vision pk1

34
A DIY interactive 3-D device Visions Project K.1.0 by Francesca Mereu and Javier Villarroel (VLAB4D Visualization Advanced Group) http://visionlab4d.com.ar

Upload: francesca-mereu

Post on 18-Jul-2015

206 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Vision pk1

A DIY interactive 3-D device

Visions Project K.1.0

by Francesca Mereu and Javier Villarroel

(VLAB4D Visualization Advanced Group)

http://visionlab4d.com.ar

Page 2: Vision pk1

The Visions Project K. is a volumetric device that allows

pseudo visualization of 3-D objects and their interaction

with the user.

Visions Project K.

Page 3: Vision pk1
Page 4: Vision pk1

Visions Project K.

AIMS:

VISIONS Poject K. 1.0 (Interactive video hologram ), is research project on the

video holograms and interactive 3D devices, which was presented at the Medialab- Prado

Center for Digital Art Culture in Madrid in February 2012.

TO RESEARCH ON 3-D DISPLAY DEVICE AND DEVELOP A LOW COST

PROTOTYPE, EASY TO ASSEMBLE, THAT USE A OPEN SOURCE

SOFTWARE;

TO VISUALIZE 3-D IMAGE AS VIDEOHOLOGRAMS;

TO EXPERIMENT USER INTERACTION as EXPERIENCE WITH

3-D IMAGE FLOATING IN THE AIR: HAPTIC INTERACTION AND VISUAL

INTERACTION.

Page 5: Vision pk1

Firstprototype: Medialab-Prado 2009

Page 6: Vision pk1
Page 7: Vision pk1

Objects are projected onto a pyramidal structure with a LCD monitor, and due

to the special geometry of the structure, it looks like real 3-D objects floating

inside the pyramid for any observer from any direction.

Visions Project K.

How visualize 3-D images

Page 8: Vision pk1

Visions Project K.

Optical System

Page 9: Vision pk1

Visions Project K.

There are 2 types of interaction user: visual and haptica

The device use a Kinect camera to

capture the interaction;

a LCD monitor to projecting the 3-D

image;

a PC to process and control the

device;

a pyramidal structure where the

image is projected;

a external structure to support the

monitor and protect the pyramid;

How does it work?

Page 10: Vision pk1

DIYa digital fabrication

Visions Project K.

Page 11: Vision pk1

• This project has been

conceived like a low cost DIY

portable device;

• The structure is light and easy

of build and dismantle;

• all the information necessary

to create, build and how to make that work isshare by a Creative Commons License

Visions Project K.

Page 12: Vision pk1

Visions Project K.

OPEN DESIGN: Sketchup

The materials to build the

entire device are:

8 plastic tubes (45 cm).

4 plastic tubes (20 cm).

4 plastic triangles to build the

pyramid

4 corners to support the

pyramid and the structure.

4 corners to support the

monitor.

Page 13: Vision pk1

DIYDIGITAL FABRICATION

Visions Project K.

The elements of the structure are

printing by a Makerbot machine

(OpenFab, Medialab-Prado)

You can download Sketchup 3-D

model

http://sketchup.google.com/3dwarehouse/d

etails?mid=f20afc7c51f36aace20f58bc12c

e37ce

Page 14: Vision pk1

HardwareKinect sensor

Visions Project K.

Page 15: Vision pk1

Hardware:

Visions Project K.

LCD Monitor CPU:

Linux

Mac

Windows

3D sensor

(Kinect)

Page 16: Vision pk1

Hardware:

Visions Project K.

Kinect

IR pattern proyection

Láser IR

CMOS RGB CMOS IR

Motor

MicrophoneMicrophone

Page 17: Vision pk1

Hardware:

Visions Project K.

Kinect applications

1. 3D Scene

2. RGB Image

3.Body and objects recognition

4.Gesture Recognition

5.Voice command recognition

6.Tilt control

Page 18: Vision pk1
Page 19: Vision pk1

FLOSS

Visions Project K.

HACKING KINECT by

Page 20: Vision pk1

Software: Processing in multiplatform

• The device use a Kinect camera, in order to visualize people in 3-D

space; It use an open source drivers

• The OpenNI framework provides a set of open source APIs. These APIs are intended to become a standard for applications to access natural interaction devices.

• The APIs provide support for Voice and voice command recognition; Hand gestures; Body; Motion Tracking

• The software was developed with the OpenNI library for

Processing;

Visions Project K.

Page 21: Vision pk1

Software:

Visions Project K.

Open Libraries

1.OpenKinect Processing, others

2.SimpleOpenNIProcessing

3.dLibsProcessing

4.OfxKinectOpenFrameworks

5.Kinect Cinder Block C/C++

Page 22: Vision pk1

Software:

Visions Project K.

OpenKinect

Point Cloud

Page 23: Vision pk1

Software:

Visions Project K.

OpenKinect

Average Point Tracking

Page 24: Vision pk1

Software:

Visions Project K.

OpenKinect

1.Easy to install

2.Multiplataform

3.Easy to use

Advantage Disadvantages1.No recognition

2.No Alignment

Page 25: Vision pk1

Software:

Visions Project K.

SimpleOpenNI

Hands

Page 26: Vision pk1

Software:

Visions Project K.

SimpleOpenNI

Gestures

Page 27: Vision pk1

VLAB4D development

Visions Project K.

Processing

OpenKinect

SimpleOpenNI

3D Video for VP

háptic interaction

for VP

Telepresence for

VP

Page 28: Vision pk1

Visions Project K.

Single projection/videohologram

Page 29: Vision pk1

3D projection/Point Cloud

Page 30: Vision pk1

Visions Project K.

3D Reconstruction/ Full Color

Page 31: Vision pk1

Visions Project K.

Haptic interaction

Page 32: Vision pk1

Futures possibilities

Visions Project K.

1. Increasing the number of applications

2. Mini version for Tablet Pc, Ipad, etc..

3.Use as scientific display (biology,

arquitecture, engineering..etc..)

Page 33: Vision pk1

Visions Project K.

Page 34: Vision pk1

THANKS

http://vlab4d.wix.com

http://visionlab4d.com.ar

[email protected]

[email protected]

Visions Project K.