Kyle RaffertyBiomedical Engineering

University of Rhode Island

Developed by Pranav Mistry Research assistant/PhD candidate MIT

Portable device that is worn around neck Consists of:

Camera Colored Markers Projector *a smart phone

Camera: tracks the movement of the colored markers using movement algorithms.

Colored Markers: Red, blue, green, and yellow tape worn on the users fingertips for tracking purposes.

Projector: Projects stored data onto most any surface.

Smart phone: needed for internet connection and computing power

Recognizes hand movements Examples from online demonstrations:

Make frame with hands: camera takes picture Google map onto wall Draw circle on wrist: projects digital clock Movement of text book/web info onto page Airline ticket updates Draw @ symbol: check email for you Many more capabilities (it’s on youtube or TED

website)

Cost: ~300$ Software will be open source

Many possible medical applications using the technology Surgical procedures (using tracking

capabilities) Rehabilitation techniques

Sources: “About (Pranav Mistry)” pranav::mistry. 2010. Apr 1 2010.

http://www.pranavmistry.com/ Mistry, Pranav. “About (SixthSense)”. 2010. Apr 2, 2010.

http://www.pranavmistry.com/projects/sixthsense/ “Pranav Mistry’s: The Thrilling Potential of SixthSense Computing-Future of

Interface”. Boxesandarrows. Feb 2010. Apr 1 2010. http://www.boxesandarrows.com/idea/view/51321

Publications: P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. To be

appeared in SIGGRAPH Asia 2009, Sketch. Yokohama, Japan. 2009 P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. To be

appeared in SIGGRAPH Asia 2009, Emerging Technologies. Yokohama, Japan. 2009

P. Mistry. The thrilling potential of SixthSense technology. TEDIndia 2009. Mysore, India 2009

P. Mistry, P. Maes, L. Chang. WUW - Wear Ur World - A Wearable Gestural Interface. In the CHI '09 extended abstracts on Human factors in computing systems. Boston, USA. 2009