mobilemonday austria #11 - usability - next generation ui - microsoft kinect

Next Generation UI Microsoft Kinect

Andreas Schabus Microsoft Österreich

aschabus@microsoft.com

Next Generation UI?

The Evolution of UIs U

ser

pro

du

ctiv

ity

Time

Batch

Command Line

Graphical User

Interfaces

1940s-1950s 1960s-1970s 1980s-today

Natural User Interfaces?

tomorrow

computer syntax, too detailed

icons, menus keyboard

mouse

human syntax images & videos touch, gestures, conversational,

intent

Natural User Interfaces (NUIs)

Minority Report, 2002

http://blogs.technet.com/b/microsoft_blog/archive/2011/01/26/microsoft-is-imagining-a-nui-future-natural-user-interface.aspx

In Germany, 79% think NUI will improve their quality

of life

http://blogs.technet.com/b/microsoft_blog/archive/2011/01/26/microsoft-is-imagining-a-nui-future-natural-user-interface.aspx

In Germany, 82% think NUI will stimulate the economy

Brain Waves

Mind control

Mood Recognition

NUI Input Methods

Computer Vision

Facial Recognition

Spatial Recognition

Augmented Reality

Gesture Sensing

Audio Recognition

Voice Command

Natural Speech

Ambient Noise

Touch

Single Touch

Multi-Touch

Pen Input

Sensors

Geospatial Sensing

Accelerometers

Biometrics

Ambient Light

NUI Output Methods

Audio

Speech Synthesis

Audible Feedback

Tactile

Haptic Feedback

Tactile Feedback

Force Feedback

Visual

Graphical Interface

Visual Feedback

Avatar

Bionic Contact Lenses

http://research.microsoft.com/en-us/collaboration/focus/health/contact-lens.aspx

Muscle Sensing Armband

Measure electrical activity with Electromyography (EMG)

http://research.microsoft.com/en-us/um/redmond/groups/cue/MuCI/

Today?

Touch Hardware Ecology

Capacitive Capacitive Infrared Vision system Stylus

Horizontal Vertical

Microsoft Kinect

RGB CAMERA

MULTI-ARRAY MIC MOTORIZED TILT

3D DEPTH SENSORS

Microsoft Kinect

Kinect for Windows SDK

http://research.microsoft.com/en-us/um/redmond/projects/kinectsdk/

NUI Skeleton Tracking

Thank You!