David EnglandLiverpool John Moores University

Whole Body Interaction: Opportunities and Challenges

Liverpool

•Liv. Pic

Non-Photorealism•Wet and

•Cockshott, England, Waite - movement (and mapping) qualities of paint

Workshops• First Workshop Liverpool: Whole Body

Interaction: The Future of the Human Body - 2007

• Interdisciplinary workshop of artists and scientists

• Fitted in with FACT’s Future of the Human Body Exhibition

•Subsequent workshops at CHI2009, CHI2010 and ACE2011

Why Whole Body Interaction

•A reaction against:

•{Virtual, Mixed, Augmented} Realities

•Mobile, Ubiquitous Interaction

•Where the focus became/is increasing the technology and not the person or people interacting

WBI•But more positively...

• A reaction to Bill Buxton’s Challenge to create interfaces that made fuller and better use of human capabilities

•And a reaction in favour of embodied/located action- following Suchman’s work on Plans and Situated Action

“Naturalism”• Scot mentioned non-photorealism yesterday

• Central to discussions of mappings in WBI

• Current move to NUI may be misleading

• Is the most “natural” mapping also the most

• engaging

• interesting

• effective .... ? • Compare Randal Smith’s continuum of Literal to Magical

mappings in the ARK

Mixed Hello

•Open source camera vision work by Josh Nimoy - jMyron toolkit - edge detection

C0d3

•Multi-device work by Caen Botto MAXMSP - Magic of the Spell “Magic Mapping”

Evolution

•Challenge Evolution of devices and technology

•WBI == movement, physiology, emotion, context, location, social connection etc etc.

•But emotional inference, for example, currently has 70-80% recognition rates with a small range of emotions

Autonomic models•Our solution: the triangulation of

inferences by combining multiple sources

•Works on the principle of Autonomic Computing (invented by IBM) for self-managing systems

•WBI interfaces and modules can be plugged in and replaced as they evolve

Future•CHI2012 Community of Digital Arts -

David England, Jill Fantuzacoffin

•Various Activities at the conference

•CHI2013 in Paris - the Digital Arts Community will continue

•We invite you to submit, participate, debate