multimodal interaction r&d
DESCRIPTION
Multimodal Interaction R&D. 4 Years Dec 2003 – Dec 2007 6 M€ 32 partners + 8 fellows. Similar on the map. 32+8 institutions spread all over Europe (and one in Africa) Red : Partners Yellow : Fellows Blue : Industry. Research interests and application domains. - PowerPoint PPT PresentationTRANSCRIPT
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Multimodal Interaction R&D
• 4 Years Dec 2003 – Dec 2007• 6 M€• 32 partners + 8 fellows
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the map
32+8 institutions spread all over Europe
(and one in Africa)
Red : Partners
YellowYellow : Fellows
Blue : Industry
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Research interests and application domains
• R&D in modalities fusion and fissionSpeech, Handwriting, Gesture, Posture, Emotions, …
• 3 Actual applications domains:– Games and Education,
– Medical imaging and robotics,
– Disabled people
• 3 Future applications domains:– Interactive arts such as music and dance
– Robotic companions,
– Cars
• Next steps: Multi-user interaction and robotics - MAGI and PERGI FP7 proposals submitted
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Modalities Fusion Example
Right Hand
Left Hand
Right LegLeft Leg
Upper Body
Lower BodyBody
Gestures
Center of Gravity
Speach
Facial Emotion
Voice Emotion
MultimodalHuman
Emotion
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar achievements– The OpenInterface open source platform
– The SIMILAR multimodal behavior interpretation theory
– The SIMILAR medical image database
– The SIMILAR facial expression recognition annotated database
– Development of migratory context-aware user interfaces, standardized UsiXML language
• Many Similar achievements will continue at the end of the project:– The third summer workshop eNTERFACE in July 2007
(after Mons and Dubrovnik, we go to Istanbul)
– The JMUI journal will be distributed by Springer
– 23 PhD exchanges in 2007
– 13 books published in the SIMILAR collection
– Over 950 scientific paper published – 5 web sites (www.similar.cc, www.openinterface.org, www.jmui.org,
www.enterface.net, www.locomummy.net).
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar after 2007
Similar actions will continue under the official name:
OpenInterface Association a non-profit organisation under Belgian law.
Contact : [email protected]