gamification-supported exploration of natural user interfaces

Technische Universität München Distributed Multimodal Information Processing Group

Gamification-supported Exploration of Natural User Interfaces

Stefan Diewald1, Andreas Möller1, Luis Roalter1, Matthias Kranz2

1Technische Universität München, Germany 2Luleå University of Technology, Department of Computer Science,

Electrical and Space Engineering, Luleå, Sweden

October 17, 2012 2nd Workshop on Automotive Natural User Interfaces (AutoNUI) at the 4th International Conference on

Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Portsmouth, NH, USA


Starting Situation: Complex Automotive User Interfaces

17.10.2012 Stefan Diewald 2

Image sources: Wikimedia Commons; http://www.e31.net/pics/Bordcomputer.jpg; http://www.auto123.com/ArtImages/102556/BMW_I_drive_i2.jpg;

Finding a desired functionality can be very time and attention-consuming.


Countermeasure: Natural User Interfaces


Image sources: http://www.autoguru.at/wp-content/uploads/2012/03/audi_multitouch_11.jpg; http://www.bmw.com/com/en/insights/technology/technology_guide/articles/_shared/img/voice_control_system.jpg

Natural User Interfaces: §  Multi-touch §  Gestures §  Voice dialogs §  … Less distraction and better user experience?


“Natural user interfaces are not natural”


“Speech utterances will have to be learned and gestures carefully developed and standardized through time.”

“None of these systems is inherently more natural than the others.”

Donald A. Norman. 2010. Natural user interfaces are not natural. interactions 17, 3 (May 2010), 6-10.


DriveAssist – Driver Assistance and Awareness System


§  Runs on mobile devices (Android smartphones and tablet PCs) §  Multi-touch for interacting with the map view


DriveAssist – Driver Assistance and Awareness System



Interaction problems with DriveAssist

First test: §  difficulties in exploring touch menus §  unaware of gestures: e.g. “pinch-to-zoom” & rotation



“Did you know?”-hints for DriveAssist


12 participants

45 minutes

only 7 did notice the hint

and only 1 found the hint useful


The Challenge

Create a strong motivation for exploring natural user interfaces in the automotive domain:

§  Uncover hidden functions

§  Make usage more comfortable



The Idea: 1 - Gamification


… the use of game design elements in non-game contexts.

Sebastian Deterding et al. 2011. From game design elements to gamefulness: defining "gamification". In Proceedings of the 15th International Academic MindTrek Conference. ACM, New York, NY, USA, 9-15.


Gamification Example


Image sources: http://aboutfoursquare.com/wp-content/uploads/2011/03/photo-11.png; http://cdn3.techworld.com/cmsdata/reviews/3210966/foursquare_badges_360.jpg;


The Idea: 2 - Share and Compare


Image sources: http://www.uplaude.com/blog/; Wikimedia Commons; Nike+


Gamification in the Automotive Domain


MyFord – collect badges online. Chevy Volt – dashboard gamification for efficient driving.


Gamification-supported Exploration of NUIs


One-time badges For more common functions.

Experience Levels For less known and less

accessed functions.


What can be gained?


…

Open the windows through voice control.

Enter a navigation target via handwriting recognition.

Change the chassis configuration via voice control.

…

x1


When to award a Badge or Level-up?



How to award a Badge or Level-up?


Congratulations, you have just unlocked the “navigation target badge” by entering your destination via voice control.


“Share and Compare”


Image sources: http://2.bp.blogspot.com/-77IL5MZo1mQ/UDIpMenIf2I/AAAAAAAAPLg/szq3N3Iyj1Y/s1600/Tank.jpg

Share new badges and experience level-ups directly with friends in real time.


The Goal

Create a strong motivation for exploring natural user interfaces in the automotive domain,

… that is at least maintained until the user is used to the system.



Future Work



Thank you for your attention! Questions?

? ? Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 21

[email protected] www.vmi.ei.tum.de/team/stefan-diewald.html


Paper Reference

•  Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/GamificationNUI_preprint.pdf

•  Please cite this work as follows: •  Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.

Gamification-supported Exploration of Natural User Interfaces In: Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI2012), pp. 47-48, Portsmouth NH, USA, October 2012

Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 22


If you use BibTex, please use the following entry to cite this work:

Oct 15, 2012 A. Möller, S. Diewald, L. Roalter, M. Kranz 23

@INPROCEEDINGS{NUIGamification2012, author = {Stefan Diewald and Andreas M\"{o}ller and Luis Roalter and Matthias Kranz}, title = {{Gamification-supported Exploration of Natural User Interfaces}}, booktitle = {{Adjunct Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI 2012)}}, year = {2012}, month = oct, pages = {47--48}, location = {Portsmouth NH, USA}, }

gamification-supported exploration of natural user interfaces

Automotive

stefan diewald5

stefan diewald9

stefan diewald6

stefan diewald17

stefan diewald7

stefan diewald16

stefan diewald10

stefan diewald11