jtel2012 emotion and games in technology-enhanced learning
DESCRIPTION
"Emotion and games in technology-enhanced learning" presentation at the 2012 Joint European Summer School on Technology Enhanced Learning in Estoril, PortugalTRANSCRIPT
![Page 1: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/1.jpg)
Emotion and games in technology-enhanced learning
JTEL 2012
Kostas KarpouzisNational Technical University of Athens
![Page 2: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/2.jpg)
a bit of theory
the quest for Flow (and fun)
![Page 3: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/3.jpg)
a theory of fun
• Raph Koster– lead designer of Ultima
Online– creative director of Star Wars
Galaxies– http://
www.theoryoffun.com/theoryoffun.pdf
– http://www.raphkoster.com
![Page 4: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/4.jpg)
![Page 5: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/5.jpg)
![Page 6: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/6.jpg)
![Page 7: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/7.jpg)
![Page 8: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/8.jpg)
![Page 9: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/9.jpg)
![Page 10: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/10.jpg)
![Page 11: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/11.jpg)
![Page 12: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/12.jpg)
![Page 13: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/13.jpg)
a theory of fun
• ‘all games are edutainment’– ‘some games teach spatial relationships (e.g.
Tetris)’– ‘some teach you to explore (Super Mario)’– ‘some teach you how to aim (FPSs)’– some teach you to share/cooperate (Farmville)– ‘players seeking to advance in a game will always
try to optimize what they are doing’
![Page 14: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/14.jpg)
a theory of fun
![Page 15: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/15.jpg)
a theory of fun
• ‘We talk so much about emergent gameplay, non-linear storytelling, or about player-entered content. They’re all ways of increasing the possibility space, making self-refreshing puzzles’
• So, what is it that makes a game ‘fun’?
![Page 16: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/16.jpg)
the concept of Flow– a state of concentration or complete absorption with the
activity at hand and the situation. It is a state in which people are so involved in an activity that nothing else seems to matter (Csikszentmihalyi,1990)
– “Being completely involved in an activity for its own sake. The ego falls away. Time flies. Every action, movement, and thought follows inevitably from the previous one, like playing jazz. Your whole being is involved, and you're using your skills to the utmost”
![Page 17: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/17.jpg)
![Page 18: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/18.jpg)
flow revisited
• the ‘holy grail’ of game design
• just the right amount of challenge
• making a game very hardgamers quit
• making a game very easygamers bored
![Page 19: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/19.jpg)
flow revisited
• it’s not about the graphics
• or the controller• or the franchise (e.g.
sports games)• just ask Rovio
– makers of Angry Birds– $80M/yr, 600M dl’s
![Page 20: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/20.jpg)
flow revisited
• ‘smart’ games adapt to player skill and engagement
• keeping them coming back for more
• at the end of the day…
![Page 21: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/21.jpg)
that’s flow!
![Page 22: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/22.jpg)
what about serious games?
• our first activity as children
• ‘fun’ and ‘flow’ are a given
![Page 23: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/23.jpg)
what about serious games?
• our first activity as children
• ‘fun’ and ‘flow’ are a given
• best material to teach social skills
![Page 24: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/24.jpg)
what about serious games?
• our first activity as children
• ‘fun’ and ‘flow’ are a given
• best material to teach social skills
• but schools fail to capitalize on that
![Page 25: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/25.jpg)
gamification
• the best one way to influence player behaviour• include game design elements in non-game contexts
![Page 26: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/26.jpg)
gamification
• image by Sebastian Deterding• Bunchball white paper: http://info.bunchball.com/gamification-101/
![Page 27: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/27.jpg)
gamification
• in Foursquare, users earn points for check-ins and other activities
• leaderboards and badge display enhance competition
![Page 28: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/28.jpg)
gamification
• replace ‘check-in’ with, e.g., ‘recycle’– gamification in the real
world
![Page 29: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/29.jpg)
gamification
• replace ‘check-in’ with, e.g., ‘recycle’– gamification in the real
world• what happens when
badges and rewards are taken away?– open research question
![Page 30: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/30.jpg)
in a nutshell
• games provide challenge and fun to players– or should be adapted to do so
• fun not always equal to entertainment– the case of serious/learning games
• player experience: function of skill, performance and challenge
![Page 31: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/31.jpg)
user modelling
![Page 32: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/32.jpg)
player personalities
• Richard Bartle– co-creator of MUD1
(the first MUD)• Bartle Test of Gamer
Psychology– series of questions to
players of MMOs into categories based on gaming preferences
![Page 33: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/33.jpg)
player personalities
![Page 34: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/34.jpg)
player personalities
• Achievers: players who prefer to gain points, levels, equipment and other concrete measurements of succeeding in a game
• Explorers: players who prefer discovering areas, creating maps and learning about hidden places
![Page 35: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/35.jpg)
player personalities
• Socializers: players who choose to play games for the social aspect, rather than the actual game itself
• Killers: players who like to …‘club’ other players– They thrive on competition with other
players, and prefer fighting them to scripted computer-controlled opponents.
![Page 36: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/36.jpg)
player personalities
• Bartle Quotient totals 200% across all categories, with no single category exceeding 100%
• A person may score "100% Killer, 50% Socializer, 40% Achiever, 10% Explorer“– indicating preference to fight people compared to
other aspects of gameplay• but…
![Page 37: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/37.jpg)
player personalities
• these are self-reported characteristics– mostly refer to what players would prefer to do
and not necessarily what they actually do when playing
• game genre-specific– and different for single- and multi-player gaming
• offer little in terms of adaptation– mostly refer to game mechanics and features
![Page 38: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/38.jpg)
back to the drawing board
• what can we model? – and how?
• definition of ‘affective computing’– ‘affective Computing is computing that relates to,
arises from, or deliberately influences emotion or other affective phenomena’ -- Roz Picard, 1995
– ‘a set of observable manifestations of a subjectively experienced emotion’ -- Merriam-Webster’s dictionary
![Page 39: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/39.jpg)
observable manifestations
![Page 40: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/40.jpg)
observable manifestations
![Page 41: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/41.jpg)
hypothesis
• ‘shallow’ treatment– i.e. not as far as ‘personality’, sticking to ‘affect’
• identify/track user reactions– facial expressions and gestures, body movements
and stance, hand and body expressivity (for whole-body interaction)
• relate those to events in the game
![Page 42: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/42.jpg)
hypothesis
• ideally, we could identify the players’ stress level (via the ‘observable manifestations’) and their skill level (via their performance)
• and cluster those to identify player types– for the particular game genre!
• or use them to adapt the game– make it easier for players ‘in distress’– or harder for players in the verge of boredom
![Page 43: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/43.jpg)
hypothesis
• why bother with both affect and performance?
• why are players standing still?– is it flow (immersion) or boredom?
• or why do they move around?– is it immersion (e.g. in a racing game) or lack of
engagement?• remember: Flow skill AND engagement
![Page 44: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/44.jpg)
we’ve covered affect;what else is there?
• cognitive models (Gray, 2007)– evaluate why players behave in the way that they do, or
conversely to control computer-driven AI (Funge, 1999)• cultural models
– “collective programming of the mind which distinguishes the members of one group or category of people from another” (Hofstede, 1996)
– not necessarily related to player origin or descent (e.g. sub-cultures)
![Page 45: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/45.jpg)
we’ve covered affect;what else is there?
• learner models– students motivation strongly linked to learning (Malone
and Lepper, 1987)– demographic information and personality understand
and predict the student’s learning behavior– demographics (gender), personality (Big 5: openness,
conscientiousness, extraversion, agreeableness, neuroticism), goal orientation (performance based on result or mastery on skill), and presence (involvement with the system) (McQuiggan et al., 2010)
![Page 46: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/46.jpg)
in a nutshell
• games provide an ideal medium to induce and capture affective interactions
• well-designed games bring out different (and valuable!) reactions from players
• gaming is a multi-faceted activity– thus, player models are usually detailed
• player affect tells us a lot about the game
![Page 47: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/47.jpg)
lessons learned
the Siren project
![Page 48: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/48.jpg)
conflict resolution games
• Siren aims to produce a conflict resolution serious game– for 10-14 y.o. children– in school
environments
![Page 49: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/49.jpg)
conflict resolution games
The life cycle of conflict (Swanstrom and Weissmann, 2005)
![Page 50: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/50.jpg)
conflict resolution games
• during escalation, negative emotions are present• cannot use neg. emotions to indicate stress adaptation
![Page 51: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/51.jpg)
conflict resolution games
• rather, use estimated emotion to identify where players are in this figure (which phase)
![Page 52: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/52.jpg)
conflict resolution games
• and produce content to ‘push’ users towards de-escalation• learning objective of the game!
![Page 53: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/53.jpg)
conflict resolution games
• sensed affect can be used to identify player performance– i.e. whether players actually ‘move’ towards
resolving the conflict• but which emotions are relevant?• negative vs positive• is that enough for all game genres?
![Page 54: JTEL2012 emotion and games in technology-enhanced learning](https://reader033.vdocuments.site/reader033/viewer/2022051609/546a4780af79597f788b4bb0/html5/thumbnails/54.jpg)
in a nutshell
• player affect is genre-dependent• reflects many qualities from the user model• many open research questions• single- vs multi-player• easy to find people to play games
– yay!