a pragmatic approach to implementation of emotional

A Pragmatic Approach

to Implementation of Emotional

Intelligence in Machines

Michal Ptaszynski Rafal Rzepka Kenji Araki

Language Media Laboratory

Graduate School of Information Science and Technology

Hokkaido University

Presentation Outline

1. Affective Computing (AC) - a bit of criticism

2. Our approach - Pragmatism in AC research

3. What we did already - AC through Pragmatics

4. (Near and Far) Future Work

2 5-7 November 2009AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09),

Affective Computing – Criticism

3 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009


4

Goal of Affective Computing

(Picard, 1995, 1997):

AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

To create a machine able to

understand the emotions of

a user and adapt its behavior

according to them.

R. W. Picard, "Affective Computing," MIT-TR, 321, 1995

R. W. Picard, Affective Computing, MIT Press, 1997


5

Two approaches to fulfill this goal:

1. Recognizing user emotions

(user-focused)

2. Implementing emotion experience

in machines (machine-focused)




• Human-like / Socialized Robots

• Learn about the emotion processes in humans (by analogy)

• Find a cure for psychosomatic diseases (stress, depression, etc.)

2. Emotion Experience in Machines

Motivations:



What does it mean to be HUMAN-LIKE? Charles Manson is a

human …Do we need our robots to be like C.M.?



Which robots should be human-like? Which needn’t?

Quarrels, fights and disputes are also social phenomena

User: Make me a coffee.

Robot: I’m not in the mood right now…Very human-like, but

would you buy it?




But… To actually implement emotions into machines

we already need to know the process…

And unfortu-nately…

We don’t, and our knowledge about emotions is often not computable yet.

• Learn about the emotion processes in humans (by analogy)

* GOOD EXAMPLE: see Karl Fua

• Find cure for psychosomatic diseases (stress, depression, etc.)




• For research like that you need to employ psychologists, neuropsychologists, psychiatrists, medicine doctors, more than computer scientists.

• Computer scientists: dirty work of computing the knowledge.

* GOOD EXAMPLE: see Diane Gromala

1. Emotion Recognition

Facial Expressions

Voice

Biometric data

Gestures

Language



Use some

(behavioral)

assumptions to

determine emotional

state of a human

1. Emotion RecognitionExamples of assumptions:

User is crying = sad

Speaks loudly = angry

His waving hands above his head = angry

High blood pressure = excited

Says “f*ck” = irritated



1. Emotion RecognitionExamples of assumptions:

User is crying = sad Maybe he’s cutting an onion in the kitchen?

Speaks loudly = angry

Maybe is listening to the music and cannot hear well?

His waving hands above his head = angry Maybe it means “help!”

High blood pressure = excited

Could this be hypertension?

Says “f*ck” = irritated

What is he is saying it like “Oh, f*ck, yeah!”



1. Emotion Recognition



Very little research

Simplified to motivation on

the beginning of papers

Almost no research

Problem 1.

• Need to continuously review the assumptions according to context.

Problem 3.

• Is it enough to recognize the emotions,or is there more?

Problem 2.

• How to use the recognized information further?

Our Approach – Pragmatism in AC



16

Emotions are strate-gies/abilities that (should) enhance our lives.*

Robots are tools to

enhance human lives.


*) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, 1993.


17

Emotions are strate-gies/abilities that (should) enhance our lives.*

Robots are tools to

enhance human lives.


*) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, 1993.

What functions could

robots fulfill to enhance

our (emotional) lives?



Conversation



1990. Peter Salovey & John D. Mayer:

Emotional Intelligence

The ability to recognize, monitor one's own and

others' emotions, to discriminate among them and

to use this information to guide one's thinking and

actions.

Salovey, P. & Mayer, J.D. (1990) "Emotional intelligence" Imagination, Cognition, and Personality, 9, 185-211



manage emotion in oneself

and others.Emotion management is the

final ability!



After over 15 years of Affective

Computing we’re still here!!

recognize emotions



It’s time to go a half step

further!discriminate between […]

appropriate and inappropriate

[…] expressions of emotions

Our Work – AC through Pragmatics




“I’m so happy (because) I passed the exam!”

Expressions of

emotion appearing

most often =

appropriate /natural/

for this context Confront expression from

the sentence with the list



Baseline = 45%-50%

Baseline+CVS = 50%

Blog mining = 60%

Blogs+CVS = 60%-70%

Future Work


Other abilities

are waiting!

Future Work


With EI framework Reformulate some abilities for the need of machine

implementation

There are some attempts toward other abilities in several research

With conversational agent

Gather appropriate conversational strategies

Create conversation model

Implications toward ethics Could we compute irony, sarcasm using information

about emotion appropriateness?

And a lot more!

Thank you for your attention!


a pragmatic approach to implementation of emotional

Documents