artificial conversational intuition...conversations take place on two channels 1: directly...

37

Upload: others

Post on 28-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly
Page 2: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Cristian Danescu-Niculescu-MizilCornell University

Artificial Conversational Intuition

Page 3: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Artificial Conversational Intuition

Cristian Danescu-Niculescu-Mizil

Cornell University

Microsoft Research Faculty Summit 2017

Page 4: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Conversations take place on two channels

1: Directly communicating information

Page 5: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Conversations take place on two channels

1: Directly communicating information

2: Meta-information about the conversation

unknowingly & unwillingly

subtle signals, e.g.,body languagestyle matchingparalinguistic cues

Page 6: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Meta-conversational channel

Off-line: conversational intuitionaligns intentions and perceptions (Tannen, 2005)

Page 7: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Meta-conversational channel

Off-line: conversational intuitionaligns intentions and perceptions (Tannen, 2005)

On-line: these signals are mutedwe aren’t (yet) attuned to new signals

Page 8: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:

Page 9: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)

Page 10: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)> Most attacks made by “regular” users!

(Cheng, Bernstein, D-N-M, Leskovec, 2017; Wulczyn et al., 2017)

Page 11: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)> Most attacks made by “regular” users!

(Cheng, Bernstein, D-N-M, Leskovec, 2017; Wulczyn et al., 2017)

> 20% of teams perform worse than the worst individual in the team!(Niculae and D-N-M, 2016; Fu, Lee, D-N-M, 2017)

Page 12: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)> Most attacks made by “regular” users!

(Cheng, Bernstein, D-N-M, Leskovec, 2017; Wulczyn et al., 2017)

> 20% of teams perform worse than the worst individual in the team!(Niculae and D-N-M, 2016; Fu, Lee, D-N-M, 2017)

Page 13: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)> Most attacks made by “regular” users!

(Cheng, Bernstein, D-N-M, Leskovec, 2017; Wulczyn et al., 2017)

> 20% of teams perform worse than the worst individual in the team!(Niculae and D-N-M, 2016; Fu, Lee, D-N-M, 2017)

Page 14: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Perplexing conversational failures online:> 40% users personally harassed online (Pew Survey, 2014)> Most attacks made by “regular” users!

(Cheng, Bernstein, D-N-M, Leskovec, 2017; Wulczyn et al., 2017)

> 20% of teams perform worse than the worst individual in the team!(Niculae and D-N-M, 2016; Fu, Lee, D-N-M, 2017)

Page 15: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Lost meta-conversational channel-> misaligned intentions and perceptions

Online platforms need to compensate…

Page 16: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

“Linguistic harbingers of betrayal”(Niculae, Kumar, Boyd-Graber, D-N-M, 2015)

Proof of concept:

Misalignment of intentions and perceptions

Page 17: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal presupposes a trust relation(unlike deception)

Work on deception:[e.g., Newman et al. 2003, Hancock et al. 2007, Mihalcea & Strapparava 2009, Ott et al. 2011]

Proof of concept:

Misalignment of intentions and perceptions

Page 18: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal

Frie

ndsh

ipEn

mit

y

Page 19: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal

Enm

ity

Frie

ndsh

ip

Page 20: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal

Enm

ity

Frie

ndsh

ip

Page 21: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal

Enm

ity

Frie

ndsh

ip

“9th circle awaits you!”

Page 22: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Enem

ies

BetrayalCan we detect signals of upcoming betrayal?

Frie

ndsh

ip

Page 23: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Enem

iesBe

trayal

Can we detect signals of upcoming betrayal?

Tricky because:

> betrayers actively hide it

Frie

ndsh

ip

Page 24: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Enem

iesBe

trayal

Can we detect signals of upcoming betrayal?

Tricky because:

> betrayers actively hide it

> victims do not see it coming

Frie

ndsh

ip

Page 25: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Enem

iesBe

trayal

Can we detect signals of upcoming betrayal?

Main intuition: misalignment will be reflected in

imbalances in conversational patterns

Frie

ndsh

ip

Page 26: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

EnmityFriendship time

Misalignmentvia conversational imbalance

Sent

imen

t im

bala

nce

Betrayal

[]…

Page 27: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Sent

imen

t im

bala

nce

BetrayalEnmityFriendship time

[]…

Misalignment via conversational imbalance

Page 28: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Sent

imen

t im

bala

nce

BetrayalEnmityFriendship time

[]…

Misalignment via conversational imbalance

Page 29: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Betrayal

Sent

imen

t im

bala

nce

Sent

imen

t

cf. Gottman (1993): stable relations are affectively balanced

EnmityFriendship time[]…

[]…

Misalignment via conversational imbalance

Page 30: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Plan

ning

Plan

ning

im

bala

nce

Betrayal

cf. Christensen (1990): Demand-Withdraw pattern

EnmityFriendship time[]…

[]…

Misalignment via conversational imbalance

Page 31: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Polit

enes

sPo

liten

ess

imba

lanc

e

Betrayal

“It’s not me it’s you.”

EnmityFriendship time[]…

[]…

Misalignment via conversational imbalance

(D-N-M

, Sudhof, Jurafsky, Leskovec, Potts, 2013)

Page 32: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Artificial Conversational Intuition

Page 33: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Artificial Conversational Intuition

> recover key meta-conversational signals> predict undesired outcomes> act to keep conversations on track

Page 34: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Artificial Conversational Intuition

> recover key meta-conversational signals> predict undesired outcomes> act to keep conversations on track

Socially sensitive…… online discussion platforms… reply suggestions … conversational assistants

Page 35: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly

Pannel

Page 36: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly
Page 37: Artificial Conversational Intuition...Conversations take place on two channels 1: Directly communicating information 2: Meta-information about the conversation unknowingly & unwillingly