hcil symposium: time for events

61
time for events telling the world’s stories from social media Mor Naaman Rutgers SC&I & Mahaya, Inc. @informor

Upload: mor

Post on 18-Dec-2014

156 views

Category:

Documents


1 download

DESCRIPTION

 

TRANSCRIPT

Page 1: HCIL Symposium: Time for Events

time for events telling the world’s stories from social media

Mor Naaman Rutgers SC&I & Mahaya, Inc.

@informor

Page 2: HCIL Symposium: Time for Events

revolution take II

Page 3: HCIL Symposium: Time for Events

a new archive

Page 4: HCIL Symposium: Time for Events

needs new methods

Page 5: HCIL Symposium: Time for Events

social"media"information"lab

Page 6: HCIL Symposium: Time for Events

our work qu

alita

tive

quan

titat

ive

syst

ems

motivations,!practices

large scale quant, data mining

tools, services, !and prototypes

Page 7: HCIL Symposium: Time for Events

people, together

Page 8: HCIL Symposium: Time for Events

radiohead

Page 9: HCIL Symposium: Time for Events

byobw

Page 10: HCIL Symposium: Time for Events

pepper spray

Page 11: HCIL Symposium: Time for Events

tahrir

Page 12: HCIL Symposium: Time for Events

outside lands festival

Page 13: HCIL Symposium: Time for Events
Page 14: HCIL Symposium: Time for Events
Page 15: HCIL Symposium: Time for Events
Page 16: HCIL Symposium: Time for Events

organize the world’s memories

Page 17: HCIL Symposium: Time for Events

objectives de

tect

iden

tify

orga

nize

Page 18: HCIL Symposium: Time for Events

objectives de

tect

ICWSM 2011a JASIST 2011 WebDB 2009 SIGIR 2007

Page 19: HCIL Symposium: Time for Events

objectives

iden

tify

WSDM 2012 ICWSM 2011b WSDM 2010

Page 20: HCIL Symposium: Time for Events

objectives

orga

nize

ICMR 2012 CHI 2012

CSCW 2012 MTAP 2012 VAST 2010

WWW 2009

Page 21: HCIL Symposium: Time for Events

today de

tect

iden

tify

orga

nize

Vox!SRSR!Multiplayer

Page 22: HCIL Symposium: Time for Events

Vox Civitas hig

hligh

ts

SRSR

Multiplayer

Page 23: HCIL Symposium: Time for Events
Page 24: HCIL Symposium: Time for Events

[with postdoctoral fellow Nick Diakopoulos]

research questions how can (Twitter) content contributed around large-scale broadcast news events inform journalistic inquiry? what kinds of insights and analyses are enabled through visual analytic tools?

Page 25: HCIL Symposium: Time for Events

designing for journalism divergent points of view newsworthiness: surprising, unusual, extremes of positive / negative

Page 26: HCIL Symposium: Time for Events

supporting analysis direct attention to relevant information automatic content analysis for filtering – relevance – uniqueness / novelty – sentiment – keyword extraction

Page 27: HCIL Symposium: Time for Events
Page 28: HCIL Symposium: Time for Events
Page 29: HCIL Symposium: Time for Events

how to evaluate? directly evaluate the output of the algorithms (quantitative) deep, extensive evaluation of users’ interaction with the system (qualitative)  

read more: Olsen (UIST ’07) Naaman (MTAP ’12)

Page 30: HCIL Symposium: Time for Events

Vox evaluation goals •  How effective for generating story ideas? •  What kind of insights/analysis are supported? •  Shortcomings and how features are used?

Page 31: HCIL Symposium: Time for Events

Vox evaluation: framing •  “develop two story pitches for the event” •  open-ended questionnaires, content analysis •  18 participants

Page 32: HCIL Symposium: Time for Events

Vox Civitas hig

hligh

ts

SRSR

Multiplayer

VAST 2010

Page 33: HCIL Symposium: Time for Events

research question how can we help a journalists identify reliable, knowledgeable sources for remote breaking news events?

[with postdoctoral fellows Nick Diakopoulos, Mummun De Choudhury]

Page 34: HCIL Symposium: Time for Events

supporting analysis eyewitness detection network embeddedness user “type” classifier location embeddedness …

Page 35: HCIL Symposium: Time for Events
Page 36: HCIL Symposium: Time for Events

evaluation “technological inquiry” with working journalists not: “how our tools worked” yes: “how fits into journalistic needs, practices”

Page 37: HCIL Symposium: Time for Events

Vox Civitas hig

hligh

ts

SRSR

Multiplayer

VAST 2010

CHI 2012 CSCW 2012

Page 38: HCIL Symposium: Time for Events

what the hell?

[with: Lyndon Kennedy, Dan Ellis, Kai Su]

Page 39: HCIL Symposium: Time for Events
Page 40: HCIL Symposium: Time for Events
Page 41: HCIL Symposium: Time for Events
Page 42: HCIL Symposium: Time for Events
Page 43: HCIL Symposium: Time for Events

supporting analysis extract the signal from people’s attention: find overlapping moments compute and rank scenes extract scene descriptors

Page 44: HCIL Symposium: Time for Events

audio fingerprinting

Wang et al. (ISMIR ’03)

Page 45: HCIL Symposium: Time for Events

a story of two clips

Page 46: HCIL Symposium: Time for Events

a story of two clips

0:00

0:00 3:14

2:32

Page 47: HCIL Symposium: Time for Events

a story of two clips

0:00

0:00 0:18

2:32

3:32

Page 48: HCIL Symposium: Time for Events

a story of n clips

time

Page 49: HCIL Symposium: Time for Events

clips => scenes

time Happy Birthday, Birthday

Higher Ground Encore

Page 50: HCIL Symposium: Time for Events
Page 51: HCIL Symposium: Time for Events

evaluation deployment scenario/task:

Decide whether to attend a show

Page 52: HCIL Symposium: Time for Events

Vox Civitas hig

hligh

ts

SRSR

Multiplayer

VAST 2010

CHI 2012 CSCW 2012

NM&S 2012 ICMR 2012 MTAP 2012

WWW 2009

Page 53: HCIL Symposium: Time for Events
Page 54: HCIL Symposium: Time for Events

towards better models of large-scale human attention

Page 55: HCIL Symposium: Time for Events

experience

Her story allows us to see what was lost, [and] gained, in the political, economic and social transformations of the 18th and 19th centuries.

Page 56: HCIL Symposium: Time for Events

a new archive

Page 57: HCIL Symposium: Time for Events

PUZPNO[Z°H[)**°ZJHSL

YouTubL-SPJkr

WorK7YLssTwP[[Lr

Hypotheses and

research questions

Researcher°L_WSVYLZ°KH[HEXPLORE

*VKLK°Ka[H°MVY°HUHS`ZPZ

9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE

3HYNL�ZJHSL�Kata

9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT

SOCRATES fut

ure

work

CityBeat

Page 58: HCIL Symposium: Time for Events

PUZPNO[Z°H[)**°ZJHSL

YouTubL-SPJkr

WorK7YLssTwP[[Lr

Hypotheses and

research questions

Researcher°L_WSVYLZ°KH[HEXPLORE

*VKLK°Ka[H°MVY°HUHS`ZPZ

9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE

3HYNL�ZJHSL�Kata

9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT

SOCRATES

Page 59: HCIL Symposium: Time for Events

CityBeat

Everywhere where there is an interaction between a place, a time, and an expenditure of energy, there is rhythm. - Henri Lefebvre

Page 60: HCIL Symposium: Time for Events

Luis Gravano Hila Becker Nick Diakopoulos Kai Su Dan Ellis Munmun de Choudhury Tarikh Korula …

thanks

Page 61: HCIL Symposium: Time for Events

[email protected] @informor

http://mornaaman.com

questions?