interacting with social media content about events

interacting with social media content about events

Mor Naaman

Rutgers SC&I

social media information lab?

social media research:

1. what are people doing (and why)?

social media research:

2. understanding social systems at scale

social media research:

3. creating new experiences

events in social media

BYOBW

Vox Civitas: reasoning about events with social media content

Multiplayer: organizing social multimedia content from live events

evaluating social multimedia experiences ov

ervi

ew

social multimedia

social multimedia

online sources of multimedia content posted in settings that foster significant individual participation and that promote community curation, discussion and re-use of content.

social multimedia on Twitter

“media’s conversational shadow”

- @ayman

research questions

how can (Twitter) content contributed around large-scale broadcast news events inform journalistic inquiry?

what kinds of insights and analyses are enabled through visual analytic tools?

how to build better tools to support journalistic inquiry?

“Hey Fellas, have a look

at this scoop I just pulled from TWITTER.”!

designing for journalism

what would a journalist ask of Twitter?

tendency to cover “decisive moments”, divergent points of view, audience criticism/applause

newsworthiness: favors surprising, unusual, good / bad

useful indicators: –  sentiment: applause, criticism, controversy, good /

bad –  response magnitude: quotes, topics / issues –  unique / novel contributions

supporting analysis

direct attention to relevant information

automatic content analysis for filtering –  relevance – uniqueness / novelty – sentiment – keyword extraction

vox civitas

Nicholas Diakopoulos, Mor Naaman, Funda Kivran-Swain,

Diamonds in the Rough: Social Media Visual Analytics for Journalistic Inquiry (VAST 2010)

http://sm.rutgers.edu/vox

Vox Civitas: reasoning about events with social media content

Multiplayer: organizing social multimedia content from live events

evaluating social multimedia experiences ov

ervi

ew

social multimedia

social multimedia on YouTube

research questions

how can we transform the consumption of video content created by users attending large-scale events?

what kinds of practices and user tasks can be enabled through a new experience?

how to build better tools to leverage the social context of video capture?

Lyndon Kennedy and Mor Naaman. Less Talk, More Rock (WWW 2009)

1 master’s student

3 months

relive with YouTube

Multiplayer (w/ Coco)

multiple perspectives:

relevance

no redundancy

improves as content added

leverages social metadata

Nicholas Diakopoulos, Mor Naaman, Tayebeh Yazdani, Zihao Yu. Navigating Events in a Multi-Perspective Social Video Browser (in submission)

Vox Civitas: reasoning about events with social media content

Multiplayer: organizing social multimedia content from live events

evaluating social multimedia experiences ov

ervi

ew

challenge: evaluate!

challenge: evaluate!

produce insights about use and usefulness that go beyond a specific implementation

challenge: evaluate!

what are the di!erent factors that are in play when users interact with the new application?

challenge: evaluate!

how do users perceive and understand the presentation and interaction mode?

challenge: evaluate!

how does the new experience help (or hinder) users in performing tasks?

two-pronged approach

directly evaluate the output of the algorithms (quantitative)

deep, extensive evaluation of the users interaction with the system or interactive prototype (qualitative) in the context of their task

read more: Olsen (UIST ’07); Naaman (MTAP ’10)

Multiplayer study goals

what utility is provided to event content consumption?

how users interact with a multi-perspective videos from an event?

laboratory study

two tasks/scenarios: – seen a show, reminisce/share – considering a show, checking it out

data collected –  think-aloud data – detailed, open-ended questionnaire –  Interaction logging

data analysis

themes extracted from notes, transcripts

logging data examined for support

insights: event viewing

seeing all activities on stage

“There’s a lot of activities on stage ... normally I would not be able to see everything at once and this allows me to do that”

insights: event viewing

“being there”

“get an idea of what it’d be like to be in the audience”

“This preview is better than a seating chart!”

insights: interaction

thumbnails natural, timeline not so much

audio switching problematic

insights: taking control

users expressed need, desire to generate new media artifacts

If I really like a certain performance then I’d set it up as a mini-editor to have a super-customized version of this great event”

Vox study goals

how do journalists use Vox Civitas and what is its journalistic utility?

what features do journalists interact with?

what kinds of insights does Vox Civitas support?

online study

deployment scenario/task:: –  “use the tool to develop two story pitches for

the event”

data collected – detailed, open-ended questionnaires –  interface logging

participants –  15 / 18 with training in journalism

data analysis

themes extracted from answers to questionnaire

types of story angles

logging data examined for support

insights: utility

ideas for follow-up; mechanism to find sources

“figure out what statement resonated the most with the public”

“used as a compliment to stories that include more sound data”

insights: story angles

audience response in multiple scales –  individual – aggregate volume, sentiment

insight: using search

Keyword searches and filtering helped find story angles

“Further investigation into statistics on college loan debt. How much are students carrying? And how long does it take to pay o!?”

insight: using search

Keyword searches and filtering helped find story angles

““I chose the keyword ‘overseas’. This gave me more of mixed emotions for the audience due to the slash in tax breaks being given to companies who ship their jobs overseas”

created new experiences for social media content from/about events

evaluations resulted in insights that are not necessarily tied to particular implementation sum

mar

y

joint work with superstars:

Nicholas Diakopoulos

Funda Kivran-Swaine

Tayebeh Yazdani

Zihao Yu

than

ks to…

mor@rutgers.edu

mornaaman.com

@informor

join us at rutgers SMIL

(email me or introduce yourself)

than

k yo

u