using rhetorical annotations for generating video documentaries stefano bocconi, frank nack, lynda...
TRANSCRIPT
Using Rhetorical Annotations for Generating Video Documentaries
Stefano Bocconi, Frank Nack, Lynda HardmanCWI AmsterdamThe Netherlands
Contact: [email protected]
2
Talk Outline
The motivation and vision of the work Annotations Editing Process Conclusions
3
Video Documentaries on the Web
Traditional video authoring: there is only one final version, what is shown is the choice of the author/editor
Proposed video authoring: Annotate the video material semantics Present it automatically to the viewer in
an interesting way, selecting what the user asks to see
4
Video material
Interview with America: video footage with interviews and background material about the opinion of American people after 9-11www.interviewwithamerica.com
Annotations: 1 hour annotated, 15 interviews, 60 interview segments, 120 statements
5
What do you think of the war in Afghanistan?
6
Analysis of the Example
Claim
Concession
Claim contradict
supportClaim
I am not a fanof military actions
War has never solved anything
Two billions dollar bombs on tents
I cannot think of amore effective solution
weaken
7
The annotations
Rhetorical Rhetorical Statement (mostly verbal, but
visual also possible) Argumentation model: Toulmin model
Descriptive Question asked Interviewee (social) Filmic (e.g. location/time/framing/gaze)
8
Encode statements Statement formally annotated:
<subject> <modifier> <predicate> E.g. “war best solution”
A thesaurus containing: Terms (155) Relations between terms: similar (72),
opposite (108), generalization (10), specialization (10)
E.g. war opposite diplomacy
9
Connect statements Using the thesaurus, generate related
statements and query the repository E.g. from “war best solution” “diplomacy
best solution”, “war not solution” Create a graph of related statements
Nodes are the statements (video segments), edges are either support or contradict
10
Toulmin model
ClaimData
Qualifier
Warrant
Backing
Condition
Concession
57 Claims, 16 Data, 4 Concessions, 3 Warrants, 1 Condition
11
Analysis of the Example
Claim
Concession
Claim contradict
supportClaim
I am not a fanof military actions
War has never solved anything
Two billions dollar bombs on tents
I cannot think of amore effective solution
weaken
12
Current Work Partially tunable: examining the
Segment graph gives feedback on the quality of the annotations and the thesaurus
Possible user profiling or different points of view with different thesauri
S1
S2
S3 S5
S4
S7
S6
S8
S9
S10
= support
= contradict
13
Conclusions
Annotate: 3-part Statements Thesaurus Toulmin model
Create a statement graph Present an interview augmented with
supporting or contradicting material
14
Pointers & Acknowledgments
This presentation and Demo available at:http://www.cwi.nl/~media/demo/IWA/
This research was funded by the Dutch national ToKeN2000 I2RP and CHIME projects.
15
Questions?
Thanks for your attention