accessing large av collections using visual analysis in digital humanities
DESCRIPTION
On the use of visual analysis technology to search audiovisual collections for research in the digital humanities. The presentation explains the audiovisual archive approach wrt access in general using visual analysis and discusses how this could fit into the practice of DH research on the basis of the results of the FP7 project AXES.TRANSCRIPT
![Page 1: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/1.jpg)
ACCESSING LARGEAUDIOVISUAL COLLECTIONS
USING VISUAL ANALYSISAV IN DH WORKSHOP @ DH2014 LAUSANNE
ROELAND ORDELMAN
![Page 2: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/2.jpg)
![Page 3: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/3.jpg)
NETHERLANDS INSTITUTE FOR SOUND AND VISION
![Page 4: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/4.jpg)
BUSINESS ARCHIVE DUTCH PUBLIC BROADCASTERS
![Page 5: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/5.jpg)
LARGE DIGITIZATION PROGRAMS
![Page 6: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/6.jpg)
CLARIAH PRESENTATIE 11 September 2013
6
+800.000 hours of audiovisual content
‘POTENTIAL’
![Page 7: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/7.jpg)
Find what you were (not) looking for
![Page 8: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/8.jpg)
![Page 9: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/9.jpg)
Browse video to find what you were looking for
X
![Page 10: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/10.jpg)
We need labels!
![Page 11: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/11.jpg)
Labels connect(content, context)
![Page 12: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/12.jpg)
Labeling
![Page 13: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/13.jpg)
CLARIAH PRESENTATIE 11 September 2013
13
BIG DATA!
![Page 14: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/14.jpg)
CLARIAH PRESENTATIE 11 September 2013
14
INNOVATIVE PLATFORMS
![Page 15: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/15.jpg)
We need USEFUL labels
![Page 16: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/16.jpg)
16
USEFUL?
Developer/ICT researcher
DH Researcher
![Page 17: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/17.jpg)
17
FEEDBACK
![Page 18: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/18.jpg)
Research & Education
Broadcast Professionals
Hergebruik
Media Archivists (documentalisten)
Beschrijven
Journalists Research
Academic researchers Investigate
Education Illustrate
![Page 19: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/19.jpg)
19
Use Scenarios&
System Requirements
Interview & elicitation sessions
Mock-up creation & evaluation
Prototype evaluation
System evaluation
Surveys & log analysis
Qualitative
Qualitative
QualitativeQuantitative
Quantitative/Qualitative
![Page 20: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/20.jpg)
![Page 21: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/21.jpg)
BUILDING PROTOTYPES
![Page 22: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/22.jpg)
2012
2013
-PRO
-RES
Onderzoekers
Media Professionals
![Page 23: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/23.jpg)
<nisv@axes> ls –lTotal 10-r--r--r--. 1 nisv axes 301 Jun 26 2011 METADATA-r--r--r--. 1 nisv axes 301 Jun 26 2011 SUBTITLES-r--r--r--. 1 nisv axes 301 Jun 26 2011 SPEECH RECOGNITION-r--r--r--. 1 nisv axes 301 Jun 26 2011 FACE RECOGNITION-r--r--r--. 1 nisv axes 301 Jun 26 2011 VISUAL CONCEPT DETECT-r--r--r--. 1 nisv axes 301 Jun 26 2011 EVENT DETECTION-r--r--r--. 1 nisv axes 301 Jun 26 2011 LOCATION DETECTION-r--r--r--. 1 nisv axes 301 Jun 26 2011 QUERY BY EXAMPLE-r--r--r--. 1 nisv axes 301 Jun 26 2011 SEARCH-r--r--r--. 1 nisv axes 301 Jun 26 2011 RECOMMENDATION-r--r--r--. 1 nisv axes 301 Jun 26 2011 USER INTERFACE<nisv@axes> |
![Page 24: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/24.jpg)
Face Recognition
![Page 25: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/25.jpg)
Query by example
![Page 26: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/26.jpg)
DETECTION REQUIRES TRAINING(EXAMPLES)
2nd EC review meeting – Hilversum – Mar 19th 2013
![Page 27: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/27.jpg)
2nd EC review meeting – Hilversum – Mar 19th 2013
EXPECTATION MANAGEMENT
![Page 28: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/28.jpg)
2nd EC review meeting – Hilversum – Mar 19th 2013
![Page 29: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/29.jpg)
Expectation Management
• Expectation management:– Training examples versus result list– Google images search versus visual search in AV
• Understanding visual search:– why something is hard to detect
• visual characteristics, training examples
– Noise is not bad per definition
![Page 30: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/30.jpg)
DH perspective
• First explorations in various projects– Requirements studies– Demonstrations– Prototypes
• Technology is ready to start exploring its use in real use scenarios (e.g., query by example)
• Feed DH ideas into ICT research community
![Page 31: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/31.jpg)
Technology exists that could helpTechnology does not solve all
problemsDiscuss with ICT experts
Technology has a price, what is the RoI?
AWARENESS
How does technology fit inHow do limitations fit in
‘Technology Critique’ (Historian 2.0?)ICT and curriculum
METHODOLOGY/TRAINING
What can it do?How does it work?
How does it perform?How can it be improved?
MICRO MACRO
How can we use it?What do we need?How does it scale?
Who could benefit as well?
![Page 32: Accessing Large AV Collections using Visual Analysis in Digital Humanities](https://reader038.vdocuments.site/reader038/viewer/2022110303/54b9fbc04a7959e9098b461f/html5/thumbnails/32.jpg)
www.axes-project.euroelandordelman.nl
Questions?
<nisv@axes>
<nisv@axes>