from script idea to tv rerun - linked production data in the media value chain

From Script Idea to TV RerunThe Idea of Linked Production Data in the Media Value Chain

Harald Sack, Hasso-Plattner-Institute for IT Systems Engineering, University of Potsdam, Germany

3rd International Workshop on Linked Media 2015, Florence, Italy, May 18, 2015CC BY-NC-SA 2.0


Harald Sack, From Script Idea to TV Rerun, LIME 2015, Florence, Italy, May 18, 2015

Content:1. (Meta)data Exchange in the Media Value Chain2. The dwerft Project 3. Data Integration via Linked Production Data4. Open Up Audio-Visual Data5. Retrieval vs. Exploration

CC BY-NC-SA 2.0

The Media Value Chain


Exchange of Media, Metadata,

and Communication

CC BY-NC-SA 2.0

The Media Value Chain


ProductionArchival

Distribution

CC BY-NC-SA 2.0

Heterogeneous InterfacesPieter Bruegel the Elder, The Tower of Babel, 1563CC BY-NC-SA 2.0

Information Loss

Additional CostPhoto by Pascal,public domain

https://flic.kr/p/7yBtp6

https://flic.kr/p/7yBtp6

Interfaces and Metadata... a well known Problem with existing solutions


Problems:● Valuable metadata gets lost between the departments● Costly reengineering & retrieval of previously available

(meta-)data● no common (Meta-)Data Formats● Proprietary Hard- and Software with heterogeneous

interfaces

CC BY-NC-SA 2.0

Process AutomationPhoto by Alex Eylar, CC BY-NC-SA 2.0

https://flic.kr/p/8SvAkS

https://flic.kr/p/8SvAkS

StandardizationPhoto by Eric, CC BY-NC-SA 2.0

https://flic.kr/p/4wwZaq

https://flic.kr/p/4wwZaq

Standardized Metadata


ProductionArchival

Distribution

CC BY-NC-SA 2.0


Standardized Metadata

CC BY-NC-SA 2.0


Data Integration via Linked Data

CC BY-NC-SA 2.0

Linked Production Data


LinkedProduction

Data

CC BY-NC-SA 2.0


● Project funded by the German government & industry● 3 years project (2014-2017)● 10 core project partners from industry and university

● associated partners

CC BY-NC-SA 2.0


● Development of Linked Services for ○ Media Production, ○ Media Distribution, ○ Media Archival, ○ Media Retrieval, and ○ Commercialization

based on Linked Data principles● Development and adaption of ontologies for the media value chain● Development of generic import-/export filters for (proprietary)

Hard- and Software● Publication of Linked Production Data as Linked (Open) Data

CC BY-NC-SA 2.0


● CP 1 - Production ○ Linked Media Production○ (automated) quality check & delivery

● CP 2 - Archival○ (semi-)automated diagnostics

for archived audio-visual media● CP 3 - Rights Management

○ (semi-) automated rights acquisition & clearance

● CP 4 - Distribution○ visual & semantic analysis○ exploratory semantic search○ intelligent recommender systems

CC BY-NC-SA 2.0

Linked Production DataData Integration in the Media Value Chain


● Data integration of metadata for ○ identification○ rights management○ administration○ process management○ technical parameter○ structural management○ content description○ filmography○ ...

CC BY-NC-SA 2.0

Linked Production DataData Integration of technical metadata

http://linkedproductiondata.org/resource/Arri_Alexa


http://dbpedia.org/resource/Arri_Alexa

owl:sameAs

dbpedia:Category:Digital_movie_cameras

dcterms:subject

CC BY-NC-SA 2.0

Linked Production DataData Integration of content related metadata


rdf:type

media fragment media fragment media fragment

http://example.com/example.ogv#t=10,20 http://example.com/example.ogv#t=20,30 http://example.com/example.ogv#t=10,20

http://dbpedia.org/resource/Buzz_Aldrin

dbpedia-owl:Astronautrdfs:subClassOf

dbpedia-owl:birth_name

dbpedia-owl:birth_date

dbpedia-owl:Person“Edwin Eugene Aldrin, Jr.“@en

“1930-01-20”^^xsd:date

CC BY-NC-SA 2.0

How do we get there…?


LinkedProduction

Data

CC BY-NC-SA 2.0

Linked Production DataTowards ontologies for the media value chain


● capturing technical metadata from interface descriptions

● knowledge acquisition with domain experts

● creating a terminology● inner-project mapping● ontology mapping● connecting systems &

devices

CC BY-NC-SA 2.0

Linked Production Data Platform

Harald Sack, From Script Idea to TV Rerun, LIME 2015, Florence, Italy, May 18, 2015 CC BY-NC-SA 2.0

LinkedProduction

Data

semantic search

intelligentrecommendation

Challenges for Media Distribution


● Deliver the media to the customer while the customer

should NOT worry about

○ media formats

○ media distribution channels

○ media modalities and restrictions

○ rights management issues

○ to find accurately what the customer is looking for

○ to find more of what is interesting for the

customer, but was not looked for intentionally...

CC BY-NC-SA 2.0

Open Up Mediawith (semantic) media analysis


audio-visualmedia

automated media analysis

manual annotation

usage data analysis

technical metadata

applications for distribution

audio-visualmetadata

CC BY-NC-SA 2.0


Automated Media Analysisto open up (legacy) media

CC BY-NC-SA 2.0

Semantic Media Analysis“Buzz Aldrin” is more than just a character string

rdf:type

http://dbpedia.org/resource/Buzz_Aldrin

dbpedia-owl:Astronautrdfs:subClassOf

dbpedia-owl:birth_name

dbpedia-owl:birth_date

dbpedia-owl:Person“Edwin Eugene Aldrin, Jr.“@en

“1930-01-20”^^xsd:date

● named entity mapping of heterogeneous (textual) metadata with KEA

CC BY-NC-SA 2.0

Retrieval vs Exploration

J. Waitelonis, H. Sack: Towards exploratory video search using linked data, Multimedia Tools and Applications, Volume 59, Number 2 (2012)

From Retrieval to Exploration


dbpedia:Neil_Armstrong

dbpedia:Michael_Collins

dbpedia:Buzz_Aldrin

dbpedia:Apollo_11dbpedia-owl:mission

dbpedia-owl:mission

dbpedia-owl:mission

category:Apollo_program

dcterms:subject

dbpedia:Apollo_13

dcterms:subject

CC BY-NC-SA 2.0

yago:Space_accidents_and_incidents

rdf:type

dbpedia:Space_Shuttle_Challengerrdf:type


How do you express a search if you don‘t know the proper name?

Moon

spacetravel

silent movieadventure

fantasy

George Melies:La voyage dans la lune (1902)

CC BY-NC-SA 2.0


Which movie should I watch next?

...and please surprise me!CC BY-NC-SA 2.0

CC BY-NC-SA 2.0

Exploratory Searchbased on intelligent recommendations


Serendipity: ● find a solution to a problem, which is relevant, but that you did not look for

intentionally ● a search result is a „serendipitious finding“, if it is interesting and

positively surprising at the same time.● surprising ≈ unexpected (statistically)

Relevance:● in general: adopted from Information Retrieval,● e.g. Popularity (PageRank), Specificity(TF-IDF, BM25), ranking heuristics● the actual relevance (importance) of a fact is determined by the personal

context and the Intention (Pragmatics) of the user.

CC BY-NC-SA 2.0

Exploratory Video SearchSome Implementations


AV Portal of the German National Library of Technologyhttps://av.getinfo.de/

Mediaglobe, http://semex.hpi.uni-potsdam.de/semex/

H. Sack, M. Plank: AV-Portal - The German National Library of Science and Technology's Semantic Video Portal, ERCIM News - Special Theme: Linked Open Data, Issue 96, (January 2014)

C. Hentschel, J. Hercher, M. Knuth, J. Osterhoff, B. Quehl, H. Sack, N. Steinmetz, J. Waitelonis, H.Yang: Open Up Cultural Heritage in Video Archives with Mediaglobe, Proc. of I2CS 2012, Lecture Notes in Informatics, Vol. 204, pp. 190-201

CC BY-NC-SA 2.0

https://av.getinfo.de

https://av.getinfo.de

http://semex.hpi.uni-potsdam.de/semex/

Exploratory SearchMore Implementations


refer - Smart Media NavigatorWordPress PlugIn:http://refer.cx/ T. Tietz, J. Waitelonis, J. Jager, H. Sack, Smart Media Navigator: Visualizing

recommendations based on linked data, in Proc. ISWC 2014, 2014, pp. 48-51.

CC BY-NC-SA 2.0

http://refer.cx/

http://refer.cx/


Harald Sack, Hasso-Plattner-Institute for IT Systems Engineering, University of Potsdam, Germany

3rd International Workshop on Linked Media 2015, Florence, Italy, May 18, 2015CC BY-NC-SA 2.0