digital media production
TRANSCRIPT
![Page 1: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/1.jpg)
Gastcollege – Nieuwe Media en Maatschappij
Digital Media Production
![Page 2: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/2.jpg)
© VRT-medialab: onderzoek en innovatie2
Quid VRT-Medialab?
• +/- 22 experts – research and development
• Member of international associations EBU (P/SCAIE, P/MAG, P/NP, P/HDTV,…) AMWA, SMPTE, IPTC, W3C
• Deliverables Expertise Proof of Concept Technology transfer
![Page 3: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/3.jpg)
© VRT-medialab: onderzoek en innovatie3
http://medialab.vrt.be
![Page 4: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/4.jpg)
© VRT-medialab: onderzoek en innovatie4
Table of Content
• Background – Digital Media Production Anno 2004 - The Digital Media Factory Reconciliation of requirements
• Creative staff Case 1 – Media Asset Management
• The consumer Case 2 – Non-linear Distribution
• The near future Case 3 – Computer Integrated Manufacturing
![Page 5: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/5.jpg)
© VRT-medialab: onderzoek en innovatie6
2004...
![Page 6: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/6.jpg)
© VRT-medialab: onderzoek en innovatie7
Background – Proof of Concept
![Page 7: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/7.jpg)
© VRT-medialab: onderzoek en innovatie8
• Objectives Tape-less production Re-purposing of material Integrated system for radio,TV and online
• Strategy - Generic if possible, specialised if required
Central storage services are the core of the architecture The MAM system implements the central warehouse processes State-of-the-art production systems are integrated with the MAM system Legacy archive system provides search and retrieval functionality
Objectives anno 2004Objectives anno 2004
![Page 8: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/8.jpg)
© VRT-medialab: onderzoek en innovatie9
Central storage
INGEST
MediaAsset Mgmt
IP network
CentralStorage
Draft Processing
Concurrentengineering
Browse Clients Processing duringingest/transfer
POSTProduction
Craft editors
Subtitling
Archiving
Analysis
Annotation
Follow-upcontinuity Editor-in-Chief
Post-sonorisation
PLAY-OUT
8 GB P2 card= 32 min videoDV25 (news)
Go Live - 17 June 2007
![Page 9: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/9.jpg)
© VRT-medialab: onderzoek en innovatie10
Lessons Learned
1. There is a mismatch between business requirements and state-of-the-art technology;
2. Media technology suppliers don’t acknowledge the limitations of IT technology;3. IT suppliers don’t sufficiently understand the requirements of (media)
production;4. Re-using applications in a context which they have not originally been designed
for is usually a sub-optimal solution;5. Proper reasearch and development are quintessential.
![Page 10: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/10.jpg)
© VRT-medialab: onderzoek en innovatie11
Online searching, re-viewing and cutting
![Page 11: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/11.jpg)
© VRT-medialab: onderzoek en innovatie12
One-click re-purposing of content
![Page 12: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/12.jpg)
© VRT-medialab: onderzoek en innovatie13
2009 - Reconciliation of Requirements
Computer Integrated Manufacturing CAD – Computer Assisted Design CAM – Computer Assisted Manufacturing
Media Asset Mgnt. - Effective re-use Harvesting and Annotation Search and Retrieval
State-of-the-Art Single system for radio, tv and online File-based production Re-use of content
Non-linear distribution on demand Personalisation
But – Needle in the haystack Unstructured information 10 times more items No native file-based tools available
![Page 13: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/13.jpg)
© VRT-medialab: onderzoek en innovatie14
Lessons Learned – Principles of System Integration
Everything should be made as simple as possible, but not one bit simpler.
![Page 14: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/14.jpg)
© VRT-medialab: onderzoek en innovatie15
Media Asset Management
Production PlatformProduction Platform
Media Asset Management
Infrastructure – Networks and Storage
Production and distribution
![Page 15: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/15.jpg)
© VRT-medialab: onderzoek en innovatie16
MAM system‘Wires’ - (Telex Services)(IPTC7901)
EBU popserver(NMS)
Web SitesArchives
Eurovision (Superpop – NMS)
DocumentationServices
Correspondents(email)
Reuters(NewsML1.1)
Lack of an effective standard Unstructured or semi-structured information
Redundant information – Overflow
Manual processingNewsroom Computer System
The problem (1) – Production Context
![Page 16: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/16.jpg)
© VRT-medialab: onderzoek en innovatie17
The problem (2) – video processing
Allegory of Fortune, Dosso Dossi (Courtesy of the J.Paul Getty museum)
« Prosperity in life is transitory and dependant on luck »
The semantic gap
-> interpretation is unique to audiovisual media
-> The source of valuable metadata is Product Engineering
-> Computer vision techniques can only recognise lower-level features
![Page 17: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/17.jpg)
© VRT-medialab: onderzoek en innovatie18
For example…
Production PlatformProduction Platform
Master Data Management
Infrastructure – Networks and Storage
Production and distribution
![Page 18: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/18.jpg)
© VRT-medialab: onderzoek en innovatie19
The State of the Art
archiefnummer : ALG 20010813 1
fragmentnummer : 1
reeks : 1000 ZONNEN EN GARNALEN
bandnummer : E03024404
formaat : DBCM
fragmenttitel : 1000 ZONNEN & GARNALEN
beeld : KL/PALPLUS
fragmentduur : 18 20
tekst : 0'00" TOERISTISCH REPORTAGEMAGAZINE OVERZICHT
ONDERWERPEN GENERIEK TOERISTISCH REPORTAGEMAGAZINE,
OVERZICHT ONDERWERPEN
0'50" VANDAAG : KUNSTENAAR LUC HOFKENS ONTWIERP EEN OASE
OP ZIJN DAKTERRAS IN BORGERHOUT DIE DOET DENKEN AAN DE
GRAND CANYON INTERVIEW MET LUC EN ZIJN VROUW
MARILOU BUITENBEELD DAK MET OMGEVING BUITENKANT
ARBEIDERSWONING, PANO OVER ROTSWANDEN, KRATEN MET WATER,
BEPANTING, FOTOALBUM MET VERLOOP WERKEN
4'00" JUNIOR : KLAARTJE ALAERTS, 13 JAAR WIL ASTRONAUTEN
WORDEN ZE BEZOEKT HETEUROSPACE CENTER METRUIMTEVEREN,
RAKETTEN SIMULATIE IN RUIMTEVEER, INTERVIEW, HEEFT EEN
UFO GEZIEN MAAKT ZELF KLEIN RAKETJE, SCHIET HET AF
7'50" DE SCHEURKALENDER : ARCHIEF RECLAMEFILM IBM
INTERVIEW MAURICE DE WILDE, EERSTE PERSOONLIJKECOMPUTER
trefwoorden : BELGIE; BORGERHOUT; ARTIEST; OASE; KUNST; GRAND
CANYON (NATUURGEBIED); DAK; TERRAS; INTERVIEW; EURO
SPACE CENTER; RUIMTEVAART; PC; BOOTTOCHT; RIJKDOM;
PASSAGIER; GASTRONOMIE; RESTAURANT; PERSONEEL;
VAKANTIE; BINNENBEELD; SCHIP; BECKERS LEEN; VRT;
LOTTO; RADIOOMROEPSTER; KLANKSTUDIO; UITVINDING;
BARBECUE; BETONMOLEN; IBM; RECLAMESPOT
rechthebbende : VRT
Opzoekscherm FILM Set: 16 Aantal: 1
blz 1 van 3
trefwoorden: ibm and vrt
archiefnummer: -
uitzendjaar: maand: dag:
fragmentnummer: fragmentduur:
reeks:
formaat: bandnummer:
aflevering: afleveringsnummer:
programma: uitzenddatum:
fragmenttitel:
tekst:
kategorie:
opnamedatum: opnamenummer:
journalist: rechthebbende:
SETS
The strings required for the operation are not defined
F11 F12 F13 F14 F17 F18 F19 F20 Ent
Eindigen Sets Refset Toon Vorige Volg/Leeg Thesaurus Commando Opzoeken
![Page 19: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/19.jpg)
© VRT-medialab: onderzoek en innovatie20
![Page 20: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/20.jpg)
© VRT-medialab: onderzoek en innovatie21
Proof of Concept
![Page 21: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/21.jpg)
© VRT-medialab: onderzoek en innovatie22
Shot Segmentation and Scene Recognition
![Page 22: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/22.jpg)
© VRT-medialab: onderzoek en innovatie23
Face recognition and identification
![Page 23: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/23.jpg)
© VRT-medialab: onderzoek en innovatie24
Video copy detection
Identify dupplicates – Trace dependencies Linking stories over time Copy detection - Intellectual Property Protection
![Page 24: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/24.jpg)
© VRT-medialab: onderzoek en innovatie25
Media Asset Management
Production PlatformProduction Platform
Master Data Management
Infrastructure – Networks and Storage
Production and distribution
Media Asset Management Issues
• Production Environment• No upfront selection - information overload;
• Multiple sources of more or less structured metadata;
• Parallel sources cause dupplicates;
• International context - multilingual
• Professional Requirements• An item is relevant or it is not;
• Retrieve all relevant items;
• No false positives
• Video Processing• 80% of the context is in the speech
• Machines may recognise more objects
• Machine processing is more robust
![Page 25: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/25.jpg)
© VRT-medialab: onderzoek en innovatie26
![Page 26: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/26.jpg)
© VRT-medialab: onderzoek en innovatie27
Conclusions
A consistent application framework and proper user-interfaces are the key to effective re-use and
supply chain integration in general.
!
(≠ Digitizing analogue and disintegrated workflows)
• Scripts contain the essential master data – integration with creative processes is a must;
• In professional context, it is key to trace dependencies between objects. Hence, as opposed to any conventional approach, a search engine must integrate information rather than to index multiple sources;
• Computer Vision does not replace formal annotation, but substantially accelerates the process and increases the accuracy
![Page 27: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/27.jpg)
© VRT-medialab: onderzoek en innovatie28
Case 2 – Non-linear Distribution
Production PlatformProduction Platform
Master Data Management
Infrastructure – Networks and Storage
Production and distribution
D a t a G e n e r a l
D a t a G e n e r a l
D a t a G e n e r a l
D a t a G e n e r a l
D a t a G e n e r a l
D a t a G e n e r a l
MetaData
MetaData
Communication(Information)
D a t a G e n e r a l
Data
Digital Broadcasting via DVB, IP or other
Digital Broadcasting via DVB, IP or other
Video Audio
![Page 28: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/28.jpg)
© VRT-medialab: onderzoek en innovatie29
![Page 29: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/29.jpg)
© VRT-medialab: onderzoek en innovatie30
![Page 30: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/30.jpg)
© VRT-medialab: onderzoek en innovatie31
![Page 31: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/31.jpg)
© VRT-medialab: onderzoek en innovatie32
1914 – First radio broadcast
![Page 32: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/32.jpg)
© VRT-medialab: onderzoek en innovatie33
1937 – Die Volksempfaenger
![Page 33: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/33.jpg)
© VRT-medialab: onderzoek en innovatie34
1955 - Mobile radio...
![Page 34: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/34.jpg)
© VRT-medialab: onderzoek en innovatie35
Digital Broadcasting – Que?
![Page 35: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/35.jpg)
© VRT-medialab: onderzoek en innovatie36
2004 – Live Streaming
![Page 36: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/36.jpg)
© VRT-medialab: onderzoek en innovatie37
Porting the radioplayer...
![Page 37: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/37.jpg)
© VRT-medialab: onderzoek en innovatie38
Porting the radioplayer...
![Page 38: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/38.jpg)
© VRT-medialab: onderzoek en innovatie39
Stats Launch feb 2009 Currently over 60.000 installations 2500 users per day Average duration 30”
![Page 39: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/39.jpg)
© VRT-medialab: onderzoek en innovatie40
Business Case
IP Distributie (radio)
• +/- 5.000.000 luisteruren per dag
• 5.000.000 uur à 128 kbps, 250 TB
• 90 PB per jaar à 70.000€ per PB
• Totaal – 6.300.000€ per jaar
Vgl. deredactie.be
• Homepage 2MB
• 128 seconden high-def audio(!)
![Page 40: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/40.jpg)
© VRT-medialab: onderzoek en innovatie41
Broadcast...
A customer can have a car painted any colour that he wants so long as it is black.
(Henry Ford)
![Page 41: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/41.jpg)
© VRT-medialab: onderzoek en innovatie42
Watch anytime - BBC iPlayer
![Page 42: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/42.jpg)
© VRT-medialab: onderzoek en innovatie43
Good, better,...
Portable - Anywhere
• Radio-player application
• Quick win – “in series” live transcoding
Broadband distribution - Anytime
• “Podcast”, “iPlayer”
• On demand complements live offering
• Major impact – master data power-lifting
The Perfect Storm…
• Mobile – Portable and impulse-driven
• Internet - Seamless integration of live and on demand
• An excellent user interface…?
![Page 43: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/43.jpg)
© VRT-medialab: onderzoek en innovatie44
Why it might work this time...
![Page 44: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/44.jpg)
© VRT-medialab: onderzoek en innovatie45
Why it might work this time...
Radio and Telephone
• Radio and telecommunication are on the cold side
• Short attention span, high level of attention
• Impulse-driven
• Mobile was the killer app…
![Page 45: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/45.jpg)
© VRT-medialab: onderzoek en innovatie46
Proof of Concept - The Ultimate Radio Exp(eriment)
myRadio @time of writing
• Broadband connection enables non-linear distribution
• Adaptive streaming enables bandwidth-friendly distribution
• Excellent quality where possible, lower bit-rate if necessary
• Open distribution framework
http://myradio.vrt.com
![Page 46: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/46.jpg)
© VRT-medialab: onderzoek en innovatie47
Proof of Concept (Ongoing)
Seamless integration of Live and On demand
• “Bookmark” by tagging
• Pause, Back and Fast Forward
Work in Process – Track each individual item
• Audio segmentation
• Speech recognition and indexing
• Metadata harvesting (!!!)
Personalisation
• Radio search engine
• Assemble myRadio
![Page 47: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/47.jpg)
© VRT-medialab: onderzoek en innovatie48
Personalisation by Interactivity
User profile
Personalisation
A customizable product and tracking the user profile based on data mining techniques will
allow us to create the illusion of personalisation
![Page 48: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/48.jpg)
© VRT-medialab: onderzoek en innovatie49
Trend - From « metadata » to CAD/CAM
?
![Page 49: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/49.jpg)
© VRT-medialab: onderzoek en innovatie50
Case 3 – Computer Integrated Manufacturing
![Page 50: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/50.jpg)
© VRT-medialab: onderzoek en innovatie51
State of the Art
![Page 51: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/51.jpg)
© VRT-medialab: onderzoek en innovatie52
Use Case – Drama Production
Ani
![Page 52: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/52.jpg)
© VRT-medialab: onderzoek en innovatie53
Proof of Concept - Scoop
http://www.youtube.com(search for “scoop”, “ibbt”, “CAD”)
![Page 53: Digital Media Production](https://reader038.vdocuments.site/reader038/viewer/2022103018/55871672d8b42a2e648b4587/html5/thumbnails/53.jpg)
© VRT-medialab: onderzoek en innovatie54 54
http://medialab.vrt.be
http://myradio.vrt.be