watermarking and fingerprinting for global broadcast ... · watermarking & fingerprinting video...
TRANSCRIPT
![Page 1: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/1.jpg)
1
Watermarking and Fingerprinting for Global Broadcast Monitoring
Presentation for: Bits by the Bay, SMPTE 2014 Technology Conference
Presenter: Wim J.C.M. Bus
Title: SVP Product Management
![Page 2: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/2.jpg)
2
1. CONTENT IDENTIFICATION
2. GLOBAL BROADCAST MONITORING PLATFORM
3. QUESTIONS
PRESENTATION OVERVIEW
![Page 3: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/3.jpg)
3
1. CONTENT IDENTIFICATION
WATERMARKING & FINGERPRINTING
![Page 4: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/4.jpg)
4
Watermarking & Fingerprinting
Video Watermarking(VWM)
Audio Fingerprinting(AFP)
Audio Watermarking(AWM)
Video Fingerprinting(VFP)
Embedding a unique identifier in audio and/or video, imperceptible to the human ear and eye, but can be detected by special software tools.
Watermarks make each content copy unique when embedding unique data, allowing to track unique content copies or the source of (illegal) content copies.
Identifying content by extracting unique features from audio and/or video, which are compared with features previously stored in a database
Fingerprints give content assets and copies thereof a unique identity, allowing efficient high volume and real-time identification of content assets and copies thereof.
Fingerprinting (matching)Watermarking (embedding)
detectionUnique watermark
Media content
Insertion of unique ID tag to individual pieces of content
Distribution
UsageRe-distribution
WM
Metadata
Metadatadatabase
Assetregistration
DistributionMedia content Distributedmedia content
Identification of fingerprintsNbr. 6538964212556….Comparison and matching
of fingerprints against fingerprints stored into the database
![Page 5: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/5.jpg)
5
Watermarking Parameters
Optimized for
application
Perceptual QualityImperceptibility of the
embedded information
RobustnessRobustness against further
modifications of the content
Capacity (Payload)How much retrievable
Information can be transmitted
Original image
115 154 180 …
158 183 174 …
177 168 144 …
After embedding
114 150 180 …
156 186 172 …
177 170 144 …
![Page 6: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/6.jpg)
6
Fingerprint Parameters
• Robustness (False Negative)“Can a clip still be identified after (severe) degradation?”
• Reliability (False positive)“How often is a clip falsely identified?”
• Fingerprint SizeStorage needed for a fingerprint
Bandwidth needed to send fingerprints to a fingerprint server
• GranularityHow many seconds of content is needed to identify a clip
• 50-80 times per second a 32 bit sub-fingerprint is extracted
• Bits are determined by looking at characteristic features of a video and
audio (e.g. luminance changes for video and spectrum changes for audio)
• A group of sub-fingerprints form a fingerprint.
Tim
e
32 bits
![Page 7: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/7.jpg)
7
Fingerprinting Matching
4.6
s
• 256 sub fingerprints ( a fingerprint block)
are compared by counting bit-errors
• If less than 35% of the bits are in error
fingerprint blocks are said to be derived
from the same clip.
Reference Fingerprint
Extracted from the
reference content
Fingerprint extracted
from unknown content
Difference
![Page 8: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/8.jpg)
8
Watermarking vs Fingerprinting
Watermarking (Granularity 1 sec)
(+) Different identifiers in copies of the same content(+) Stand alone(-) Modification of the content (active)(-) Watermark not present in legacy content
Fingerprinting (Granularity 3-5 sec)
(+) Content is not modified (passive)(+) Works for legacy content (-) Connection to database required(-) Cannot distinguish distribution path/source
![Page 9: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/9.jpg)
9
2. GLOBAL BROADCAST MONITORING PLATFORM
MEDIA INTELLIGENCE
![Page 10: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/10.jpg)
10
Teletrax - Key Characteristics
Technology:
– Video Watermark & Video Fingerprinting based broadcast monitoring service
– Optimized for Short-Form and Long-Form content tracking
Network:
– A consistent Global monitoring network
– Over 2,200 TV channels in more than 60 countries incl. all 210 US DMA’s
Platform:
– Flexible server farm running in a High-Grade professional colocation in New Jersey.
– World wide TV content monitoring information delivered to the desktop within 15 minutes
![Page 11: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/11.jpg)
11
• Government/NGO’s (Watermarking/Fingerprinting)
– (Non) Government organisations that create content and have a need to both monitor domestically and/or internationally.
– Global Monitoring of third content in case of incidents/ crisis.
– What , Where and how long is content being used (Exposure).
– In which context is the content being used (video, EPG).
• News agencies (Watermarking)
– News agencies distribute stories to and need track the actual usage and billing of its clients.
• Entertainment (Fingerprinting)
– Large studios that distribute high value content and want to track for contract compliancy.
– Track illegal usage of non licensed content.
• Advertisement (Watermarking/Fingerprinting)
– Campaign verification (Watermarking /Fingerprinting)
– Competitive intelligence, which competitive brands are/where running campaigns on TV (Fingerprinting)
Teletrax – Application areas
![Page 12: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/12.jpg)
12
Broadcast Monitoring – Watermarking workflow
Identification of
unique watermark
Watermarking
Insert ID tag to
individual pieces
of content
DistributionMedia content
metadata
Monitoring network
Data-Centre
Content owner
Content identified
and reported
via online portal
TV
Channel
![Page 13: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/13.jpg)
13
Broadcast Monitoring – Fingerprinting workflow
Distribution
Monitoring network
Data-Centre
Content owner
Content identified
and reported
via online portal
TV
Channel
Fingerprint
extraction
Reference
fingerprint
registration
Matching
Analysis
Media content
Channel-FP
storage
Reference-FP
Database
![Page 14: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/14.jpg)
14
ConfidentialConfidential
Broadcast Monitoring – Platform Architecture
IdentificationHits Engine
Data collection
Rep
ort
Sch
edu
ler
Analytics Engine Analytics
Data MarriageCustom
MetadataGRPData
Program Data
Detectors
VWMAudio CCVFP
Embedders / Ingest
VWMmetadata
VFPAudio
Custom ReportingStandardMarketIndividual Customer
Network
Management
FP-Reference Database
Channel-FPStorage
Video clips
![Page 15: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/15.jpg)
15
Raw data for per TV channel
![Page 16: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/16.jpg)
16
Comparison
![Page 17: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/17.jpg)
17
Retro-Track – Boston Marathon
![Page 18: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/18.jpg)
18
3. QUESTIONS
![Page 19: Watermarking and Fingerprinting for Global Broadcast ... · Watermarking & Fingerprinting Video Watermarking (VWM) Audio Fingerprinting (AFP) Audio Watermarking (AWM) Video Fingerprinting](https://reader034.vdocuments.site/reader034/viewer/2022042915/5f538da880a605732f368845/html5/thumbnails/19.jpg)
19
www.civolution.comTwitter: @Civolution
Solutions for content identification and value creation