how sony is leveraging curated descriptive metadata · how sony is leveraging curated descriptive...

How Sony is Leveraging Curated Descriptive Metadata

for Competitive Business Value

Jason Lambert, Executive Director, Content Licensing, Sony PicturesMatt Turner, Chief Strategy Officer, Media and Manufacturing, MarkLogic

Michael Malgeri, Principle Technologist, MarkLogic

01 Introductions

Growing value of data

Archive metadata at Sony Pictures

Valuable data in action – DEMO!

Questions

Wrap up

02

03

04

Agenda

05

06

Isaac Sacolick

President, StarCIO

2019 Michel de Ru

MarkLogic, 2018

Industrialize

your data!

Key to Digital Transformation is

making sure people know

where data comes from and

how they can use it

2014

© Sony Pictures Entertainment – Confidential and Proprietary

Sony Pictures Content Licensing

▪ Film clips

▪ Stock footage

▪ Production stills

▪ Posters

▪ Portrait photography

▪ Screenplay excerpts

▪ Thematic elements

Challenge

▪ No easy way to find and access memorable moments in the studio’s

catalog

▪ No centralized repository of film clip information that would enable future

exploitation

▪ Time and money was wasted on duplicated efforts across the company

▪ Difficult to support compliance activities for advertising and publicity

© Sony Pictures Entertainment – Confidential and Proprietary

Solution

Create a repository of time-based metadata (actors, transcript, descriptive,

legal restrictions) to support numerous applications and use cases

throughout SPE.

© Sony Pictures Entertainment – Confidential and Proprietary

What is time-basedmetadata?

© Sony Pictures Entertainment – Confidential and Proprietary

Time-based MetadataDescribing content at a granular level

CREATING METADATA TIMELINES

Metadata Timeline

© Sony Pictures Entertainment – Confidential and Proprietary

TAG ACTORS USING FACIAL RECOGNITION

Dan AykroydCharacter: Dr. Raymond Stantz

IMDb ID: nm0000101

Gender: Male

Main Credits: Yes

Notes: Ghostbuster, Doctor,

Scientist, Parapsychologist

Bill MurrayCharacter: Dr. Peter Venkman

IMDb ID: nm0000195

Gender: Male

Main Credits: Yes

Notes: Ghostbuster, Doctor,

Scientist, Parapsychologist

Identifying actors as they appear on screen, as well

as the characters they play, their IMDb ID’s, etc.

© Sony Pictures Entertainment – Confidential and Proprietary

ALIGN DIALOGUE USING PHOENETIC INDEXING

Time-aligning script files in order to make a

film’s dialogue searchable

© Sony Pictures Entertainment – Confidential and Proprietary

Actor 1

Actor 2

Dialogue

Actor 2

Actor 1 Actor 1

Actor 3

Dialogue Dialogue Dialogue Dialogue

Time-based MetadataDescribing content at a granular level

CREATING METADATA TIMELINES

Metadata Timeline

© Sony Pictures Entertainment – Confidential and Proprietary

DESCRIPTIVE INDEXINGTime-based Metadata

Describing content at a granular levelSubjectsSmurf, candy, toy, customer, display, toy

store

Emotionsfrightened, scared

ThemesOut of Control, Fish Out of Water

Tonesexciting, fun, funny, humorous, mischievous

Featureschase sequence, montage

BrandsM&M’s, Mars, The Smurfs, FAO Schweetz

SettingFAO Schwartz, New York City

Actionshiding, holding still, pretending, shopping

© Sony Pictures Entertainment – Confidential and Proprietary

DescriptiveKeywords Location

Scene 1 Scene 2 Scene 3

BrandsKeywords

Keywords KeywordsTheme

Tone

TIME-BASED METADATA

AutomatedActor 1

Actor 2

Dialogue

Actor 2

Actor 1 Actor 1

Actor 3

Dialogue Dialogue Dialogue Dialogue

© Sony Pictures Entertainment – Confidential and Proprietary

RESTRICTED ELEMENTS – MUSIC & LEGAL

MusicTitle: Born To Be Wild

Artist: Steppenwolf

Cue Type: Licensed

LegalRestriction: Brooke Shields

Source: GPMS

Rest. Type: Talent

LegalRestriction: Knicks Logos

Source: Mkt Summary

Rest. Type: Logos

Music and legal restrictions (as well as potential

S&P issues) identified in order to facilitate advertising & publicity related use cases for

groups throughout the studio

© Sony Pictures Entertainment – Confidential and Proprietary

THE FEEDBACK LOOP

Each new use case creates additional inventory and metadata that can be shared across the ecosystem.

Use Case 1

Legal + S&PLanguage

Ad/Pub Hold

Music Cue

DescriptiveKeywords Location

Scene 1 Scene 2 Scene 3

BrandsKeywords

Keywords KeywordsTheme

Tone

TIME-BASED METADATA

Automated

Use Cases

Actor 1

Actor 2

Dialogue

Use Case 2

Actor 2

Actor 1 Actor 1

Actor 3

Dialogue Dialogue Dialogue Dialogue

Scene 1

Use Case 2 Use Case 2

Scene 2 Scene 3

Use Case 1

Ad/Pub Hold

© Sony Pictures Entertainment –

Confidential and Proprietary

- Find a Scene containing a specific Theme and a specific phrase (Dialogue) for a Licensing opportunity…

Theme

Dialogue

Village Well Demo!

That’s Smart Content!

Village Well – MarkLogic Data Hub

DESCRIPTIVE

METADATA

ASSET

INFORMATION

SOCIAL MEDIA

CAMPAIGN

DATA

HARMONIZATION

SMART MASTERING

GOVERNANCE

SECURITY

CLOUD READY

DISTRIBUTION PARTNERS

MARKETING PARTNERS

OTHER APPS

MEDIA DATA

DATA FIRST • CLOUD READY • SECURE

Questions?

MarkLogic Media Solutions

Media Data Hub helps you:

• Create Great Experiences

• Lead the Digital Transformation

DATA FIRST • CLOUD READY • SECURE

Data Hub ServiceCloud service that deploys in

minutes with predictable, low cost

Get Started

MEDIA COMMUNITYwww.marklogic.com/solutions/industry/media/community/

MEDIA SOLUTIONS

hwww.marklogic.com/solutions/industry/media//

Thank you

jason_lambert@spe.sony.com

matt.turner@marklogic.com

michael.malgeri@marklogic.com