"the suitcase" project cloud qtr meeting presentation @ disney/abc
TRANSCRIPT
THE SUITCASEA USC SHORT FILM
BY ABI DAMARIS CORBIN
Next Generation Cloud Based WorkflowIngest, Transcode, Store, Orchestrate
c4 FrameworkIntegrate, Efficacy
MetadataCollect, Manage, Interoperability, New Ontologies
The Suitcase
Core GOALS
High Dynamic RangeAdoption, ACES
360 Camera Capture Narrative Experience, Live Stream
The Suitcase
Extended GOALS
Ingest Directly into the Cloud (Edge Landing Pad) Using a secure high-speed connection, ingest camera RAW files directly onto cloud storage.
Transcode Utilizing Cloud Computing Using a private cloud store as the hub, transcode camera RAW files using either Amazon Elastic Compute Cloud (EC2) or Google Compute. Take advantage of scalability and parallel processing to run all transcodes simultaneously.
Utilize Private Cloud Storage as Centralized Data Store Using a private cloud store as a work in process store for applications such as Avid, Nuke, Maya, and After Effects.
Next Generation Cloud BasedWorkflowTest Cases
Utilize Orchestration Software to Integrate with Different Services Analyze and utilize Agnostic Orchestration Software to automate functions concerning movement and creation of digital media assets within the cloud pipeline.
Production Workflow
5
C4 ID management and integration Report on the qualitative value and ease of incorporating the C4 ID system for tracking digital assets across vendors and tools.
JSON RESTful API deployment Integrate C4 compatible API’s with select production software applications and services to communicate within the C4 framework.
Data authority and synchronization Evaluate the framework’s ability to resolve authoritative data sources, and the use of C4 IDs to authenticate data accuracy.
c4 FrameworkTest Cases
Automation Report on opportunities to improve production workflows using C4 enabled automation.
User Impact Determine the effects of C4 on the processes of domain experts in production. Evaluation includes human factors, opportunities to improve existing departmental workflows, interoperability, and integration with established filmmaking processes.
Software and Services Integration
Efficacy
Collection and management Evaluate the improvements to the workflow, capture, storage and accessibility of metadata.
Interoperability Evaluate methods for establishing reliable interoperability between data sources. Analyze practical considerations such as unified metadata storage vs data silo integration via framework.
Input / Output Identify metadata inputs and outputs for key production software and hardware.
MetadataTest Cases
Ontologies Report on metadata needs of existing Ontologies, and what schemas are commonly applied to production metadata gathered. Identify areas of potential application such as marketing and distribution. Map a single set of metadata for the Suitcase to a structured ontology.
TheSuitcase-MetadataTestCase
MetadataTestCaseRequirement:Extractasinglesetofdescrip3vemetadataforTheSuitcase,mappedtoastructuredontology.
TheTestCase
Defini5ons
Metadata(forourpurposes)=informa3onaboutthecontent(asopposedtoe.g.viewershipinforma3on)•Example:episode3tleNOTNielsenra3ng
Descrip5ve=informa3onaboutwhatisgoingononscreen(asopposedtotechnicaloropera3onalmetadata);includestemporalmetadata•Examples:characters,loca3ons,onscreenac3ons,scenebreaks
Ontology=datamodeldefiningtherela3onshipsbetweenaGributesofinterest•Example:Acharacterappearsinascene
Seman5cOntologies
Informa5onisrepresentedastriples:
Aflexible,dynamicwaytorepresentinforma3onthatfacilitatestheabilitytoruncomplexqueriesagainstthedatasetaswellasapplica3ondevelopment.
JoeFranekisPlayedByMojeanAria
Subject Predicate Object
Triplescanbelinkedtogether…
JoeFranek
MojeanAria
“I’mnottheexplosionkinda
guy” Scene7
playsCharacter
hasDial
ogue
occursIn…tohelpanswerques4onslike:whatisthesceneinwhichMojeanAria’scharactersays“I’mnottheexplosionkindaguy”?
MetadataApplica5ons:General
Search/Research:Searchongranularfacetsandmetadatafields
ProductDevelopment:Powernewproductsorfeatures(personaliza3on,t-commerce,etc.)
Analy5cs:SurfacepaGernsinourcontentthatarenotintui3ve.
MetadataApplica5ons:TheSuitcase
Efficientlysearchforandgenerateclipsbasedondescrip5vemetadata,whicharerequiredforvariouspurposes,including(1)marke5ngmaterials/promos;(2)actors(forreels).
Samplequeries:• “RetrieveaclipofthebombsceneforChris4an”• “Retrieve4mecodesrepresen4ngtheclimaxofthestory,tosendtotheshopcuKngthetrailer”
Generateasetofinforma5onthatisusefultodownstreamdistributorstohelpengineernewproductfeatures.Samplequeries:• “Provideinfoaboutthetalentonscreenatagiven4mecode,sothatdownstreamdistributorcansurfacebiographicalinforma4ononasidebar”
• “Provideinfoaboutapieceofluggageonscreenatapar4cular4mecode,sothatavendorcansurfacealinktopurchasetheobjectinques4on”
MetadataCategoriesofInterest
High Priority Lower Priority
Character (appearances) Props/Objects
Talent Wardrobe
Locations/Settings Music
Actions/Events (Car Crash, Explosion, Kiss, Argument)
Event Types (Climax, Turning Point, etc.)
Dialogue
Scene/Shot Breaks
StretchGoal:UpstreamMetadataExtrac5on
High Priority Lower Priority
Character (appearances) Props/Objects
Talent Wardrobe
Locations/Settings Music
Actions/Events (Car Crash, Explosion, Kiss, Argument)
Event Types (Climax, Turning Point, etc.)
Dialogue
Scene/Shot Breaks
Answertheques3on:Canweextractauthorita3ve,structuredmetadatafromtheproduc3onprocess,ratherthanrecrea3ngitdownstream?
Challenge:Richermetadatalivesupstream(pre-produc4on/produc4on)butissubjecttochange—par4cularlydifficultfortemporalmetadata.Dataextractedtowardstheendofthepost-produc4onworkflow(par4cularlytemporalinforma4on)ismoreauthorita4ve,butnotalwaysasrobust.
FinalDraY
MovieMagic
ScriptE
scenechronize
SyncOnSet
Avid
MetadataExtrac5onWorkflow
1.Ontologycrea5on CharTalentplaysCharacter
EventsKissingDrivingArguing
Snoopingetc.
CharactersJoe Franek
Kelly Sully Dropo
Donald Timiltyetc.
ControlledVocabulary: AuthorityList:
sceneswithDonaldTimilty6.Architectsearchportal/APIs/alterna5vesolu5onsforsurfacingdatatoendclients
2.Controlledvocabularydevelopment+authoritylists
3.Loadontologyintoseman5cdatabase
4.Createinstancedata(“tag”TheSuitcasefinalcut)
5.Constructqueriesfordataextrac5on
scenechronize
Camera
Audio
Movie Magic
Final Draft
AVIDEditiorial
PIX PIX Dallies DI/Matering
Software
Mark Logic
C4Framework
SyncOnSet
Grey Meta
ColorfrontTranskoder
Source MetadataC4 MetadataModified Metadata
KeyThe Suitcase - Metadata WorkflowVersion 0.4 / September 1, 2015
Shotgun VFXSoftware
VFX CreationSoftware
MetaData Workflow
16
Adoption Report on production considerations for filming with HDR including departmental training, workflow, color grading and mastering.
ACES Workflow Report on the application of an ACES HDR workflow to ensure consistent color management throughout.
High Dynamic RangeTest Cases
Camera
The Suitcase - ACES / HDR WorkflowVersion 0.2 / October 14, 2015
On-SetDIT Cart
Co-LoDAM Cart
OpenEXR16-bit
ACESREC2020 ODT
ColorfrontOSD
ACESMaster
ColorfrontOSD
On-SetMonitoring
HDRLUT
Capture Post Deliver
ColorfrontTranskoder
PrimaryColor Grade(Dual Grade)
Camera RAWACES EXRDelivery Grades
Key
P3 1000nit
GradedOpenEXR
REC709Master
P3Master
REC2020Master
ACESP3 ODT
ACESREC709 ODT
REC709
REC709Metadata
HDR Workflow
18
Interactive Linear 360 Narrative Design and shoot a narrative scene using a 360 camera.
Live On Set 360 Streaming Use a 360 camera on set to live stream the production as it happens.
360 Camera CaptureTest Cases
THE SUITCASEVIRTUAL REALITY
THE SUITCASEVIRTUAL REALITY
VR COMPLIMENTVR LIVE STREAMLive stream a day on the production set in 360 degrees to a Mobile phone
VR headset
An immersive Prequal from the perspective of the terrorist and the
suitcase
Live Stream in Virtual RealityVideostitch will live
stream the set in 360 degrees on November
17th or 18th. This will be Viewable on
the Wemersive app with a Samsung Gear
VR Headset
VR COMPLIMENT
w/Augmented Reality Projection Dome
360 Footage from VR
Compliment Projected onto
Geodesic Dome at Festivals.
Audiences mobile phone acts
as Augmented Reality
X-Ray machine to see inside
The Suitcase
Funding Partners
Infrastructure / Hardware Partners
Software Partners
Cloud Service Provider Partners
Studio Partners