the evolution of music continues
BigDataintheMusicandAutomo3veIndustries-MusicDNAFromB2Bdatacapturingtosophis3catedB2B2CServices
DagfinnBach
Musiconline-shortintro
• Themainstandardsince1991:MPEG
• MovingPictureExpertsGroup
• Morethan350industryanduniversitymembers
• Officialname:ISO/IECJTC1/SC29WG11
• Format:
• MPEG-1->Layer3(”mp3”)
• MPEG-2
• MPEG-4
• hVp://www.mp3-history.com/en/the_mp3_team.html
• A[erMPEG-4
• Metadataisbecomingmoreandmoreimportant
• ThisisthebasisforMusicDNA
Confiden3alinfo 2
MusicDNABigData
MusicDNAofferstodayamethodfor:
• Capturingaudio• Analysingandproducingmetadata(MusicDNAdescriptors)
• fingerprin3ngandcapturingmoredata
• structuring• storing
”BigData”aboutmusic
forcrea3ng:
1. Stand-aloneB2Bservices2. U3lizingthedatabasetopowerservicestargetedforendconsumerstoenhancetheuserexperiencewithinsearch,sharing,transferandvisualiza3on.
3
TheMusicDNADatabase
Threecomponents:
1. Apowerfuldatabasecontaining2fingerprintsand15MPEG-7descriptorsofeachsegmentwithineachsoundtrackwithinacollec3onof27Milliontracksisoneofthemostextensiveopera3vemetadatabasesformusicinthemarket.
2. 20.000RadioChannelsindexedinanaddi3onalradio-monitoringdatabase,currentlyrunningareal-3memonitoringof18.000radiochannelsacrosstheworld.
3. Recognizingaudioofairplaysevery10seconds(fingerprin3ngofen3retrack)andmatchesanddisplayrightsdataandotherassociateddata,andcreatesanewdatabaseshowingthehistoryofairplaysacrosstheworld.
Alldatabasesaregrowingincrementally
4
MusicDNAData(MPEG-7–ISO/IEC15938)
• Genre,subgenre• Tempo-/Beatdetermina3on
• Aggressiveness• Mood
• Hardness• Speech-/musicdiscrimina3on
• Musiccolor
• Segmenta3on
• SoloInstrument
• InstrumentDensity
• Percussiveness
5
• Vocaldetec3on• Key• Synthe3city• RhythmpaVern*
• VocalDetec3on;singertype(male,female,child,choir)*
• Vocalstyle(singing,rap,opera,screamingetc...)*
• CoverSongdetec3on*• +4-6newdescriptorseveryyearenablingincrementallymoreadvancedrecommenda3onandrecogni3on;
• ID3Data• SoundslikeFingerprint
*tobelaunchedin2016
RadioAirplayData
• Foreachairplayrecogni3onevery10secondacross18.000channels:• TrackTitle• Ar3stName
• ISRC(similarasISBN)
• ChannelName
• CountryofChannel• AirPlay(dd.mm.yyyy),3meanddura3on(fromhh.mm.sstohh.mm.ss)
• Cityofchannelloca3on(includingGPSdata)• MorefieldstobeaddedbymeansofMusicDNAtracking/matching
7
BigDataBasisforapplica3ondevelopment
• 27milliontracks
• 15tags• Average5segmentspersong
• 1,5Billion“datapoints”fordescribing/classifyingmusic
• Canbematchedandcombinedwith6to7datafieldsforRadiomonitoringfrom18.000channelsacrosstheworldfrom100.000matcheseveryminute(24/7)–1Billionmatchesperweek
• willcon3nuouslygeneratebillionsofnew“datapoints”everydaywithparameterslikecityofairplay,reachofaudience,3meofthedayforairplay(local3me->morning,day,a[ernoon,night)
• whichcanbeusedfurtherforgenera3ngmoreandmoresophis3catedindexes,andsearch/recommenda3onsolu3onsbyworkingwith“affiliated”par3es
8
Applica3onsfortheAutomo3veIndustries(1)
A:MusicDNATuner:
• Asmartradioindexinstalledineachcar
• UpdatedregularlyfromBigDataapplica3onscalcula3ngtheprofile(MusicDNA+speech/musicrate)ofeachradiosta3onateveryhour,duringeveryday,duringtheweek.
• LicensedtoPanasonicAutomo3veSystemsforlaunchin2016(wasprelaunchedatCESinLasVegasinJanuary2015andatDetroitMotorShowinFeb2015,installedinJaguarandLandRover)
B:MusicDNARadioAssistance:
• AnonlinedatabaseguidingtheprofileofavailablesimilarterrestrialchannelsbasedontheGPSposi3onofthecar
• Willautoma3callychangetoasimilarchanneltotheonethatislostwhenthecarismovingoutofreachoftheradiotransmiVer
• Licensenego3a3onswithoneoftheworld´slargestcarmanufacturers,forlaunchin2018.PrototypewaslaunchedinternallyinOctober2015)
Confiden3alinfo 18
Applica3onsfortheAutomo3veIndustries(2)
C:MusicDNATunercombinedwithOnlinemusicservice:
• Canfindradiochannelsimilartofavouriteplaylistinthemusiconlineservice
• Cancreateplaylistfromradiolistening(curatedplaylists)
• Cancreateplaylistbasedonlocalpopularityinareaofdriving.• Currentlyinini3aldiscussionwithaEuropeanhigh-endcarbrandforlaunchin2018
D:Moreuserscenariosbeingexplored….
• Greenersolu3ons• Newbusinessmodels
• Portable(outofthecar)solu3ons• Etc…
Confiden3alinfo 19
ISOStandards-MusicDNAandBlue`ords
MusicDNA:Classifica3onforsearch,data-op3miza3onandmatching:
• ISO/IEC15938:“MPEG-7”
• SpecifiesMetadatasystemfordescribingmul3mediacontent
• Descrip3onDefini3onLanguage(DDL)• MusicDNAMPEG-7descriptors
• MusicDNAMPEG-7fingerprint
Blue`ords:Datecentresecurity:
• ISO/IEC27001:"Informa3ontechnology—Securitytechniques—Informa3onsecuritymanagementsystems—Requirements”
• ISO/IEC27017:2015/ITU-TX.1631—Informa3ontechnology—Securitytechniques—Codeofprac3ceforinforma3onsecuritycontrolsbasedonISO/IEC27002forcloudservices
• ISO9001:“Qualitymanagementsystems—Requirements”
Confiden3alinfo 20
MusicDNAClients
Mostmusicclients:
• XML(ExtensibleMarkupLanguage)
• API(Applica3onProgrammingInterface)
• MPEG-7forsearch/recommenda3on(exportedfromMusicDNA)
Automo3veClients:
• MIB(ManagementInforma3onBase):Variousstandards
• FM/DABIntegra3on:Variousstandards
• XMLandAPI
• MPEG-1andMPEG-4foraudioplayback
• MPEG-7forsearch/recommenda3on(exportedfromMusicDNA)
Confiden3alinfo 21