google research, mountain view research scientist douglas …gorillaz blur artist has band member...

Google Confidential and Proprietary

Music Research at GoogleDouglas EckResearch ScientistGoogle Research, Mountain View

Google Confidential and Proprietarydeck@google.com

Team members

● Dick Lyon Machine Hearing team (audio)● Ron Weiss● Kevin Wilson● Ryan Rifkin● Sourish Chadhuri● Pascal Getreuer

● Doug Eck Music Intelligence team (music)● Daniel Steinberg● Andre Hentz● Tony Lam● Philippe Hamel● Ali Razavi● Maneesh Bhand● Alex Susemihl (intern)

Names in BOLD are here at NEMISIG!

Google Confidential and Proprietarydeck@google.com

MusiciansKnowledge and Connections

UsersCollaborative Filtering

MusicAudio Signal Processing

Google Confidential and Proprietarydeck@google.com

Play Music All Access

See also the Music Timeline visualizer

Google Confidential and Proprietarydeck@google.com

iTunes Store Opens

Q: What do music user want?

Google Confidential and Proprietarydeck@google.com

Google Confidential and Proprietarydeck@google.com

Pandora streaming statistics

Google Confidential and Proprietarydeck@google.com

MusicRecommendation

Personalized, contextual radio that adapts to listener feedback. Low-

friction, easy engagement

“Lean Back” experience

Google Confidential and Proprietarydeck@google.com

Music Discovery

Organize the world’s music information. Tools for exploration, sharing and visualization. Social.

“Lean Forward” Experience

Google Confidential and Proprietarydeck@google.com

SAI-based audio features

histograms

Supervised embedding

learner (e.g. WSABIE)

Joint embeddings

scoring

Audio

Training Labels

(Knowledge Graph)

Weighted ALS matrix factorizer (CF)CF matrix

factorizer (e.g. wALS)

User listening

data

Google Confidential and Proprietarydeck@google.com

Knowledge and Connections

Knowledge Panel result from searching for "Gorillaz”

Google Confidential and Proprietarydeck@google.com

Google Confidential and Proprietary

Freebase Music Schema

Jamie Hewlett

Person

Musician

Damon Albarn

Gorillaz

Blur

Artist

Has Band Member

Has Band Member

Has Band Member

Is AIs A Is A

Is A

Is A

Is A

Google Confidential and Proprietary

Playlist: Songs by Artists who had a member die in 2012

Adam YauchBeastie Boys

Has Band Member

(You've Gotta) Fight for Your Right 2012-05-04

Date of DeathHas Track

Davy JonesThe MonkeesI'm A Believer 2012-02-29

Robin GibbThe Bee GeesStayin' Alive 2012-05-20

Bob WelchFleetwood MacGo Your Own Way 2012-06-07

Freebase is a public dataset, so try it yourself!http://tinyurl.com/bj4bkdv

Google Confidential and Proprietarydeck@google.com

MIR@Google

● Question: what can Google give back to the MIR community?

● Always hiring interns and full-time employees. Contact deck@google.com

● Visiting faculty program

● Google Research Awards