google research, mountain view research scientist douglas …gorillaz blur artist has band member...

15
Google Confidential and Proprietary Music Research at Google Douglas Eck Research Scientist Google Research, Mountain View

Upload: others

Post on 14-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and Proprietary

Music Research at GoogleDouglas EckResearch ScientistGoogle Research, Mountain View

Page 2: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Team members

● Dick Lyon Machine Hearing team (audio)● Ron Weiss● Kevin Wilson● Ryan Rifkin● Sourish Chadhuri● Pascal Getreuer

● Doug Eck Music Intelligence team (music)● Daniel Steinberg● Andre Hentz● Tony Lam● Philippe Hamel● Ali Razavi● Maneesh Bhand● Alex Susemihl (intern)

Names in BOLD are here at NEMISIG!

Page 3: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

MusiciansKnowledge and Connections

UsersCollaborative Filtering

MusicAudio Signal Processing

Page 4: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Play Music All Access

See also the Music Timeline visualizer

Page 5: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

iTunes Store Opens

Q: What do music user want?

Page 6: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Page 7: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Pandora streaming statistics

Page 8: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

MusicRecommendation

Personalized, contextual radio that adapts to listener feedback. Low-

friction, easy engagement

“Lean Back” experience

Page 9: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Music Discovery

Organize the world’s music information. Tools for exploration, sharing and visualization. Social.

“Lean Forward” Experience

Page 10: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

SAI-based audio features

histograms

Supervised embedding

learner (e.g. WSABIE)

Joint embeddings

scoring

Audio

Training Labels

(Knowledge Graph)

Weighted ALS matrix factorizer (CF)CF matrix

factorizer (e.g. wALS)

User listening

data

Page 11: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Knowledge and Connections

Knowledge Panel result from searching for "Gorillaz”

Page 12: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

Page 13: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and Proprietary

Freebase Music Schema

Jamie Hewlett

Person

Musician

Damon Albarn

Gorillaz

Blur

Artist

Has Band Member

Has Band Member

Has Band Member

Is AIs A Is A

Is A

Is A

Is A

Page 14: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and Proprietary

Playlist: Songs by Artists who had a member die in 2012

Adam YauchBeastie Boys

Has Band Member

(You've Gotta) Fight for Your Right 2012-05-04

Date of DeathHas Track

Davy JonesThe MonkeesI'm A Believer 2012-02-29

Robin GibbThe Bee GeesStayin' Alive 2012-05-20

Bob WelchFleetwood MacGo Your Own Way 2012-06-07

Freebase is a public dataset, so try it yourself!http://tinyurl.com/bj4bkdv

Page 15: Google Research, Mountain View Research Scientist Douglas …Gorillaz Blur Artist Has Band Member Has Band Member Has Band Member Is A Is A Is A Is A Is A Is A. Google Confidential

Google Confidential and [email protected]

MIR@Google

● Question: what can Google give back to the MIR community?

● Always hiring interns and full-time employees. Contact [email protected]

● Visiting faculty program

● Google Research Awards