riot games' insights evolution
TRANSCRIPT
![Page 1: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/1.jpg)
Brandon Hsiung Riot Games Director of Insights [email protected]
Riot Games’ Insights Evolution A Journey to Become More Player-Focused
![Page 2: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/2.jpg)
![Page 3: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/3.jpg)
RIOT HEADQUARTERS
![Page 4: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/4.jpg)
1700+ RIOTERS
![Page 5: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/5.jpg)
1,700+ RIOTERS IN 17 OFFICES
1700+ RIOTERS
![Page 6: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/6.jpg)
7.5MILLION
PEAK CONCURRENT PLAYERS
STATS RELEASED JANUARY 2014
67MILLION
MONTHLY ACTIVE PLAYERS
MORE THAN 27MILLION
DAILY ACTIVE PLAYERS
MORE THAN MORE THAN
LEAGUE PLAYER BASE
![Page 7: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/7.jpg)
ESPORTS
![Page 8: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/8.jpg)
INSIGHTS @ Riot We strive to empower Rioters to make player informed strategic decisions &
data-powered products
![Page 9: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/9.jpg)
INSIGHTS @ Riot
ANALYTICS Allows us to measure,
investigate and analyze player behaviors
DATA SCIENCE Gives us the ability to
apply science to behaviors in-game to develop models and
products
RESEARCH Equips us to understand
the wants, needs, behaviors, attitudes and relationships of players
TECH Enables us to ingest,
store, process, and serve up our
player data
![Page 10: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/10.jpg)
We want to be TRUSTED advisors
![Page 11: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/11.jpg)
We were disjointed We were on the outside
We were acting as a service
![Page 12: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/12.jpg)
Disjointed
Engineering
Data Tech
Player Experience User
Research User
Experience
Publishing Market
Research
Business Intelligence
Predictive Analytics
Web Analytics
How could we gain their trust if we weren’t unified?
*Insights related disciplines org chart circa 2012
![Page 13: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/13.jpg)
Culture &
Organization
Disjointed
![Page 14: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/14.jpg)
Symbols Stories Structures
![Page 15: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/15.jpg)
Disjointed
![Page 16: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/16.jpg)
Symbols Stories Structures
Disjointed
INSIGHTS @ RiotWe strive to empower Rioters to make player informed strategic decisions &
data-powered products
![Page 17: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/17.jpg)
Symbols Stories Structures
Disjointed
![Page 18: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/18.jpg)
Symbols Stories Structures
MONTHLYINSIGHTS
Oct 12, 2015
February 4th 2015Insights Offsite 2015
Disjointed
INSIGHTS @ Riot
ANALYTICSAllows us to measure,
investigate and analyze player behaviors
DATA SCIENCEGives us the ability to
apply science to behaviors in-game to develop models and
products
RESEARCHEquips us to understand
the wants, needs, behaviors, attitudes and relationships of players
TECHEnables us to ingest,
store, process, and serve up our
player data
![Page 19: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/19.jpg)
Symbols Stories Structures
Unified Disjointed
INSIGHTS OPS Enables Insights to deliver
extraordinary value
INSIGHTS @ Riot
ANALYTICS DATA SCIENCE RESEARCH TECH
![Page 20: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/20.jpg)
We built a foundation of trust We were on the outside
We were acting as a service
![Page 21: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/21.jpg)
Tech
Research
Data Science
Analytics
Insights
Team Team Team Team
At first, we did really well…
![Page 22: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/22.jpg)
Tech
Research
Data Science
Analytics
Insights
Team Team Team Team
Outside
Due to increasing demand, we lacked alignment, so…
Team Team Team Team Team Team Team Team
…couldn’t prioritize …lacked context …had no influence
![Page 23: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/23.jpg)
Tech
Research
Data Science
Analytics
Insights
Team Team Team Team
Outside
Team Team Team Team Team Team Team Team
![Page 24: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/24.jpg)
Product
Production
Design
Engineering
Dev Mgmt
Insights
Art
Central Embed
Insights
Team Team Team Team Team Team Team Team Team Team Team Team
Inside Outside
![Page 25: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/25.jpg)
For Embeds, how do we know they’re effective?
![Page 26: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/26.jpg)
Ensure you Embed at the highest scope possible
Prod. Prod.
Initiative
Game
Prod.
Initiative
Prod.
Embed
Here
Revaluate placement every 3-6 months
![Page 27: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/27.jpg)
For Central people, won’t they get left the scraps?
![Page 28: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/28.jpg)
Non-embed Products
Product-specific needs
Central Embed
Company-wide needs
• Player segmentation • Competitive analysis • Cross-game economy study • Regional variation study • R&D • …and many more
![Page 29: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/29.jpg)
0
5
10
15
20
25
30
35
13 14 15 16
# of
Rio
ters
Year
Embeds
Forecast
![Page 30: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/30.jpg)
We built a foundation of trust We embedded to create alignment
We were acting as a service
![Page 31: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/31.jpg)
Can you get me the sentiment results for Shurima? Q: Sure, here’s the report with the lab results and analytics A:
Service
![Page 32: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/32.jpg)
Service
We were present, but didn’t have a
presence
![Page 33: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/33.jpg)
Service
Team
Production
Design
Engineering
Dev Mgmt
Insights
Art
How do we move beyond a historically
weak “pull” & non-existent “push”
relationship? Pu
ll Push
![Page 34: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/34.jpg)
Service
Team
Production
Design
Engineering
Dev Mgmt
Insights
Art
Stakeholders weren’t educated enough to ask the right questions
Pull Embedded even more!
Built education programs • Data 101 • Taste the Insights Launched Knowledge Platform • Knowledge@Riot
![Page 35: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/35.jpg)
Push Push
Team
Production
Design
Engineering
Dev Mgmt
Insights
Art
We lacked roles to drive and represent Insights
Pull
?
Crafted three roles • Delivery Lead • Strategy Lead • Data Lead
Advisor Service
![Page 36: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/36.jpg)
We built a foundation of trust We embedded to create alignment
We became advisors
![Page 37: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/37.jpg)
![Page 38: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/38.jpg)
DISCLAIMER The journey we took isn’t for everybody • Costly to maintain identity • Going native is a risk • Can’t address as many problems • Need to constantly evolve
![Page 39: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/39.jpg)
Build a foundation of trust Embed to create alignment Be a presence, not just present + Trusted Advisor
![Page 40: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/40.jpg)
Trusted Advisor + Player-Informed Mission
Player-Focused
![Page 41: Riot Games' Insights Evolution](https://reader034.vdocuments.site/reader034/viewer/2022042510/5879ca381a28abb42a8b702b/html5/thumbnails/41.jpg)
Questions?
Brandon Hsiung Director of Insights @ Riot Games
BHSIUNG @ RIOTGAMES.COM