intuition vs. metrics the big debate andrew mo | playfish china
TRANSCRIPT
![Page 1: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/1.jpg)
![Page 2: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/2.jpg)
Intuition vs. Metrics The Big Debate
Andrew Mo | Playfish China
![Page 3: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/3.jpg)
![Page 4: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/4.jpg)
![Page 5: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/5.jpg)
![Page 6: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/6.jpg)
so what’s the debate?
![Page 7: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/7.jpg)
INTUITION
“I will quit beforeI make a gamebased on analytics”
– Warren Spector, Disney
![Page 8: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/8.jpg)
METRICS
“Creating SuccessfulSocial Games:Understanding Player Behavior”
– Mark Skaggs, Zyng
![Page 9: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/9.jpg)
which one wins?
vs
![Page 10: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/10.jpg)
(drum roll)
![Page 11: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/11.jpg)
both.
![Page 12: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/12.jpg)
thank you … questions?
![Page 13: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/13.jpg)
the (actual) plan
why do we need both?
why is it hard to do it right?
when to use which?
![Page 14: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/14.jpg)
a much wider debate…
![Page 15: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/15.jpg)
inspirationpatternsholistichunchtacit
analysisdataintentionallogicexplicit
![Page 16: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/16.jpg)
you need both
![Page 17: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/17.jpg)
“Not everything that counts can be counted and not everything that can be counted counts”
![Page 18: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/18.jpg)
“Radical innovation requires both evidence and intuition: evidence to become informed, and intuition to inspire us in imagining and creating new and better possibilities.”
— Jane Fulton Suri , IDEO
![Page 19: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/19.jpg)
it’s evolution, baby.
![Page 20: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/20.jpg)
but it’s hard!
![Page 21: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/21.jpg)
single biggest reason for failure…
…using the wrong one at the wrong time
![Page 22: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/22.jpg)
two tales
![Page 23: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/23.jpg)
tale #1: wrong number
![Page 24: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/24.jpg)
once upon a time, a CEO …
![Page 25: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/25.jpg)
… was all about safety
![Page 26: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/26.jpg)
• safety targets were being met– Initiatives underway– money spent
• … but clear signs of problems:– Numerous safety
hazards reported at supposedly "upgraded" refineries
the problem
![Page 27: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/27.jpg)
BP Deepwater Horizon Explosion (April 20, 2010)
![Page 28: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/28.jpg)
tale #2: trust me
![Page 29: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/29.jpg)
once upon a time, a CEO …
![Page 30: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/30.jpg)
… was all about money
![Page 31: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/31.jpg)
a big believer in intuition
• courses for executives “on trusting their instincts when making difficult decisions”
![Page 32: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/32.jpg)
the problem
• intuition was trusted even when key data said otherwise
• poor decisions left the company exposed to a lot of risk
![Page 33: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/33.jpg)
![Page 34: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/34.jpg)
when to use which?
![Page 35: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/35.jpg)
choosing the right one
• your values matter
• your team matters
• the problem matters
![Page 36: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/36.jpg)
values matter
![Page 37: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/37.jpg)
designer proposed this
![Page 38: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/38.jpg)
pm proposed this
![Page 39: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/39.jpg)
went to the VP with this
![Page 40: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/40.jpg)
data driven values
…ultimately tested 44 different shades of blue
![Page 41: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/41.jpg)
![Page 42: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/42.jpg)
team matters
![Page 43: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/43.jpg)
traditional game development
Producer(Creative)
Game Designer(Creative)
web development
Designer(Creative)
Product Manager(Data)
social game development
Producer/Designer (Creative)
Product Manager(Data)
![Page 44: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/44.jpg)
![Page 45: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/45.jpg)
balance of power is key
Producer(Creative)
Product Manager(Data)
![Page 46: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/46.jpg)
the problem matters
![Page 47: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/47.jpg)
highly complex inputs intuition
less complex inputs analysis
![Page 48: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/48.jpg)
more complex intuition
![Page 49: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/49.jpg)
less complex analysis
![Page 50: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/50.jpg)
intuition best practices
![Page 51: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/51.jpg)
![Page 52: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/52.jpg)
![Page 53: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/53.jpg)
“The analysis, based on past events, certainly seems sound. But your instincts are the only way you're going to do something unsound.
And unsound things become hits. Sound ones never do.”
— Seth Godin
![Page 54: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/54.jpg)
how to use intuition
• experience is important• lean towards it for complex
problems, not for details• lean towards it for long-term
planning• lean towards it when creating
something new• back it up with data whenever
possible
![Page 55: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/55.jpg)
metrics best practices
![Page 56: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/56.jpg)
![Page 57: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/57.jpg)
![Page 58: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/58.jpg)
good things about metrics
• what gets measured gets done• good metrics drive good behaviour• good metrics help you make good
decisions• good for highly measurable
environments with short feedback loops
![Page 59: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/59.jpg)
bad things about metrics
• what gets measured gets done• bad metrics drive bad behaviour• bad metrics help you make bad
decisions• bad for noisy environments with
long feedback loops• metrics can age quickly
![Page 60: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/60.jpg)
key metrics for social games
engagement
DAU
playrate (DAU/MAU)
funnel tracking
virality
installs / DAU
# of invites sent
accept %
monetization
% spenders
ARPU & ARPPU
new vs. repeat spenders
![Page 61: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/61.jpg)
metrics best practices
• align with your goals• good enough (vs. perfect)• keep it simple … a few good
ones• revise, revise, revise
… things change; don’t be afraid to add, change and remove
![Page 62: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/62.jpg)
closing comments
![Page 63: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/63.jpg)
final words• you need both!
– metrics are good to optimise and to clear false assumptions
– intuition can lead you out of your rut (for good and for worse)
– Trust your gut and prove it with data!
• use the right one at the right time, but don’t hide behind either
![Page 64: Intuition vs. Metrics The Big Debate Andrew Mo | Playfish China](https://reader035.vdocuments.site/reader035/viewer/2022062404/551b723e550346d6338b4efe/html5/thumbnails/64.jpg)