i don't know (and that's ok)
DESCRIPTION
Keynote address for Product Development Insights conference - NYC 10/1/2010.TRANSCRIPT
![Page 1: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/1.jpg)
I Don’t Know(And That’s OK.)
Cindy AlvarezThe Experience is the Product - http://www.cindyalvarez.com
Copyright 2010 Cindy Alvarez
![Page 2: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/2.jpg)
Copyright 2010 Cindy Alvarez
I’m here today to promote ignorance.
![Page 3: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/3.jpg)
Copyright 2009 Cindy Alvarez
Product Development Maturity
![Page 4: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/4.jpg)
Copyright 2009 Cindy Alvarez
Product Development Effectiveness
![Page 5: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/5.jpg)
Copyright 2010 Cindy Alvarez
How does “knowing” kill great product
development?
![Page 6: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/6.jpg)
Knowing is static but the world changes
Copyright 2010 Cindy Alvarez
![Page 7: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/7.jpg)
Knowing is apples but the situation may be oranges
Copyright 2010 Cindy Alvarez
Crowdsourced localization of KISSinsights - 100+ questions in 14 languages
![Page 8: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/8.jpg)
You know but you don’t know enough
Copyright 2010 Cindy Alvarez
ONLINE BILL PAY
average bills paid/month
average $/payment
most likely to pay these types of bills
log in X times/month
pay X bills per session
![Page 9: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/9.jpg)
You know but you don’t know enough
Copyright 2010 Cindy Alvarez
ONLINE BILL PAY
average bills paid/month
average $/payment
most likely to pay these types of bills
log in X times/month
pay X bills per session
BEFORE:put incoming bills in the bill pile
circle due dates on calendar
set up reminders on my cell phone
pen and paper calculations
check when payday is
AFTER:cross it off the calendar
check if I can pay more towards my credit card bill
transfer extra into savings
![Page 10: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/10.jpg)
Knowing makes you lazy and you’ll forget to provide data
Copyright 2010 Cindy Alvarez
“Users need this...The market demands this...Trust me and just build it.”
![Page 11: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/11.jpg)
which breeds HiPPOs.
Copyright 2010 Cindy Alvarez
“As the CEO, I just know this’ll work...”
![Page 12: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/12.jpg)
If you were right, you denied your team the opportunity to learn and feel awesome
Copyright 2010 Cindy Alvarez
![Page 13: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/13.jpg)
And if you were wrong, you lose credibility
Copyright 2010 Cindy Alvarez
“This is all your fault! We built exactly what you asked for.”
![Page 14: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/14.jpg)
Copyright 2010 Cindy Alvarez
For great product development to thrive,
![Page 15: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/15.jpg)
Copyright 2010 Cindy Alvarez
Foster a culture of not knowingbut learning
![Page 16: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/16.jpg)
Copyright 2010 Cindy Alvarez
“WAIT! What do you mean, you don’t know?!”
![Page 17: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/17.jpg)
Copyright 2010 Cindy Alvarez
(This approach isn’t easy on enterprise customers, CEOs, or project managers.)
![Page 18: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/18.jpg)
Copyright 2010 Cindy Alvarez
“I don’t know, but --• here’s how we’re going to find out..”
• my hypothesis is...”
• here’s what I do know...”
![Page 19: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/19.jpg)
Copyright 2010 Cindy Alvarez
+ More work+ More uncertainty
More rigor
= Better odds*
* come on, you know there are no guarantees in product development!
![Page 20: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/20.jpg)
Copyright 2010 Cindy Alvarez
OK, so how do we foster a culture of
not knowingbut learning?
![Page 21: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/21.jpg)
Copyright 2010 Cindy Alvarez
Start with ground rules:
![Page 22: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/22.jpg)
Copyright 2010 Cindy Alvarez
It’s always OK to ask “what is the goal of doing this?”
![Page 23: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/23.jpg)
Copyright 2010 Cindy Alvarez
All brains are good brains.
![Page 24: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/24.jpg)
Copyright 2010 Cindy Alvarez
Limit “heads down” time.
![Page 25: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/25.jpg)
Copyright 2010 Cindy Alvarez
“Ugly data” trumps no data.
![Page 26: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/26.jpg)
Copyright 2010 Cindy Alvarez
Develop your own learning funnel:
![Page 27: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/27.jpg)
Copyright 2010 Cindy Alvarez
interviews
surveys
market research analytics bug reports
competitive research user testing best practices
“what’s important”
A/B testing
summarize (most companies skip this
--> fail)
![Page 28: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/28.jpg)
Copyright 2010 Cindy Alvarez
Teach your team to fish:
![Page 29: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/29.jpg)
Copyright 2010 Cindy Alvarez
How can we ask the customer?
How can we ask the data?
How can we compare ourselves to alternatives?
How can we try “doing the opposite thing?”
How can we gain a new perspective?
Don’t expect people to “just know” how to contribute
![Page 30: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/30.jpg)
Copyright 2010 Cindy Alvarez
Show off:
![Page 31: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/31.jpg)
Copyright 2010 Cindy Alvarez
We learned ____________,
so we didn’t build _____________,
which saved us ________!
We learned ____________,
so we quickly did _____________,
which earned us ________!
![Page 32: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/32.jpg)
Copyright 2010 Cindy Alvarez
Oh, and --don’t try to do this
all at once:
![Page 33: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/33.jpg)
Copyright 2010 Cindy Alvarez
idea this was great
idea this sucked
idea this needs work
idea this was great
(It won’t be this neat, but you get the idea.)
![Page 34: I Don't Know (and that's OK)](https://reader034.vdocuments.site/reader034/viewer/2022052303/54c731dc4a79590c6e8b4690/html5/thumbnails/34.jpg)
Copyright 2010 Cindy Alvarez
Go out thereand “I don’t know”
your way to your next great product!