lean user testing best practices – ux camp hamburg 2015

10
Lean User Testing Best Practices Lessons Learned From Running Hundreds of DIY User Interviews UX Camp Hamburg 2015

Upload: stefan-wolpers

Post on 18-Feb-2017

784 views

Category:

Software


1 download

TRANSCRIPT

Page 1: Lean User Testing Best Practices – UX Camp Hamburg 2015

Lean User Testing Best Practices

Lessons Learned From Running Hundreds of DIY User Interviews

UX Camp Hamburg 2015

Page 2: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Agency Experience I

• 7 interviews of 90 min duration each over 2.5 days

• Buffet was okay• Attendees’ interest

spiked:– At lunch-time– In the late afternoon

[email protected]

Page 3: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Agency Experience II

• Costs: 3,000+ €/Interview• Results:– No real news for the Product team…– …but stakeholder accepted the report

[email protected]

Page 4: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab I

• The Four NOs:1. No observation room2. No buffet3. No 90 min interviews4. No special event

[email protected]

Page 5: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab II

[email protected]

Page 6: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab III

• Recruiting of B2C Users:1. Facebook doesn’t work. But newsletters do…2. Use simple Google forms3. Have a joker for each session available4. Remind them (email & phone call)5. Reward them (20 €, remember ‘attention’)6. No show rate: 5-10% (Additional shows, too!)7. 150 emails required for one interview

[email protected]

Page 7: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab IV

• Best Practices:1. 30-60 min interviews are most effective2. 5-10 min to onboard, 5 min to leave.3. Post-interview muffins only4. Crew: max. 25. Observers: 2-36. Let (trained) stakeholder run interviews7. Screen recordings are rarely ever

watched [email protected]

Page 8: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab V

[email protected]

Page 9: Lean User Testing Best Practices – UX Camp Hamburg 2015

The Do-It-Yourself User Lab VI

• Costs: approx. 200+ €/Interview• Lessons learned:– Better standing of the Product within the company– Useless requirements could be rejected or ignored– Low hanging UX fruit picked– The best performing departments participated actively– Rapid product delivery possible – Litmus test in Agile for the top management & the

organization as a whole

[email protected]

Page 10: Lean User Testing Best Practices – UX Camp Hamburg 2015

„Hands-on Agile: Lean User Testing“

Email: [email protected]: @AgeOfProduct @StefanW

Blog: https://age-of-product.com