lean user testing best practices – ux camp hamburg 2015

Lean User Testing Best Practices

Lessons Learned From Running Hundreds of DIY User Interviews

UX Camp Hamburg 2015

The Agency Experience I

• 7 interviews of 90 min duration each over 2.5 days

• Buffet was okay• Attendees’ interest

spiked:– At lunch-time– In the late afternoon

stefan@age-of-product.com

The Agency Experience II

• Costs: 3,000+ €/Interview• Results:– No real news for the Product team…– …but stakeholder accepted the report

stefan@age-of-product.com

The Do-It-Yourself User Lab I

• The Four NOs:1. No observation room2. No buffet3. No 90 min interviews4. No special event

stefan@age-of-product.com

The Do-It-Yourself User Lab II

stefan@age-of-product.com

The Do-It-Yourself User Lab III

• Recruiting of B2C Users:1. Facebook doesn’t work. But newsletters do…2. Use simple Google forms3. Have a joker for each session available4. Remind them (email & phone call)5. Reward them (20 €, remember ‘attention’)6. No show rate: 5-10% (Additional shows, too!)7. 150 emails required for one interview

stefan@age-of-product.com

The Do-It-Yourself User Lab IV

• Best Practices:1. 30-60 min interviews are most effective2. 5-10 min to onboard, 5 min to leave.3. Post-interview muffins only4. Crew: max. 25. Observers: 2-36. Let (trained) stakeholder run interviews7. Screen recordings are rarely ever

watched againstefan@age-of-product.com

The Do-It-Yourself User Lab V

stefan@age-of-product.com

The Do-It-Yourself User Lab VI

• Costs: approx. 200+ €/Interview• Lessons learned:– Better standing of the Product within the company– Useless requirements could be rejected or ignored– Low hanging UX fruit picked– The best performing departments participated actively– Rapid product delivery possible – Litmus test in Agile for the top management & the

organization as a whole

stefan@age-of-product.com

„Hands-on Agile: Lean User Testing“

Email: stefan@age-of-product.comTwitter: @AgeOfProduct @StefanW

Blog: https://age-of-product.com