human testing ios apps
DESCRIPTION
This is the presentation Mobtest's CTO and founder Dirk de Kok gave at the Renaissance iOS app makers' conference. He talked about user testing iOS apps, including concept testing, usability testing, beta testing, QA testing. See also https://github.com/mobtest/renaissance.io/TRANSCRIPT
© Mobtest 2013
Human Testing iOS apps
Dirk de [email protected]/dirkdk
Renaissance conferenceJan 23rd 2013
‣ works technically as intended
App quality
‣ offers considerable value
‣ intuitive and easy to use
Human testing
Manual QA testing
Concept testing
Usability testing
Beta testing
Live testing
{User testing
Test to create better apps
not just bug free apps
‣ if high quality, app might get featured
‣ initial ratings drive subsequent downloads
‣ reaching a top 25 normally happens
around launch
‣ critical updates take still 1-2 weeks
because of Apple review process
Test early, before launch
Concept testing
Goal
validate app idea with target market
How
‣ find respondents
‣ do interview with factual questions
‣ show mockup or prototype
Usability testing
Goal
test how easy it is to use your app
How
‣ in person
‣ remote
‣ meet testers in office or coffee shop
‣ give tasks with only end result
‣ let user think out loud
‣ observe usage, facial expression, posture
In person usability testing
‣ easier to remember
‣ easier to share with your team
can’t do it on iOS device itself
Record usability test
Via Skype DIY camera
‣ recruit larger group of users
‣ distribute ad hoc build
‣ give tasks with only end result
‣ track task completion in app and
ask questions afterwards by survey
Remote usability testing
‣ does it work as user expects?
‣ discoverability
‣ areas of confusion
‣ positive experience
What to look for
Goals
‣ final feedback from users
‣ integration test with real data
‣ get early adopters enthusiastic about
app (reviews and ratings!)
Beta testing
How
‣ Recruit testers via own network or service
‣ Get their UDID, create ad hoc build and
distribute
‣ Reward feedback
Beta testing
QA testing
Goals
‣ make sure app works technically fine
QA testing
How
‣ get a good test engineer
‣ write a detailed plan
‣ execute plan
QA methods
‣ structured testing with predefined test
scripts with expected outcomes
‣ “go break it” exploratory testing
What to look for
‣ Hardware models x iOS versions
‣ Connectivity (wifi, cell, intermittent)
‣ Gestures, moves, tilting and multitouch
‣ Location/geofencing
Live testing
‣ A/B testing
‣ Monitoring usage patterns
‣ Crash log analysis
‣ Feedback options for user
http://github.com/mobtest/
Thank you