UX & Agile - UX Research Amsterdam meetup - 04022016

Download UX & Agile - UX Research Amsterdam meetup - 04022016

Post on 15-Apr-2017

451 views

Category:

Technology

21 download

TRANSCRIPT

  • UX Research

    Agile

  • Anna Witteman Head of UX Lab

    IceMobile

  • Copyright A. Witteman & R. van den Oever, All Rights Reserved.

    Amsterdam based company (& office in Hong Kong, Toronto)

    120 employees

    over 30 nationalities

    Either a foodie, code king, design nerd, beer brewer or unicorn

    IceMobile Amsterdam

  • Context ChatPulse UX Testing

    Cultural relevant research

    Experience Mapping

  • THE MARSHMALLOW CHALLENGE

  • Orient Plan Build Ta-da!

    Business (wo)men

    Kindergarten students

    0 18 Minutes

    Uh-oh!

  • Agile teams

    Product Backlog

    Sprint Backlog

    Potentially Shippable Product

    2-3 weeks

    24 hours

    Daily Scrum Meeting

    Design

    Development

    Q/A Testing

  • the problem

  • Ta-da!

    Previous Usability Testing

    Iterative Usability Testing

    0 Time

    Uh-oh!

    Involve users

  • Agile teams

    Product Backlog

    Sprint Backlog

    Potentially Shippable Product

    2-3 weeks

    24 hours

    Daily Scrum Meeting

    Design

    Development

    Q/A Testing

    Usability testing

  • findings do not stick

  • mismatch

  • no visible value

  • Transfer information effectiveThe team should learn most of the user test, not the UX researcher

    Fit the user into the processDo testing so that it is not extra work

    Make results visibleValue should be clear and measurable

    We wanted to find a way to:

  • HOW?

  • Which practice proved its value?

    Individuals and interactions

    Working software

    Customer collaboration

    Responding to change

    over

    over

    over

    over

    processes and tools

    comprehensive documentation

    contract negotiation

    following a plan

    Agile Manifesto

  • Source: Nielsen, Jakob, and Landauer, Thomas K.: "A mathematical model of the finding of usability problems," Proceedings of ACM INTERCHI'93 Conference (1993), pp. 206-213.

    Usability Testing is an iterative process!

  • Iteration is the heartbeat of agile & user testing

    use it!

  • Product = Prototype

    Write a scenario

    Create a prototype

    Recruit users

    Pilot test

    Conduct Tests

    Edit videos

    Analyze video

    Write report

    Present results

    User test = Report

  • Our setup is a combination of simple tools

  • Our setup is a combination of simple tools

  • More evaluators = more issues identified

    Source: Herttzum, M., Jacobsen, N. (2001). The evaluators effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, vol. 13, pp.421-443.

  • Ratio benefits to costs of # evaluators4 = ideal # evaluators

    Source: Herttzum, M., Jacobsen, N. (2001). The evaluators effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, vol. 13, pp.421-443.

  • Chapter title

  • How to keep track of the findings?

    # user that did this task

    # user that had this problem

    time stamps of this issue

    on video

    description of issue

  • How to keep track of the findings?

  • Pulse: iterative User Involvement

    Prioritize: test important part(s) most extensive

    Frequent: reliable results, also test improvements

    Empathize: learn what matters to users

    Optimize: learn to test

    Allow responding to change

    'I have not failed. I've just found 10000 ways that won't work.

    Sir Thomas Edison

  • Pulse UX TestingTraditional UX testing

    Iterative UX testing: every 2 weeks

    UX testing (near) the end of a project

    Continuous testingSingle test

    Small sessionsBig session

    Performed by the teams: the team members learn most

    Performed by researchers: the researchers learn most

    Changes early in the process; thus less costly

    Changes late in the process; thus very costly

    Rise in first time right of features

    Few first time right of features

    120% end-result in 80% of the time

    Difficult to measure success

  • Transfer information effectivelyThe team learns most of the user test, not the UX researcher

    Fit the user into the processDo testing so that it is not extra work

    Make results visibleValue should be clear and measurable

    What we achieved:

  • Thank you!

    anna@icemobile.com linkedin.com/in/annawitteman

    @Morise

    mailto:anna@icemobile.com?subject=http://linkedin.com/in/annawitteman

  • We are hiring. icemobile.com/jobs

  • IceMobileAmsterdam @icemobile@icemobile