why do usability problems go unfixed?
DESCRIPTION
Even when everyone agrees on the changes, usability problems sometimes persist. In this talk from UPA2012 in Las Vegas, Steve Krug and Caroline Jarrett report on a survey of UX professionals and their own ideas about how to tackle this challenge.TRANSCRIPT
![Page 1: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/1.jpg)
Why do the most serious usability problems we uncover often go unfixed?
“But the light bulb
has to want to change”
Steve Krug and Caroline Jarrett#upa2012 Las Vegas
![Page 2: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/2.jpg)
2
Does this seem familiar?
![Page 3: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/3.jpg)
3
You work hard to find serious usability problems
Image credit: infodesign.com.au
I can’t find out where I sign in
![Page 4: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/4.jpg)
4
You present your findings to the client/team
This video clip shows……
![Page 5: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/5.jpg)
5
They love your findings and recommendations
That’s exactly what we needed
to know!
![Page 6: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/6.jpg)
6
Everyone agrees on the changes
We know what we have to do and we’re going to do it
![Page 7: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/7.jpg)
7
Months/years later, the same problems still exist
Image credit: infodesign.com.au
If only I could find out where to sign in…
![Page 8: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/8.jpg)
These are often the most serious issues
Significant negative impact on► The users’ experience ► The effectiveness of the site or product► The profitability of the site or product
8
Why don’t users sign in?
![Page 9: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/9.jpg)
9
This happened to me (Steve)
Didn't do long term engagements After a while, I wasn't surprised Told myself:
► It’s OK, I’m educating them► They’ll do better in the next project/job/lifetime
![Page 10: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/10.jpg)
10
This happened to me (Caroline)
Did do long term engagements After a while
► I was more surprised when changes did happen► But I was still disappointed when they didn’t
![Page 11: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/11.jpg)
Obligatory audience participation (15%)
Have you experienced this?► If so, please think of an example
when it happened► If not, feel smug or young► Share your thoughts with
the person sitting next to you
11
![Page 12: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/12.jpg)
12
We decided to do a survey
It would be good to go beyond our suspicions Increase chances of our UPA proposal getting
accepted Chance to practice doing
a survey together
![Page 13: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/13.jpg)
13
![Page 14: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/14.jpg)
We opted for ‘send and hope’ – via Twitter
Off to our followers► @cjforms ~ 800► @skrug ~ 8,000► @RosenfeldMedia ~ 70,000 thanks Lou► Of whom: ~ 500 clicked the survey
link- Of whom: 146 filled in the survey
– Of whom: » 15 had never had this happen to them» Giving us 131 responses. » But we were very happy because the responses
were REALLY interesting and thoughtful.
14
![Page 15: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/15.jpg)
People put a lot of effort into our survey
15
1-5 6-10 11-20 21-30 more than 500
10
20
30
40
50
60
Time to complete (minutes)
These folks must have taken a break. Glad they came back to it.
We didn’t get as many comments from these(but the data is useful)(and short comments are easier to analyse)
These people worked really hard for us. Respect.
![Page 16: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/16.jpg)
We asked people why it happened (12 options)
16
![Page 17: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/17.jpg)
17
Which one do you think is the most frequent?
Not enough time Too much else to do Not enough resources Required too big a change to a business process Technical team said it couldn't be done Team did not have enough power to make it happen Conflicted with decision maker's belief or opinion No effective decision maker Disagreements emerged later Deferred until next major update/redesign Other events intervened before change could happen Legal department objected
![Page 18: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/18.jpg)
Steve’s view: You can’t fix everything
© 2001 Steve Krug
Problems you can find with just a few test participants
Problems you have the resources to fix
![Page 19: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/19.jpg)
Caroline’s view: Redesign must die (thanks Lou)
19From Louis Rosenfeld’s talk “Redesign must die” http://www.slideshare.net/lrosenfeld/redesign-must-die
![Page 20: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/20.jpg)
Our own picks for most popular reason
Not enough time Too much else to do Not enough resources Required too big a change to a business process Technical team said it couldn't be done Team did not have enough power to make it happen Conflicted with decision maker's belief or opinion No effective decision maker Disagreements emerged later Deferred until next major update/redesign Other events intervened before change could happen Legal department objected
20
Steve
Caroline
![Page 21: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/21.jpg)
Our instincts are good but…
Legal department objected
Disagreements emerged later
Other events intervened before change could happen
Technical team said it couldn't be done
Required too big a change to a business process
Team did not have enough power to make it happen
No effective decision maker
Too much else to do
Not enough time
Deferred until next major update/redesign
Not enough resources
Conflicted with decision maker's belief or opinion
0 10 20 30 40 50 60 70
Number of times this reason was chosen
![Page 22: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/22.jpg)
We underestimated the politics
Legal department objected
Disagreements emerged later
Other events intervened before change could happen
Technical team said it couldn't be done
Required too big a change to a business process
Team did not have enough power to make it happen
No effective decision maker
Too much else to do
Not enough time
Deferred until next major update/redesign
Not enough resources
Conflicted with decision maker's belief or opinion
0 10 20 30 40 50 60 70
Number of times this reason was chosen
![Page 23: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/23.jpg)
Most people chose lots of reasons
23Don't know 1 reason 2 3 4 5 6 7 8 9 reasons0
5
10
15
20
25
30
35
“I could have checked off just about every one of these. Was this survey written just for me?”
![Page 24: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/24.jpg)
24
Two groups of reasons came up a lot
Not enough time Too much else to do Not enough resources Required too big a change to a business process Technical team said it couldn't be done Team did not have enough power to make it happen Conflicted with decision maker's belief or opinion No effective decision maker Disagreements emerged later Deferred until next major update/redesign Other events intervened before change could happen Legal department objected
“Capacity”
“Politics”
![Page 25: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/25.jpg)
Almost everyone chose capacity and/or politics
25
One or more capacity
reasons, 27
At least one from capacity and one from politics, 63
One or more politics rea-
sons; 34
Don't know; 4 Other; 3
![Page 26: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/26.jpg)
26
So, what can we do?
![Page 27: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/27.jpg)
Think about your ideas for a moment
Survey question 4:
“If something like that happened again, what would you do differently to ensure that the changes got made?”
27
![Page 28: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/28.jpg)
28
Ideas from our surveyrespondents – in themes
![Page 29: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/29.jpg)
Theme: Do nothing
Accept the situation► “Sometimes recommendations don't get realized.”► “Clients don’t have to follow our advice”► “I'll chant some Oms”
29Image credit: shutterstock.com
![Page 30: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/30.jpg)
Theme: Choose better clients or a better job
“Become more efficient at choosing who I accept as clients”
“Work for a company that gave a fig about UX”
30Image credit: shutterstock.com
![Page 31: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/31.jpg)
Theme: Do basic UX better
Do testing earlier Make stakeholders watch the sessions Present results better
► More explanations► Use video clips
31
![Page 32: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/32.jpg)
Theme: Think about the impact on developers
“redefine problem as interaction bug” “have a role in the implementation team” “don’t spring surprises on them”
32Image credit: Effortmark Ltd
![Page 33: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/33.jpg)
Theme: Get better at politics
Get decision-maker support Understand priorities “Get more buy-in. Explain changes to a
sponsor. Argue the case. Make it harder to NOT do the change”.
33
![Page 34: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/34.jpg)
34
How can we keep this from happening? (Steve)
![Page 35: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/35.jpg)
Go ahead. Follow the conventional wisdom…
Be more politic if you want► It probably won’t hurt
Understand their priorities► It probably won’t hurt
Learn to speak their language► It probably won’t hurt
Make an ROI case► Feel free, if you have a spare month or three
I encourage you to do all of these things Do I think it will solve the problem?
► Probably not35
![Page 36: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/36.jpg)
Why not, you may ask?
Because I think there are four real reasons why serious problems don’t get fixed
36
![Page 37: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/37.jpg)
1. Since you can’t fix everything, you have to prioritize
© 2001 Steve Krug
Problems you can find with just a few test participants
Problems you have the resources to fix
![Page 38: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/38.jpg)
...and we don’t necessarily prioritize well
If you were a developer, which would you work on?
38
One very hard-to-solve (perhaps impossible) problem
A large quantity of low-hanging fruit
![Page 39: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/39.jpg)
2. The elephants have been in the room a long time
Serious problems are often familiar problems Their longevity makes people assume they’ll
be hard to fix “If there was a simple solution, we would
have fixed it.”
39
![Page 40: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/40.jpg)
3. The siren song of redesign
“It will be fixed in the next redesign” is very seductive because it sounds true
Allows you to stamp the file “Case Closed!” Makes everyone happy
► Except, of course, the users
Oh, and then there’s the fact that it never happens
40
![Page 41: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/41.jpg)
4. The absent father holds the trump card
Often someone not in the room later disagrees
What he says, goes► (Let’s face it: they’re usually men)► (Especially the ones who
make arbitrary decisions)
41
![Page 42: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/42.jpg)
So, what’s a girl to do?
42
![Page 43: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/43.jpg)
Accept that the absent father may never love you
Forget about convincing the Don You probably can’t get to him And even if you can, you probably can’t
change his mind► Either he’s nuts (96 point type!)► Or he believes you’re too small
to see the big picture
43
![Page 44: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/44.jpg)
Don’t raise the bridge; lower the water
Instead of trying to work the political game and convince everyone, just make it easier for the changes to be made
Commit to fixing a small number of the most serious problems each month
Keep the solutions simple, so► They get done!► They get done quickly► The higher-ups don’t have to be involved
44
![Page 45: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/45.jpg)
Don’t try to convince everybody
45
Your team
Yourboss
Other bosses he depends on
Stakeholders
Mr. Big
You
Higher-ups
![Page 46: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/46.jpg)
Ideally…
46
Your team
Yourboss
Other bosses he depends on
Stakeholders
Mr. Big
You
Higher-ups
![Page 47: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/47.jpg)
i.e., the people you can get in an observation room
47
![Page 48: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/48.jpg)
Keep them focused on the worst problems
48
Focus ruthlessly on a small number of the most important problems.
![Page 49: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/49.jpg)
© 2001 Steve Krug
![Page 50: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/50.jpg)
© 2001 Steve Krug
![Page 51: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/51.jpg)
Tweak, don’t redesign
© 2001 Steve Krug
When fixing problems, always do the least you can do™.
![Page 52: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/52.jpg)
© 2001 Steve Krug
Your motto should be…
What’s the smallest change we can make that we think might solve the observed problem?
I argue that there’s always some tweak that can mitigate a serious problem
And you should implement it ASAP
![Page 53: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/53.jpg)
53
Caroline responds… about that elephant
![Page 54: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/54.jpg)
Eat now, eat soon, or eat an elephant?
54
![Page 55: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/55.jpg)
Sometimes teams need a success experience
55
![Page 56: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/56.jpg)
Sometimes users have a different perspective
56
![Page 57: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/57.jpg)
One story struck me particularly
“This recommendation was made and added to a CI list about three years ago, and has never been implemented. The main reason was that it wasn't important enough when compared against the other CI items on the list. Now, the entire site section is up for a redesign, and the item is on hold indefinitely”
57
![Page 58: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/58.jpg)
One story struck me particularly
“This recommendation was made and added to a CI list about three years ago, and has never been implemented. The main reason was that it wasn't important enough when compared against the other CI items on the list. Now, the entire site section is up for a redesign, and the item is on hold indefinitely”
58
![Page 59: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/59.jpg)
Even the most user-focused organisations…
Wonderful tools for the scientific community Very committed to user-centred design
59
![Page 60: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/60.jpg)
60
We have different ideas about rewards
![Page 61: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/61.jpg)
61
Look for success in everybody’s terms
Image credit: Francis Rowland
![Page 62: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/62.jpg)
That light bulb reference
Q: How may psychiatrists does it take to change a light bulb?
A: Only one, but the light bulb has to want to change
62Image credit: shutterstock.com
![Page 63: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/63.jpg)
Your turn
Questions, comments, requests for a refund?
63
![Page 65: Why do usability problems go unfixed?](https://reader033.vdocuments.site/reader033/viewer/2022060107/554ba16db4c905b3618b4aa6/html5/thumbnails/65.jpg)
More presentations from us
65
http://www.slideshare.net/cjforms
http://www.slideshare.net/SteveKrug