winning at the politics of usability
DESCRIPTION
Winning at the Politics of Usability. John Sorflaten – Human Factors International Michael Rawlins – Open Solutions Jeff Sauro – Oracle; Measuring Usability Javier Broch – Columbia University Linda Chadwick – Duck Creek Technology. Politics Defined. “The Buck Stops Here” – Harry Truman - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/1.jpg)
1
Winning at the Politics of Usability John Sorflaten – Human Factors International Michael Rawlins – Open Solutions Jeff Sauro – Oracle; Measuring Usability Javier Broch – Columbia University Linda Chadwick – Duck Creek Technology
![Page 2: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/2.jpg)
2
Politics Defined “The Buck Stops Here” – Harry Truman So…. Take ownership of political
problems.
![Page 3: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/3.jpg)
3
Who has heard this?…. “We don’t have time for usability now” “We don’t need you right now…maybe
later.” “This project is almost done. Can you
check it out?” Others?
![Page 4: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/4.jpg)
4
But….we’re here… Many organizations heard the message
and now have usability staff And trained them… And hope to use them… And… (gulp….) … you don’t get used….
![Page 5: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/5.jpg)
5
The art of politics… “Politics moves mountains with mere
words.” -- anonymous
![Page 6: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/6.jpg)
6
Here’s some words….
1. Speak credibly – John Sorflaten2. Have credentials – Michael Rawlins3. Talk the talk – Javier Bloch4. Be quantitative – Jeff Sauro5. Do the dew. Get moxie. – Linda
Chadwick
![Page 7: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/7.jpg)
7
John: Speaking Credibly
Roadbump? You: “I think we should use a drop down
list here to make it easier to type the entry.”
Them: “That’s your opinion. Here’s my opinion….”
Guideline: avoid giving opinionsSee eleven more shock absorbers,
next…
![Page 8: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/8.jpg)
8
Cite your Data (top 4 winners):
1. “Research indicates…” (e.g., www.usability.gov)
2. “Our usability testing shows…”3. “Our standards say…” (and they have
been tested for usability)4. “Best practices suggest that…”
(usability training, books, gurus…)
![Page 9: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/9.jpg)
9
Do Gedanken Experiments (Einstein)
5. Cognitive task analysis: Identify loads… • Visual• IntellectualE.g., To select a radio button:
1. decide to use mouse (I); 2. look for mouse (V+Mo); 3. reach, grab (Mo); 4. re-position pointer (V+Mo); 5. select option (V, I, Me, Mo)
• Memory• Motor
![Page 10: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/10.jpg)
10
Speak Objectively…
6. “I don’t know…we’ll run a usability test” (avoid speaking for all users)
7. “If I were to conduct a UT, I expect x% of subjects to have this problem…” (give reasons, too)
8. “If I were a UT subject, I would probably be puzzled by…”
![Page 11: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/11.jpg)
11
Borrow Findings…
9. “Other UTs covered similar issues…” (and those results suggest we do x)
10. “Our interviews and observations showed end-users actually did x...”
11. “End-users said they thought x…” (collective mental model)
![Page 12: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/12.jpg)
12
Now, “Speak Credibly”… Avoid opinion like “I think” or “I feel” Use your data (top 4 winners) Use thought experiments (VIMM) Speak objectively (If I were…) Borrow findings (other tests, interviews..)
![Page 13: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/13.jpg)
13
Michael: Have Credentials
Roadbump? You: “I read that Jakob Nielsen said…” Them: “Yeah, but Jarrod Spool said…”
See 5 improved seats, next…
![Page 14: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/14.jpg)
14
1. Get R-E-S-P-E-C-T (Thanks Aretha!)
If you’re a gatekeeper for usability, can you demonstrate earning that role?
Doctors get an M.D.; Executives get an MBA. Pilots get a license.
What’s your “white coat and stethoscope”?
PhD? MA? CUA? (Certified Usability Analyst); IIBA? (International Institute of Business Analysis certification)
![Page 15: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/15.jpg)
15
2. Get Style Did you pass a driver’s license test? What did it mean? A credential validates our knowledge Self-confidence creates authority Self-efficacy shows up in our “style”
![Page 16: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/16.jpg)
16
3. Be A Professional Professional-ism means membership,
peer review, demonstrated skills Passing a test means “initiation” “A Professional” means management
treats you with: Respect Allegiance Expectations
![Page 17: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/17.jpg)
17
4. Network Your Community… Read and meet your peers… Meet the person next to you. Share your main political challenges. Share solutions, ideas. Share phone number and email. Follow up and network again. “What’s their personality type?”
![Page 18: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/18.jpg)
18
5. Ethically Negotiate and Communicate Risks…
It’s not important to win every argument…
Allow people to reach the correct conclusion on their own time. Supply the kernels of knowledge.
Share the importance of open, direct communication.
![Page 19: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/19.jpg)
Page 19
Index
Javier: Talk the Talk
![Page 20: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/20.jpg)
Page 20
Political Steps - roadmap
1.Define Strategy & Interview stake holders
2.Usability budged
3.BAD GUY - external group to execute political
4.Committee & Tools
5.Fund one project
6.Train & Hire usability
Index
![Page 21: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/21.jpg)
Page 21
Political (elevator) speech –I make technology easy to use
–Simplify things
–Tech. for my mom
–Humanize technology
–Lower the cognitive load
–Make things simpler to use
![Page 22: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/22.jpg)
Page 22
Winning at Politics: ready to say? be unpopular?
– “My feedback does not count, I’m not the intended user”
– What your boss likes might not be what your users like
– Negative feedback
– Culture to satisfy the “board room” (not the user)
– Involve all the parties
Index
![Page 23: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/23.jpg)
Page 23
Expected political obstacles and roadblocks
– The usability of Usability work
– ”I know what the user wants”
– The stakeholder “I like this…”
– “I like this type of web technology”
– “If I can find it, they could find it”
Index
![Page 24: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/24.jpg)
Page 24
Why change the process?
• Ownership? Decentralization
• No usability $, No standards
• The wake up call. Nobody wants to do it
• Customer might only interact via web
• No inventory. Duplication Index
![Page 25: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/25.jpg)
Page 25
Why change the process? (Cont.)
• No focus on user (UCD)
• Political design
• Every one has an opinion
• Every one wants a link
• The boss opinion
.. your reasons …
Index
![Page 26: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/26.jpg)
Page 26
E-mail usability
![Page 27: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/27.jpg)
Page 27
![Page 28: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/28.jpg)
Page 28
Index
![Page 29: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/29.jpg)
Page 29
Political gain … Collecting simple Usability Data
What ..
– are your …. user groups? …frequent tasks?
– key information do your users access the most?
– type of services?
– part of your site do users use the most?
Index
![Page 30: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/30.jpg)
Page 30
Index
![Page 31: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/31.jpg)
31
Measuring Usability
Politics of Quantitative Usability
Jeff Sauro
June 18th 2008
![Page 32: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/32.jpg)
32
Quanta-Phobia
![Page 33: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/33.jpg)
33
Lies,
Damn Lies
& Statistics
… and usability ?
![Page 34: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/34.jpg)
34
You Can't Manage What You Don't Measure
Metrics allow for ROI of Usability
![Page 35: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/35.jpg)
35
6/8 Complete
75% Completion Rate
What do you Report?
Completion Rates
![Page 36: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/36.jpg)
36
75%
![Page 37: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/37.jpg)
37
Release your inner Math Geek
![Page 38: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/38.jpg)
38
What is the true Completion Rate ?6/8 Complete
0 10050
2.5% 2.5%
95% Confidence Interval (40%, 94%)
95%
![Page 39: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/39.jpg)
39
Wide Margin of Error—Why Bother?
95% CI (40%, 94%) = 54 points
![Page 40: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/40.jpg)
40
Use Benchmarks / Criteria
0 10050 70
91%
60%
6/8 Complete
60% Chance 70% of Users Can Complete
97.5%
40
![Page 41: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/41.jpg)
41
Dealer’s Hand
Your Hand
60% Chance You Win
![Page 42: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/42.jpg)
42
60% Chance of Rain
![Page 43: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/43.jpg)
43
60% On Time Arrival
![Page 44: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/44.jpg)
44
60% Chance of Successful Operation
![Page 45: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/45.jpg)
45
1.Benchmarks—What is the min completion rate?
2.How sure do you need to be you’ve improved?
3.Quantify the unknown with CI’s
4.Work within the Limitations of Small Samples
Be brave and be quantitative
http://measuringusability.com/UPA
Calculators & Formula Online
![Page 46: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/46.jpg)
46
Appendix
![Page 47: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/47.jpg)
47
Sample size
Think-aloud Studies
Normality
Time on Task
![Page 48: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/48.jpg)
48
Diagnosis /Comparisons in Think-Aloud
One dot does a lot
![Page 49: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/49.jpg)
49
Managing Non-Normality
Log Transformation
![Page 50: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/50.jpg)
50
Margin of Error for Task Time
Sample Size
Marg
in %
90
80
70
60
50
40
30
20
10
0
Cv
0.70
0.300.48
Margin % vs Sample Size for Typical CVs
Samples < 20 Have > 20% Margin of Error
![Page 51: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/51.jpg)
51
Sample Size
Perc
ent
of Cri
teria
1101008060402015104
93
90
85
80
75
70
60
50
Sample Size Needed for % of Criteria to be SignificantCV of .48
Use Benchmarks / Criteria
How Long Should the task take?
![Page 52: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/52.jpg)
5252
Linda: Do the Dew. Get Moxie.
Roadbump? You: “Why don’t we focus more on
usability?” Them: “But there’s so much to do, so
many other problems to solve.”
See 5 steering tips next…
![Page 53: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/53.jpg)
5353
The Misperceptions …
![Page 54: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/54.jpg)
5454
The Misperceptions …
![Page 55: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/55.jpg)
5555
The Misperceptions …
![Page 56: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/56.jpg)
5656
1. Be “Coordinator” vs. “Expert” Reduce “threat” to colleagues egos Respect and listen to opinions Avert resentment, foster team work Now they’ll listen to your ideas Now they’ll WANT “cool and usable” Make the system work for you
![Page 57: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/57.jpg)
57
Change
"Our dilemma is that we hate change and love it at the same time; what we really want is for things to remain the same but get better”
-- Sydney J. Harris
57
![Page 58: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/58.jpg)
5858
2. Use “Change Management” Check out this discipline, get a book Publish positive reports, experiences Give advance notice on changes Personal messages better than mass mail Update people on project progress
![Page 59: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/59.jpg)
5959
3. Reward “Early Adoption” At meetings, praise individual usability
efforts Start positive feed-back loops Reinforce champion’s confidence in your
work Give your champion something to brag
about
![Page 60: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/60.jpg)
6060
4. Spread the Usability Training Avoid energy-drain of endless questions Packaged training lets others see the
“secrets” You are the “usability consultant” to others “Word processing” now done by everyone Range of training: one-hourhalf daymore You’ll keep job security, amidst teaching
others
![Page 61: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/61.jpg)
61
What are you called?
61
![Page 62: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/62.jpg)
6262
5. Job Title Finesse Re-think “job title du jour” phenomenon Create a hierarchy of usability titles NOT a “dead-end” job (for tired people) Promote path for advancing usability careers Insure salary perks for increased skills/scope All this acknowledges: “career professional” Usability will never disappear Do the due. GET MOXIE!
![Page 63: Winning at the Politics of Usability](https://reader035.vdocuments.site/reader035/viewer/2022070406/5681408b550346895dac16ea/html5/thumbnails/63.jpg)
63
John: Rapping Up Politics Doing the dew (due) means “politics” Who would like more moxie? Tell us your take-home rap…
! Wow… ! Sure… ! Love it… ! Goforit…
E-mail your ideas: [email protected]