dalia el-shimy ux research lead, shopifyjer/courses/hci/lectures/el-shimy2017.pdf · • technology...
TRANSCRIPT
![Page 1: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/1.jpg)
1
U S E R R E S E A R C H : T H E C H A L L E N G E S O F D E S I G N I N G F O R P E O P L E
D A L I A E L - S H I MY U X R E S E A R C H L E A D , S H O P I F Y
![Page 2: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/2.jpg)
2
U S E R - C E N T E R E D D E S I G N
![Page 3: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/3.jpg)
3
![Page 4: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/4.jpg)
4
U S E R R E S E A R C H I S A C R I T I C A L C O M P O N E N T O F U S E R - C E N T E R E D D E S I G N
![Page 5: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/5.jpg)
5
A brief historical overview of user research…and, also, of where UX comes from
Before 1950s 1950s-1960s 1960s-1970s 1980s-2000s
System performance
phase
System reliability
phase
Usability phase
User performance
phase
How long would it function without
failure?
How fast can it perform?
How fast can the user perform?
How easy is it to use?
![Page 6: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/6.jpg)
6
Evaluating usabilityGive your target users a series of repeatable tasks, then measure:
Time to complete
Task completion rate
Accuracy
Error rate
Satisfaction
![Page 7: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/7.jpg)
7
“ W H AT O F T E C H N O L O G Y N O T F O R A C C O M P L I S H I N G TA S K S B U T F O R H AV I N G E X P E R I E N C E S , F O R
E X P R E S S I N G O N E ’ S I D E N T I T Y, F O R F L I R T I N G A N D A R G U I N G A N D L I V I N G ? ”
[ K AY E E T A L . , 2 0 0 7 ]
![Page 8: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/8.jpg)
8
F R O M T O TA S K - B A S E D T O E X P E R I E N C E - B A S E D D E S I G N
![Page 9: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/9.jpg)
9
F R O M U S E R - C E N T E R E D T O P E O P L E - C E N T E R E D D E S I G N
![Page 10: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/10.jpg)
10
T H I R D - WAV E H C I
![Page 11: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/11.jpg)
11
A brief historical overview of user research(and, also, of where UX comes from)
Before 1950s 1950s-1960s 1960s-1970s 1980s-2000s
System performance
phase
System reliability
phase
Usability phase
User performance
phase
User experience
phase
How long would it function without
failure?
How fast can it perform?
How fast can the user perform?
How easy is it to use?
2000s-Present
![Page 12: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/12.jpg)
12
User experience phase
• Personal, social, cloud, mobile computing
• Contexts are broader
• Technology is more pervasive
• Shift from the utilitarian/pragmatic to the emotional/affective
![Page 13: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/13.jpg)
13
User experience evaluation
• User testing methods: Usability testing with think aloud, post-test questionnaires
• Inspection methods: Heuristic evaluation, cognitive walkthrough
• Traditional research methods: Surveys, interviews
• Field methods: Observations, diaries, A/B Testing
![Page 14: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/14.jpg)
14
W E ’ R E R E A L LY G O O D AT E VA L U AT I N G TA S K S … B U T L E S S S O E X P E R I E N C E S .
![Page 15: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/15.jpg)
15
What are some examples of interfaces where evaluating tasks might be more important? What about ones where evaluating experiences might be more important?
Q U E S T I O N 1 :
![Page 16: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/16.jpg)
16
“ E VA L U AT I O N H A S B E E N A D O M I N A N T T H E M E I N H C I F O R D E C A D E S ,
B U T I T I S FA R F R O M B E I N G A S O LV E D P R O B L E M .”
[ M A C D O N A L D A N D AT W O O D , 2 0 1 3 ]
![Page 17: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/17.jpg)
17
S O W H Y D O I C A R E A B O U T T H I S P R O B L E M ?
![Page 18: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/18.jpg)
![Page 19: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/19.jpg)
![Page 20: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/20.jpg)
![Page 21: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/21.jpg)
21
M U S I C T E C H N O L O G Y… ?
![Page 22: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/22.jpg)
![Page 23: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/23.jpg)
23
S O W H Y W E R E N ’ T T H E S E I N S T R U M E N T S E V E R Y W H E R E ?
![Page 24: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/24.jpg)
MappingInput Output
![Page 25: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/25.jpg)
![Page 26: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/26.jpg)
?Input Output
![Page 27: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/27.jpg)
![Page 28: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/28.jpg)
28
M U S I C - O R I E N T E D H C I
![Page 29: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/29.jpg)
29
H O W C O U L D M U S I C T E C H N O L O G Y B E N E F I T F R O M U S E R - C E N T E R E D D E S I G N ?
![Page 30: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/30.jpg)
Distributed musical performance
![Page 31: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/31.jpg)
![Page 32: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/32.jpg)
32
Design goals
• Capitalize on computing technology inherent to the distributed context
• Increase the level of interaction between the distributed musicians
• Apply a user-centered methodology throughout the process
![Page 33: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/33.jpg)
33
Key principles of usability
Early focus on users and tasks
Empirical measurement Iterative design
User observations: • 15 musicians over several months • Focused on their interactions • Uncovered the what and how
![Page 34: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/34.jpg)
34
Key principles of usability
Early focus on users and tasks
Empirical measurement Iterative design
User interviews: • Non-leading interviews • Based on loose prompts • Uncovered the why
Creativity, enjoyment, self-expression, interaction
![Page 35: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/35.jpg)
35
Key principles of usability
Early focus on users and tasks
Empirical measurement Iterative design
• Iterative prototypes • One-feature at a time • Usability tests
![Page 36: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/36.jpg)
36
U S A B I L I T Y… F O R M U S I C ?
![Page 37: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/37.jpg)
37
Key principles of usability
Early focus on users and tasks
Empirical measurement Iterative design
• Iterative prototypes • One-feature at a time • Usability tests
![Page 38: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/38.jpg)
38
Task-based evaluationTime to complete
Task completion rate
Accuracy
Error rate
Satisfaction
![Page 39: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/39.jpg)
39
“ I T I S N O T O N LY U N D E S I R A B L E B U T I M P O S S I B L E T O D E F I N E
T H E M U S I C I A N ’ S TA S K .” [ C A R I O U , 1 9 9 2 ]
![Page 40: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/40.jpg)
40
Limitations
Feedback is narrow
Difficult to test small, iterative changes
Difficult to isolate novelty factor
Difficult to determine long-term impressions
![Page 41: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/41.jpg)
41
How things actually turned out…
Early focus on users and tasks
Empirical measurement Iterative design
Weekly sessions with a band: • Preliminary discussion • Formal A/B/A test • Post-condition questionnaire • Post-test discussion • Recommendations
Long-term deployment
![Page 42: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/42.jpg)
42
How things actually turned out…
Early focus on users and tasks
Empirical measurement Iterative design Long-term
deploymentParticipatory
design
Artist residency • Lasted several months • Composer wrote several pieces • Actively involve all stakeholders • Collaboration becomes two-sided
![Page 43: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/43.jpg)
![Page 44: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/44.jpg)
44
User-centered design isn’t always clear cut
There is no neat, linear, “one-size fits all” solution
It’s not about following a process to the letter
It’s about understanding the process well enough to be able to adapt it to different contexts
For each context: determine what to evaluate and how to evaluate it
![Page 45: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/45.jpg)
45
F R O M A C A D E M I A T O I N D U S T R Y…
![Page 46: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/46.jpg)
46
![Page 47: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/47.jpg)
47
![Page 48: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/48.jpg)
48
The role of UX researchUnderstand behaviours/needs/expectations around the product
Make recommendations accordingly
See those recommendations through
Ask questions, find answers, share knowledge
Encourage empathy across all disciplines
It’s all about making sense of information to help people make decisions
![Page 49: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/49.jpg)
49
The role of UX researchResearch and Development
Engineering User experience
Design Front-end developmentContent strategy Research
DataDevelopment
Product
![Page 50: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/50.jpg)
50
H O W D O U X R E S E A R C H E R S W O R K W I T H D ATA S C I E N T I S T S ?
![Page 51: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/51.jpg)
51
L E T ’ S TA L K A B O U T Q U A L I TAT I V E R E S E A R C H
![Page 52: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/52.jpg)
52
![Page 53: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/53.jpg)
53
![Page 54: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/54.jpg)
![Page 55: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/55.jpg)
55
![Page 56: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/56.jpg)
![Page 57: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/57.jpg)
![Page 58: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/58.jpg)
58
L E T ’ S TA L K A B O U T Q U A N T I TAT I V E R E S E A R C H
![Page 59: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/59.jpg)
59
![Page 60: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/60.jpg)
60
![Page 61: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/61.jpg)
61
![Page 62: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/62.jpg)
62
![Page 63: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/63.jpg)
63
![Page 64: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/64.jpg)
64
S O H O W D O W E C H O O S E T H E R I G H T T E C H N I Q U E ?
![Page 65: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/65.jpg)
Findings
65
MethodQuestionPhase
![Page 66: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/66.jpg)
66
When do quantitative data and qualitative UX research best complement each other?
a) During the early stages of a project b) During the later stages of project c) Both
Q U E S T I O N 2 :
![Page 67: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/67.jpg)
67
Getting shit done
![Page 68: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/68.jpg)
68
![Page 69: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/69.jpg)
69
Questions: • What potential problems might we solve? • How might we gather context on the problem?
Getting shit done
Qualitative • Existing research • Observations, interviews, diaries, internal workshops Quantitative • Existing data • Establishing facts, confirming/disproving assumptions
![Page 70: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/70.jpg)
70
Questions: • What are the root problems? • What are the biggest challenges we might focus on?
Getting shit done
Qualitative: • Profiles/segments/personas • Interviews, co-design/participatory workshops Quantitative: • Quantify how big are the segments that would benefit from this product
![Page 71: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/71.jpg)
71
Questions: • How might we be scrappy and effective
when testing assumptions and hypotheses?
Getting shit done
Qualitative: • Lo-fi prototype testing • Clickable mockups Quantitative: • Define success metrics and baseline for
those project success metrics
![Page 72: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/72.jpg)
72
Questions: • Can people use what we’re building? • Is what we’re building addressing the initial
problems and goals?
Getting shit done
Qualitative: • High-fidelity usability tests • Diary studies Quantitative: • A/B tests, • Instrumentation and reports setup • Beta testing
![Page 73: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/73.jpg)
73
Questions: • Are people using it in the way we thought they would? • Did we successfully solve the problem we identified?
Getting shit done
Qualitative: • Forums/social media monitoring • Open-form feedback forms Quantitative: • Monitor success metrics • Populate reports
![Page 74: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/74.jpg)
74
Questions: • What incremental improvements might be worthwhile? • What revisions should we make to our roadmap?
Getting shit done
Qualitative: • Retrospectives • Post-mortem • Analysis of support tickets Quantitative: • More A/B tests and experiments • Monitor reports
![Page 75: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/75.jpg)
75
How might you map the various stages of Shopify’s GSD process to your own course project?
Q U E S T I O N 3 :
Idea Think Explore Build Launch Tweak
![Page 76: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/76.jpg)
76
Phase Question Qualitative Quantitative
IdeaWhat potential problems might
we solve? Existing research, observations,
diariesEstablishing facts,
confirming assumptions
Think What are the root problems?Interviews, co-design/
participatory workshopsQuantify segments
ExploreHow might we test
assumptions and hypotheses?
Lo-fi prototype/mockup testingDefine success metrics,
measure baselines
BuildCan people use what
we’re building? High-fidelity usability tests,
diary studies, beta tests A/B testing,
instrumentation, reporting
LaunchAre people using it in the way
we thought they would? Forums/social media
monitoringMonitor success metrics,
more reporting
TweakWhat improvements might be
worthwhile? Analysis of support tickets,
retrospectiveMore A/B tests, more
reporting
![Page 77: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/77.jpg)
77
W E A C T U A L LY C A L L T H I S M I X E D M E T H O D S R E S E A R C H .
![Page 78: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/78.jpg)
78
Mixed methods research
“An approach to research in the social, behavioural, and health sciences in which the investigator gathers both quantitative (close-ended) and qualitative (open-ended) data, integrates the two, and then draws interpretations based on the combined strengths of both sets of data to understand research problems.”
[Creswell, 2015]
![Page 79: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/79.jpg)
79
Provides detailed perspectives Captures the voices of the participants
Captures complex phenomena Is based on the views of the participants,
not the researcher Appeals to people’s enjoyment of stories
Adapts to context
Draws conclusions for large numbers of people
Is relatively efficient when it comes to data collection and analysis
Investigates relationships within data Appeals to people’s preference for
numbers
Has limited generalizability Studies few people
Is subject to the researcher’s biases Is time-intensive when it comes to data
collection and analysis
Is impersonal Does not record the words of the
participants Provides limited understanding of the
context of participants Is largely researcher driven
Strengths Weaknesses
Qua
litat
ive
Qua
ntita
tive
![Page 80: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/80.jpg)
80
S O … W H AT D O E S E C O M M E R C E H AV E T O D O W I T H M U S I C ?
![Page 81: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/81.jpg)
81
![Page 82: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/82.jpg)
82
The same rules apply…
There is no neat, linear, “one-size fits all” solution
It’s not about following a process to the letter
It’s about understanding the process well enough to be able to adapt it to different contexts
For each context: determine what to evaluate and how to evaluate it
![Page 84: DALIA EL-SHIMY UX RESEARCH LEAD, SHOPIFYjer/courses/hci/lectures/el-shimy2017.pdf · • Technology is more pervasive • Shift from the utilitarian/pragmatic to the emotional/affective](https://reader034.vdocuments.site/reader034/viewer/2022042220/5ec61fa6cf1ca866e41566e5/html5/thumbnails/84.jpg)
84
Interested in an internship at Shopify?• Keep an eye out on shopify.com/interns
• We hire for our four Canadian offices: Montreal, Toronto, Ottawa, and Waterloo
• Posts for summer internships will go out in January
• “Developer intern” is for any RnD development disciplines: data engineering, data analytics, infrastructure, front-end development, backend development, security, and mobile
• UX roles are posted separately