workshop 1 - user experience evaluation

Sónia Sousa & Mati Mottus, TLU, 2014

User eXperience

Workshop 1


General aim…

• Develop one's own conceptual understanding of –how to apply • the methods; • the tools; and •Metrics

–based on a defined criteria.


Workshop 1

• It aims is to – evaluate how real users experience from• using online media players (web service)

• It include 2 main procedures– One uses• Think-out-loud protocol; and • Task Completion Rates

– Another uses • Exploration test

– Heuristic Evaluation


Workshop 1

• Measuring the user experience– Effectiveness and efficiency and user behaviors

• From two perspective• User perspective (pragmatic aspects)

– Perceiving information– Interpreting information– Decision making

• Designer perspective (pragmatic aspects)– Providing information– Storing information– Information architecture


UX workshop 1

• How to?– Identify the target audience– Creating Usability Test Tasks• set of 5 to 10 tasks within a 90-minute session

– Do the test• Read to the participant one task at a time, and give

time to complete the task

– Do the exploration test– Data Analysis


Category of UX methods

• Study types– Field studies – Lab studies – Online studies – Questionnaires / Scales

• Studied period of experience– Before usage– Snapshots– An episode (of a task or

activity) – Long-term UX

• Development phase– Concepts– Early prototypes– Functional prototypes– Products on market

• Evaluator / Information provider– UX experts – One user at a time – Groups of users – Pairs of users


What you need to do

• First – Read the material available in drop box– Start with script-procedure• And try to follow the procedure

• Tools to be use– (get familiar with them)• Scripts forms• Evaluation and observation sheets• Recording tools (QuickTime player)


Exploration test

• Designer perspective– Using Heuristic Evaluation

• What is it – is an evaluation of an interface performed by one or

more HCI experts• What you need to do– Executer same tasks procedure asked to users

• File (task-scrips-for-user.pdf)

– Fill the file about heuristic evaluation analysis• File (Heuristic_Evaluation.pdf)


Things to know

• About the procedure– A moderator shows a design to gain perceptions of

people. – The user is encouraged to freely explore the

design; and– The moderator asks questions when something

interesting happens.– A moderator provides a user with tasks to perform

during testing that reflect their different usage patterns.


Things to know

• About the procedure– Users should not be directed in any specific way. – Exploration test are conducted as one session.– Participants will perform a set of 5 to 10 tasks

within a 90-minute session. – Tasks should represent the most common user

goals– It is crucial to establish very clear success criteria

for each task.


Data analysis

• Success Rate: Task completion success– We define success rate by the percentage of

progress users made in completion the task– measure the percentage of tasks that users

complete correctly• See http://www.measuringusability.com/• Look for the most suitable calculator

http://www.measuringusability.com/

workshop 1 - user experience evaluation

Education