euro-cat ergonomic evaluation
DESCRIPTION
Euro-CAT Ergonomic Evaluation Niki Lambropoulos and Fintan Culwin presented at the Euro-CAT workshop in Barcelona 05/02/2010TRANSCRIPT
Prototype users/experts evaluation
Dr. Niki Lambropoulos & Prof. Fintan Culwin
Department of Informatics, London South Bank University
2
Agenda
HCI-Ed, the LSBU’s Role in Euro-CAT
Ergonomic EvaluationHCI-Ed 7 steps Prototype evaluation (Step 3)
3
HCI-Ed in 7 Steps1.Context & Learning Values -
Hypothesis2. (Iterative) Design – Requirements 3. Evaluation with user groups/experts4. Development5. Evaluation with user groups6. Re-Design & Development7. Study & Research - Tool Release
1CH 2DR 3E 4D 5E 6D 7RTR
4
Research Problem
Distributed learning teams in team-based learning situations aim to achieve organisational convergence.
However, there are collaboration problems due to mediated distance & time flexibility.
5
Key CSCeL concept: Collaboration AwarenessStudents’ difficultiesGroup AwarenessTime convergence
Learners’ Intentions (learning goals): Task Convergence
Users’ operations (actions/tasks): Pedagogical Usability
Step1a: Context & Learning Values
1CH 2DR 3E 4D 5E 6D 7RTR
6
Being HumanCollaboration Awareness
Students’ difficulties: In addition to f2f Collaborative Learning difficulties, CSCeL situation adds Computer Mediated Communication (CMC) and ILE difficulties (Kirschner,
2009)
Group Awareness: understanding of the activities of others, which provides context for your own activity (Dourish & Bellotti, 1992)
Time convergence: Distributed learning teams are characterised by the degree of time flexibility and computer mediation (Romero, 2010)
7
3C Model: Communication, Coordination & knowledge
Convergence (Ellis et al, 1991)
How?
1CH 2DR 3E 4D 5E 6D 7RTR
8
If group awareness is a prerequisite for convergence then increase of group awareness will result in increase of organisational convergence and thus, collaboration awareness.
Step1b: Hypothesis
1CH 2DR 3E 4D 5E 6D 7RTR
9
Euro-CAT…Collaboration Awareness Tool Task-independentSupports 3C via
Mirroring capabilitiesAwareness cues
Does not replace other 3C tools
1CH 2DR 3E 4D 5E 6D 7RTR
Step2: (Iterative) Design - Requirements
10
Step2: (Iterative) Design - Requirements
1CH 2DR 3E 4D 5E 6D 7RTR
The design can be defined as an individual and collective activity, finalized by a project to develop a physical and symbolic artefact. The artefact is rarely well defined in this step.
11
Key Concepts for Design
1CH 2DR 3E 4D 5E 6D 7RTR
Group ProgressUsers
Scheduling
Trail tracking
Now
Awareness Cues
12
Euro-CAT Screenshot
1CH 2DR 3E 4D 5E 6D 7RTR
13
Step3: User/Expert Evaluation @ this workshop
1CH 2DR 3E 4D 5E 6D 7RTR
Euro-CAT Ergonomic Evaluation Pedagogical Utility/Usability/Accessibility
Questionnaire & System Usability Scale (SUS)
Cognitive WalkthroughThink aloud protocol
14
Task Description: Setting1. Define your week days and week-end days
(click all days). 2. Click Save 3. Click Next
15
Task Description: Week days1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next
16
Task Description: Week-end1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next
17
Task Description: Week days1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next
18
Task Description: Timeline1. Click on your timeline to make changes2. Click to add/change messages3. Click to add/change tasks
19
Euro-CAT Ergonomics starts!
URL:
http://www.survey.bris.ac.uk/lsbu/euro-cat
20
Thank you!
Questions?
Dr. Niki Lambropoulos
Prof. Fintan Culwin