euro-cat ergonomic evaluation

Prototype users/experts evaluation

Dr. Niki Lambropoulos & Prof. Fintan Culwin

Department of Informatics, London South Bank University

2

Agenda

HCI-Ed, the LSBU’s Role in Euro-CAT

Ergonomic EvaluationHCI-Ed 7 steps Prototype evaluation (Step 3)

3

HCI-Ed in 7 Steps1.Context & Learning Values -

Hypothesis2. (Iterative) Design – Requirements 3. Evaluation with user groups/experts4. Development5. Evaluation with user groups6. Re-Design & Development7. Study & Research - Tool Release

1CH 2DR 3E 4D 5E 6D 7RTR

4

Research Problem

Distributed learning teams in team-based learning situations aim to achieve organisational convergence.

However, there are collaboration problems due to mediated distance & time flexibility.

5

Key CSCeL concept: Collaboration AwarenessStudents’ difficultiesGroup AwarenessTime convergence

Learners’ Intentions (learning goals): Task Convergence

Users’ operations (actions/tasks): Pedagogical Usability

Step1a: Context & Learning Values

1CH 2DR 3E 4D 5E 6D 7RTR

6

Being HumanCollaboration Awareness

Students’ difficulties: In addition to f2f Collaborative Learning difficulties, CSCeL situation adds Computer Mediated Communication (CMC) and ILE difficulties (Kirschner,

2009)

Group Awareness: understanding of the activities of others, which provides context for your own activity (Dourish & Bellotti, 1992)

Time convergence: Distributed learning teams are characterised by the degree of time flexibility and computer mediation (Romero, 2010)

7

3C Model: Communication, Coordination & knowledge

Convergence (Ellis et al, 1991)

How?

1CH 2DR 3E 4D 5E 6D 7RTR

8

If group awareness is a prerequisite for convergence then increase of group awareness will result in increase of organisational convergence and thus, collaboration awareness.

Step1b: Hypothesis

1CH 2DR 3E 4D 5E 6D 7RTR

9

Euro-CAT…Collaboration Awareness Tool Task-independentSupports 3C via

Mirroring capabilitiesAwareness cues

Does not replace other 3C tools

1CH 2DR 3E 4D 5E 6D 7RTR

Step2: (Iterative) Design - Requirements

10

Step2: (Iterative) Design - Requirements

1CH 2DR 3E 4D 5E 6D 7RTR

The design can be defined as an individual and collective activity, finalized by a project to develop a physical and symbolic artefact. The artefact is rarely well defined in this step.

11

Key Concepts for Design

1CH 2DR 3E 4D 5E 6D 7RTR

Group ProgressUsers

Scheduling

Trail tracking

Now

Awareness Cues

12

Euro-CAT Screenshot

1CH 2DR 3E 4D 5E 6D 7RTR

13

Step3: User/Expert Evaluation @ this workshop

1CH 2DR 3E 4D 5E 6D 7RTR

Euro-CAT Ergonomic Evaluation Pedagogical Utility/Usability/Accessibility

Questionnaire & System Usability Scale (SUS)

Cognitive WalkthroughThink aloud protocol

14

Task Description: Setting1. Define your week days and week-end days

(click all days). 2. Click Save 3. Click Next

15

Task Description: Week days1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next

16

Task Description: Week-end1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next

17

Task Description: Week days1. Schedule your working hours2. Schedule your learning hours3. Click Save4. Click Next

18

Task Description: Timeline1. Click on your timeline to make changes2. Click to add/change messages3. Click to add/change tasks

19

Euro-CAT Ergonomics starts!

URL:

http://www.survey.bris.ac.uk/lsbu/euro-cat

20

Thank you!

Questions?

Dr. Niki Lambropoulos

lampron2@lsbu.ac.uk

Prof. Fintan Culwin

fintan@lsbu.ac.uk