incos2010 irene

19
http:// hci.ece.upatras.gr Study of the effect of awareness on synchronous collaborative problem-solving Chounta Irene-Angelica, Avouris Nicolaos HCI Group Dept. of Electrical and Computer Engineering University of Patras

Upload: irene-angelica-chounta

Post on 27-Jun-2015

235 views

Category:

Education


2 download

DESCRIPTION

"study of the effect of awareness on synchronous collaborative problem solving", INCOS 2010

TRANSCRIPT

Page 1: Incos2010 irene

http://hci.ece.upatras.gr/

Study of the effect of awareness on synchronous collaborative

problem-solving

Chounta Irene-Angelica, Avouris NicolaosHCI Group

Dept. of Electrical and Computer EngineeringUniversity of Patras

Page 2: Incos2010 irene

http://hci.ece.upatras.gr/

Presentation’s Structure

• Objective of the study• Description of the study setup and the cases

examined• Awareness and attention shifting phenomena

in sessions – Examples from collaborative sessions

• Discussion on findings• Further Research

Page 3: Incos2010 irene

http://hci.ece.upatras.gr/

Objectives• Study of awareness and attention shifting

phenomena during collaboration• Study of the interplay between task,

attention and dynamics of collaboration• Use of eye-movements for groupware

evaluation and assessment of the quality of collaboration

Page 4: Incos2010 irene

http://hci.ece.upatras.gr/

Study Setup• Qualitative Study• Six participants forming 3 dyads to

represent distinctive cases• One student of each dyad monitored by

eye-tracker• Participants in dyads worked together in

order to perform a collaborative problem-solving task

Page 5: Incos2010 irene

http://hci.ece.upatras.gr/

Formation of Dyads3 dyads that represent distinctive cases• Case A: Users of similar knowledge background• Case B: An inexperienced user collaborating

with an expert in the field• Case C: Collaboration of disparate skills users

Dyads User monitored by eye-tracker

Collaborative Partner

Case A User A User A’

Case B User B, inexperienced User B’, expert

Case C User C, expert User C’, inexperienced

Page 6: Incos2010 irene

http://hci.ece.upatras.gr/

Collaboration Scheme

• Synchronous Collaboration via groupware application Synergo

• Duration of collaborative sessions: 20’ minutes

• Collaborative Task: Website Evaluation using the Cognitive Walkthrough method

Page 7: Incos2010 irene

http://hci.ece.upatras.gr/

Problem-Solving Task in Synergo• Joint development of state diagram depicting

the task execution

Common workspace

Drawing tools

Chat tool

Requested State Diagram

Page 8: Incos2010 irene

http://hci.ece.upatras.gr/

Actions under studyWe study actions that provoke visual changes on the shared resources:

•Resize Object•Modify Text•Delete Object

•Chat message•Insert object•Move object•Paste Object

Estimate the response time to visual changes: response time=|(time an action took place- time the collaborating partner realized the action)|

Page 9: Incos2010 irene

http://hci.ece.upatras.gr/

Analysis of Activity-Case A•Users of similar knowledge background•Smooth collaboration and results of good quality•Equally active on the workspace and chat•Time was spent equally on browsing the website and building the state diagram•Users divided the task and worked separately most of the time.

User A

avg_res_workspace 00:01:00

avg_res_chat 00:01:01

avg_res_total 00:01:00

Actor User A User A'

Actions 28 (54%) 23 (46%)

Messages 19 (41%) 27 (59%)

•Attention shiftings occurred when workload was low•Delays and Awareness failures occurred as activity unfolded

Page 10: Incos2010 irene

http://hci.ece.upatras.gr/

Analysis of Activity-Case A - Example

User A’ asks for helpUser A’ asks for help again

User A’ asks for help for the third time

User A composes a reply but forgets to send it

User A remembers to send message

Page 11: Incos2010 irene

http://hci.ece.upatras.gr/

•Users of not similar experience and knowledge•Poor session in terms of collaboration quality•Both used the chat tool equally while the experienced user (User B’) took over the workspace activity•Intense chat activity

Analysis of Activity-Case B•The inexperienced user (User B) monitored all activity •Finally User B lost interest and focused on the chat

Actor User B User B'

Actions 17 (26%) 46 (74%)

Messages 35 (53%) 30 (47%)

User B

avg_res_workspace 00:00:53

avg_res_chat 00:00:10

avg_res_total 00:00:36

Page 12: Incos2010 irene

http://hci.ece.upatras.gr/

Analysis of Activity-Case B - Example

User B’ inserts object

User B’ inserts object again

User B inserts object

User B deletes his object

User B deletes partner’s object

User B deletes partner’s object for the second time

Page 13: Incos2010 irene

http://hci.ece.upatras.gr/

Analysis of Activity-Case C•Users of disparate skills•Poor session in terms of collaboration quality but provided satisfactory solution•The experienced user (User C) took over chat and workspace activity•Help was not provided to inexperienced user (User C’) when needed•User C’ had no feedback from User C

User C

avg_res_workspace 00:00:20

avg_res_chat 00:00:39

avg_res_total 00:00:27

Actor User C User C'

Actions 31 (71%) 13 (29%)

Messages 22 (62%) 14 (38%)

•Though User C was able to see in short time the messages of his partner, he did not reply•Gradually communication was diminished and collaboration failed

Page 14: Incos2010 irene

http://hci.ece.upatras.gr/

Discussion(1)We study three distinctive cases of collaboration activity:• Dyad of same background and motivation• Dyad of different expertise but motivated

towards collaboration• Dyad with disparate skills and not motivatedThe eye gaze patterns of users during collaboration have been recorded and analyzed

Page 15: Incos2010 irene

http://hci.ece.upatras.gr/

Discussion(2)• Users immersed into an activity (high

cognitive workload) remain unaware of their collaborators’ actions

• Users with high cognitive workload tend to ignore partner’s actions that are not directly related to their goal

• Users with low activity tend to be more responsive to incoming events/visual changes

Page 16: Incos2010 irene

http://hci.ece.upatras.gr/

Use of eye gaze to assess quality of collaboration

Statistics alone can mislead us to false conclusions concerning quality of collaboration, i.e.:

The use of eye gaze patterns can help identification of such ambiguous cases

User with small number of actions

User who does not quickly reply to messages

Unwilling to collaborate ?

Unaware of incoming message

Not motivated ? Facing

trouble

Page 17: Incos2010 irene

http://hci.ece.upatras.gr/

Eye gaze for awareness mechanisms design

Eye gaze patterns and eye behavior can be proven useful for awareness mechanisms design and evaluation•Awareness mechanisms should attract the attention but also vary according to task’s nature•Awareness support should adapt to the workload of users. •Awareness Regarding Content•Additional mechanisms that will provide help or guidance can be combined with awareness support

Page 18: Incos2010 irene

http://hci.ece.upatras.gr/

Future Research• design and implement adaptive awareness

mechanisms• integrate them in collaborative applications• and conduct studies to determine how the

characteristics of the awareness mechanisms affect the collaborative activity.

• Use the results and methods in the implementation of a groupware evaluation tool

Page 19: Incos2010 irene

http://hci.ece.upatras.gr/

Questions are welcome

Thank you