application of eye tracking technology as a self-evaluation tool in the training program of future...

PowerPoint Presentation - Slide 1

Application of Eye Tracking Technologyas aSelf-Evaluation Toolin theTraining Program of Future Online TutorsDr. techn. Gergely Rakoczi

Teaching Support CenterVienna University of Technology

[email protected]

OverviewIntroduction goals, purpose

The Study setting, technology, students

Results conclusions, pros and cons,

http://static2.thrivesmart.com/uploaded_images/business_images/0003/4105/Eyes_slide_show.jpg

June 28th 2016Gergely Rakoczi @ EdMedia 2016

1. Introduction goals, purpose


Online TutorsCurrently:

Increasing need for using interactive communication tools

Everyday tutoring tasks affected

Many forms of communication and moderation processes involved

https://getonlinetutor.files.wordpress.com/2011/03/tutor-1.jpg not just e-mail! Chats, forums, Skype and web conference sessions, moderators in live events, blogging, social media management !


4

Training ProgramsTraining Programs (should) includeSoft skill trainingCompetency-based tasksDifferent qualification profilesImmersive training methods

Existing programs are good!https://www.google.at/search?q=training+program&site=imghp&source=lnms&tbm=isch&sa=X&ved=0ahUKEwjruOWS0bbNAhUCWiwKHbrlDAAQ_AUICCgB&biw=1920&bih=1063Our Focus: How is feedback given ?Trainers observation (might be subjective and limited)boring text documents(group) discussions(few provide) screen recordings


5

Our goal Sometimes provided feedback is not individual, boring, not quantitative

So, as a technical University:Enrich training by technology Enable to re-live the tutoring experienceProvide quantitative data for comparisonUse a new, cool and interesting method for self-evaluation

with Eye Tracking Technology!


6

Looking for related work Hardly any related work most similar work by (Yalcinalp et al, 2013) Eye tracked students using web-conferencing in distance education Focus on visual distribution and usability improvements

Yalcinalp S., Turkoglu, H. & Ersoy, H. (2013). A Case Study: Task Analysis for Using a Video Conferencing System of Graduate Students Through Eye Tracking Methodology. In Proceedings of IAC-ETeL 2013: International Academic Conference on Education, Teaching and E-learning (pp.411-419). Prague: MAC Prague consulting Ltd.

http://www.burrard-lucas.com/image/botswana/normal/meerkat_family.jpg


7

2. The Study setting, technology, students


Extending our TrainingTraining program based on earlier concept of the author:Application of a mixture of moderations tools:forum, chat, mail, web-conferenceStep-by-step from asynchronous to synchronous toolsStep-by-step from guided to open scenariosIn-between reflections with essays and group discussions

+ Recording gaze data!


9

The StudyGoal: Record the students eye-movements during moderating a web-conference session

Eye tracker:Tobii X50, no chin rest2 infrared camerascoronal reflectionResolution:1280x1024, 20 inch TFTConference tool:Adobe Connect


10

Analysis & Artifacts

Fixed layout6 voluntary moderators were eye tracked (N=6)Defined roles to ensure authentic tutoring scenario


11

After the Eye Tracking


Collected gaze data is provided in different ways, first Share experiences relax and remove the tension

12

After the Eye Tracking


After that additional feedback is given in different forms within the learning environmentRetrospective analysis13

3. Results conclusions, pros and cons,


Video Example


4 different scenario for tutoring scenarioPresentationListen to other presentation and facilitate questions if requiredConducting pollsModerating debated via chat and audio15

Exemplary Results

Chat is number 1

Followed by the participants pod management of users

also important at the beginning video podDistribution over groups very similar

Presentation more followed by moderator of group 3

21.Feb 2013Gergely Rakoczi @ MoodleMoot Austria 2013

Pros [+]Novelty effect: gaze data raisedcuriosity and(initial) motivation for participation

Heatmaps showednot only Hot areas (chat, user management pod)But also neglected areas (notes, presentation)

Gaze data: Good additional informationEnriched review and great basis for generating discussions !!!Comparison to othersEye tracking (basically) applicable in training of online tutorsNew way to learn about myself !Wow, I was totally obsessed with the chat and have missed to follow the other pods.


Cons [-]

Considerable overhead for setup / testing

Moderator reported feeling more stiff and tense

Low activity in forum debates about gaze data results more moderation from teacher required

Small sample size (N=6), not suitable for more or larger groupsConclusion:

Good experience, will continue for small groups, but not if number of course participants increase


Questions?Thank you for your attention!

http://www.monkeygag.com/wp-content/uploads/2013/04/484533_276257415808526_1047165374_n.jpg


19