WP4

The Pilot Evaluation Package in EMMA

WP4

OBJECTIVES & METHOD

• Delivering data to MOOC providers to enable them to get the most from their MOOC(s), via

– Tracking

– Learning Analytics

– Survey

WP4

WP4 - Pilot evaluation

GENDER, AGE, NATIONALITY, PROFESSION, EDUCATIONAL BACKGROUND

LearningAnalytics

(TLU)

Recording and treatment of objective data on

usage: PASSIVE measurement

DataTracking

(CSP)

Collection of Participants

OPINIONS (IPSOS)

Participants Profiling

(IPSOS)

Registration Questionnaire EXPECTATIONS

EVALUATIONS

COURSE FEEDBACK

questionnaire

EMMA PLATFORM FEATURES

QUESTIONNAIRE

WP4

LA in General

The measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.

1st international conference on LA

WP4

Methodology

Focus• a) real-time analytics through learning analytics dashboards for instructors and

students; • b) retrospective analysis of the digital traces in EMMA platform.Aims• Mainly aims at providing personalized feedback to teachers and individual learners• And is designed

– To support personalization– And personalized learning paths

• Learning analytics enables monitoring of learning process and controlling achievements

• Provided feedback and raised awareness of the learning experience enhances the development of “learning how to learn” competence

• More: Tammets & Brouns “Learning Analytics Approach in EMMA project”• Tammets et al D4. 1 Learning analytics: theoretical background, methodology and expected results

WP4

Tracked functions

WP4

Tracking System diagram (v1)

WP4

WP4 - Pilot evaluation

GENDER, AGE, NATIONALITY, PROFESSION, EDUCATIONAL BACKGROUND

LearningAnalytics

(TLU)

Recording and treatment of objective data on

usage: PASSIVE measurement

DataTracking

(CSP)

Collection of Participants

OPINIONS (IPSOS)

Participants Profiling

(IPSOS)

Registration Questionnaire EXPECTATIONS

EVALUATIONS

COURSE FEEDBACK

questionnaire

EMMA PLATFORM FEATURES

QUESTIONNAIRE

WP4

USERS PROFILING

9

WP4

Was this in context of your formal education? Have you had any previous experience with e-learning?

What is your overall level of satisfaction with e-learning so far?

90% 10%

Very satisfied = 29%

38% OF THE RESPONDENTS HAD ENROLLED IN A MOOC BEFORE

1 21%

2 14%3 21%

4 4%5 8%

6+ 20%

E- LEARNING EXPERIENCE

WP4

EXPECTATIONS

11

WP4

What we would like you to do today

• Focus on

– your MOOC’s learning objective

– what you would like to know as your course progresses – real time

– what you would like to know after the course is finished – retrospectively

• Work in couples/small groups

WP4

RULES

don’t be shy

be creative

think disruptive

NO RULES!

WP4

What we would like you to do today

• Task 1 - Tracking / Learning Analytics (10’)

– You are a fly on the wall, observing a student taking a MOOC: what catches your attention? List actions / interactions which are meaningful to you as a teacher, will give you insights into

• PRESENTATION

WP4

What we would like you to do today

• Task 2 – SURVEY (10’)

– LEARNERS PROFILE – habits – skills …

– LEARNERS EXPECTATION – attitudes – motives …

– COURSE IMPACT – what went well and what went wrong

• PRESENTATION

WP4

15-047852