mirror reflective-learning-at-work-presentation-sept2012
DESCRIPTION
Status MIRROR project at the end of 2nd project year. MIRROR EU Project Reflective learning at work (www.mirror-project.eu) LinkedIn group: Mirror reflective learning at work: http://www.linkedin.com/groups?home=&gid=3357670TRANSCRIPT
MIRROR Reflective Learning at Work
Project lifetime: 2010-2014 Status and progress (Sept 2012)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 0
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 1
MIRROR Partners
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 2
Agenda
▪ Overall MIRROR Vision & Approach
▪ MIRROR apps
▪ Design-based Research
▪ Year 2 Achievements
▪ Outlook into Year 3
▪ Dissemination and exploitation
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 3
Challenge: Training-on-the-job does not Scale Is THE training method employed by most SMEs
Often there is no teacher, no HR manager, no author, no learning content, ...
Individuals learn by observing others, by getting feedback from others, by reflecting on own experiences and by (informally) sharing experiences
Goal: Enrich other TEL Approaches with Computational Support for Reflective Learning (CSRL) Reflective learning allows to derive knowledge which is not explicitly
documented
Support reflective learning in distributed/virtual environments
Systematically support reflective learning in increasingly accelerated work conditions
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 4
It’s Personal
You learn for yourself
You learn what interests you
You learn when you are motivated
You learn from your own successes/mistakes
Your emotions play a large part in what you are learning
[Boud et al. 1985]
Reflective Learning – it‘s Personal
Individual is foremost target
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 5
It’s Social
You learn by observing others
You learn from help/guidance of others
You learn by sharing/benchmarking with others
You learn within a team/community/organization
A team/community/organization learns through you
[Boud et al. 1985]
Reflective Learning – it‘s Social
Privacy and trust are crucial for sharing
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 6
It’s Revisiting the Past
You rely on your memory
You learn by returning to your experience
You learn by re-evaluating your experience from a different point of view/with different emotions
[Boud et al. 1985]
Reflective Learning – it‘s Revisiting the Past
Augment the individual and collective memory
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 7
Augment memory to intensify and extend reflective learning
Encourage systematic and periodic learning by reflection during work
Allow effortless capturing and sharing of experiences
Provide guidance and baselines for effective reflective learning
Support articulation and construction of knowledge
Make learning by observation scalable within organizations
Enable learning by observation in distributed environments
Close the reflective learning loop between individuals, teams, communities, and organizations
Computer Supported Reflective Learning - What can it offer?
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 8
Project Objectives
Objective A: Refine the conceptual understanding of learning by reflection in the workplace and its contribution to a holistic treatment of knowledge in the organization
Objective B: Develop a variety of Methods and Apps for learning by reflection based on historical or captured user data and experiences
Objective C: Apply the developed reflection methods and Apps in diverse testbeds and evaluate learning effectiveness “in the wild”
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 9
Four Activity Streams to Integrate the Six Perspectives
WP4 WP5 WP6 WP7 WP8 WP3
Reflective Learning Model
User & Design Studies
Storyboards & Requirements
Interoperability Framework
Obj. A
Tech Obj.
Obj. C
D1.4
D1.2
D1.3
D2.1
D 3.1
D 4.1
D 5.1
D 6.1
D 7.1
D 8.1
D1.1
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 10
Reflection Topics in the Testbeds
Regola
Disaster and emergency
management
Target group Volunteers,
Rescue Managers
NBN
Physician Education,
Conversations with relatives
Target group Physicians,
nurses
RNHA
Dealing with challenging behaviour
Target group Caregivers, managers
INFOMAN
Sales presentations and standard
slides
Target group
Sales consultants
BT
Virtual meetings, learning design
Target group Learning
Professionals
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 11
Theoretical Basis: Reflective Learning (Boud et al.)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 12
Computer-Supported Reflective Learning - Basic Idea
Collect Data
Reflect on Data
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 13
The MIRROR Vision
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 14
MIRROR APPS
See for our Apps showroom: http://www.mirror-project.eu/showroom-a-publications/mirror-apps-status
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 15
Apps in Development (excerpt)
MIRROR App Name Description
CroMAR Sensing of information from several public data
providers
Timeline App Articulation of experiences and annotations
Task Tracker Articulation of current tasks
Proximity Sensors Sensing of proximity and articulation
DocTrain Articulation of medical specialist training tasks
Live Interest Meter (LIM) Articulation of thoughts and personal feedback
MoodMap App Articulation of moods and related thoughts
Task Detection App Sensing of computer activities
Carer Articulation of events (challenging behaviours)
Microblogging for Care
Staff in Dementia Care
Homes
Articulation of observations and experiences
Prep App Articulation of experiences
Serious Game - Moodmap Articulation of game-related moods
Issue Articulation and
Management App
Articulation of issues
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 16
Sensors
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 17
Mood Map App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 18
Mood Map App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 19
WatchIT App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 20
CROMAR App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 21
LIM App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 22
DocTrain App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 23
Carer App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 24
Task Detection App
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 25
iBeeper Framework
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 26
iBeeper App - driving activities
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 27
iBeeper App - sport activities
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 28
3D Serious Games: Interface
3D Virtual Hospital
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 29
3D Serious Games: Dialogues
Example of branching story
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 30
Talk Reflection App (NBN)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 31
Issue Articulation App (NBN)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 32
Issue Management App (NBN)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 33
DoWeKnow App (INFOMAN)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 34
DoWeKnow App (INFOMAN)
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 35
DESIGN-BASED RESEARCH
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 36
The Role of CSRL Model
App Development
CSRL Model
Testbed Practices Ev
alu
atio
n F
ram
ew
ork
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 37
Year 2 in Perspective
Year 1
AS IS Situation
Year 2
TO BE Situation
Year 3
Generalizability
Year 4
Evaluation
Focus on
project-internal
users
Extend focus
to wider user
communities
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 38
Year 1: Understand AS IS Situation - Focus on User & Design Studies
What can we learn about reflective learning as it happens today within concrete testbeds in order to intensify and extend reflective learning in the future?
What do people reflect about?
What triggers reflection?
Is there support for reflection in place?
What kind of data, tools, practices could support reflection?
In which way are reflection results shared (if at all)?
...
Reflection session: A time-limited activity framing processes of reflection
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 39
Year 1: Initial Structure of CSRL Model
TEL Project Results
Literature Surveys
Triggers Objectives Content Process Outcomes Timing Support
Reflection Session
User Studies
Design
Studies
14 user & design studies 64 participants
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 40
App Development
Computer-Supported Reflective Learning (CSRL) Model
Testbeds
Design-based Research (from Y1 to Y2)
E
v
a
l
u
a
t
i
o
n
User Studies
Design
Studies
Story Boards
& Requ.
Apps & Games
TEL Project Results
Privacy
Creativity Work-shops
Literature Surveys D1.5
Evaluation
Methodology
D1.3 Scenarios & Requirements
D1.4 CSRL Model
D2.2 Interoperability Framework
D10.2
Formative
Evaluation
Results
D3.2-D8.2 & D9.3B
App Development and
Theory Refinement
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 41
Year 2: Define TO BE Situation - Focus on App Development
How can we support reflective learning at the workplace with Apps?
Which role can apps play?
Which apps should be developed?
How should the apps work and look like?
In which situations should the apps be used?
How should the apps handle data?
How can apps share data?
What kind of interfaces work well?
Which problems occur when using the apps?
...
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 42
Initiate reflection
session
Work
Make information
available for reflection
Re-evaluate work
experience
Make sense of
available information
Plan to apply reflection outcome
Apply reflection outcome
Conduct reflection
session
From Y1 to Y2: Emerging CSRL Model
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 43
Year 2: Refined CSRL Model
Initiate reflection
session
Work
Make information
available for reflection
Re-evaluate work
experience
Make sense of
available information
Plan to apply reflection outcome
Apply reflection outcome
Conduct reflection
session
Story Boards
& Requ.
Apps
Evaluation Results
evaluation of 9 apps in 10 settings
14 apps
25 storyboards
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 44
Year 2: 14 Apps Developed
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 45
Year 2: Apps in Action - Evaluation of 9 Apps in 10 different Settings
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 46
Year 2: MIRROR Spaces Concept & Interoperability Framework ▪ Spaces for the data exchange between clients on
different platforms
▪ Support for private and shared reflection
▪ Application can be connected to multiple spaces
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 47
OUTLOOK INTO YEAR 3
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 48
Just providing data is not enough!
High Expectations and Unclear Nature of Reflection
Huge interest in data
Personal benefit can be observed
«so what?» Reflection Support is needed
Linking ‘data curves’ to events and causes requires more context
Comparison between yesterday/today, today/average, me/others, ... could help people to ask interesting questions
What did we learn in Year 2?
Awareness Reflective Learning
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 49
Major Results
CSRL Model v1
14 Apps
Interoperability Framework
Evaluation of 9 Apps in 10 Settings
Learning Outcome
Leve
l 1
Reac
tion
Leve
l2Le
arni
ngLe
vel3
Beha
viou
rLe
vel4
Re
sult
s
Re-evaluation of Experience
BehaviouralIntentions
Knowledge / Skills
Action
Business Impact
MIRROR Adoption
Level of Participation
Process Indicators
Gained Knowledge
Quantity / Quality
Instances/Performance
Key Performance Indicators
Work
Community
Organization
Level of Participation
Learning Process (Reflection)
App Usage
Processes & Methods
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 50
DISSEMINATION AND EXPLOITATION
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 51
MIRROR journey
Get informed:
Project information on website www.mirror-project.eu
Get involved: Test Mirror apps: • Provide feedback to become a member of
our exploitation network
Stay up-to-date: Become a member of the LinkedIn group: Mirror – Reflective learning at work
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 52
Mirror website
▪ News & Tweets on homepage
▪ Deliverables, work package updates, publications, newsletters
▪ Labs: apps showroom with instructions to try out, video’s
▪ Use cases
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 53
16 Apps in showroom
Apps Manuals
Videos
Contacts
Evaluation form
Links
http://mirror-dev.fzi.de/lim/
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 54
Business Segment for Reflective Learning: Performance Support and Collaboration
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 55
MIRROR can fill a gap in the market of soft skills training
Topics: project management, conflict handling, presentation skills,
negotiation skills, …
Classroom training
• Theory
• Role Plays • In Groups
Individual Coaching
• Expert
Observation • Discussion
• Help
E-Learning Modules
• Theory
• Videos with best practices
• Exercises (e.g. multiple choice)
MIRROR Coaching
Apps
• Capturing • Data Analysis
• Reflection • Proactive
Help
$$$
+ Well accepted in
companies
- Long term effect?
$
+ Ease of use
- No training effect
$
+ Real training
effect
- Permanent data
capturing
$$$$$
+ High training
effect
- Costs a lot of
personal time
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 56
Industry Solutions
Focus Areas for Exploitation have been defined:
▪ Dementia Care (English)
▪ Healthcare (English and German)
▪ Sales (English and German)
▪ Crisis management (Italian, English)
▪ HR/L&D
-> Reflective Learning Solutions can also be industry specific exploited, if generalization is not applicable
© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 57
▪ MIRROR will be the first approach to support agile learning by doing and reflective learning at work
▪ MIRROR will increase learning effectiveness, work outcome and quality
▪ MIRROR will foster the use of TEL in new application areas within organisations
Thank you very much