soft-skill assessment on digital simulators

22
Soft-skill Assessment on Digital Simulators Kalyan Chatterjea – EMAS Academy Renu Yadav – EMAS Academy Digital Ship Singapore 1st Oct – 2nd Oct 2013 Singapore 2013

Upload: emas-training-academy-and-simulation-centre

Post on 12-Nov-2014

355 views

Category:

Technology


1 download

DESCRIPTION

> Soft-skills & their Assessment on Simulators > Developing Specific Behavioural Markers > Use of Behavioural Markers in a Bridge Resource Management Course

TRANSCRIPT

Page 1: Soft-skill Assessment on  Digital Simulators

Soft-skill Assessment on Digital Simulators

Kalyan Chatterjea – EMAS AcademyRenu Yadav – EMAS Academy

Digital Ship Singapore 1st Oct – 2nd Oct 2013

Singapore 2013

Page 2: Soft-skill Assessment on  Digital Simulators

Agenda

Soft-skills & their Assessment on Simulators

Developing Specific BehaviouralMarkers

Use of Behavioural Markers in a Bridge Resource Management Course

Singapore 2013

Page 3: Soft-skill Assessment on  Digital Simulators

Why Assess?

Assessment drives learning

It provides opportunity for participants to gauge their own learning

It also feeds back facilitators to tweak contents to meet learners’ needs

Finally, are the course objectives met?

Singapore 2013

Page 4: Soft-skill Assessment on  Digital Simulators

Types of Assessment

Pre-CourseAssessment

FormativeAssessment

SummativeAssessment

Singapore 2013

Page 5: Soft-skill Assessment on  Digital Simulators

Digital Tools for Assessment used @ EMAS Academy

We use for our digital assessment. ExamView is used to develop question banks for the

following types of questions:

Multiple ChoiceMultiple Answer QuestionsMatching

Singapore 2013

Page 6: Soft-skill Assessment on  Digital Simulators

Digital Tools for Assessment used @ EMAS Academy for

Bridge Resource Management Course

ExamView CPS(Classroom Performance System) is used for quick assessment and recording of scores

Singapore 2013

Page 7: Soft-skill Assessment on  Digital Simulators

Digital Tools for Assessment used @ EMAS Academy for

Bridge Resource Management Course

ExamView CPS(Classroom Performance System) is used for quick assessment and recording of scores

Singapore 2013

Page 8: Soft-skill Assessment on  Digital Simulators

Digital Tools for Assessment used @ EMAS Academy for

Bridge Resource Management Course

ExamView CPS(Classroom Performance System) is used for quick assessment and recording of scores

Singapore 2013

Page 9: Soft-skill Assessment on  Digital Simulators

Assessment on Diesel-Electric Propulsion

Singapore 2013

Digital Tools for Assessment used @ EMAS Academy for

ER Resource Management Course

Page 10: Soft-skill Assessment on  Digital Simulators

Trigger logics developed to capture simulation events

Coaching message

Assessment

Singapore 2013

Digital Tools for Assessment used @ EMAS Academy for

ER Resource Management Course

Page 11: Soft-skill Assessment on  Digital Simulators

Assessment based on simulation events

Singapore 2013

Digital Tools for Assessment used @ EMAS Academy for

ER Resource Management Course

Page 12: Soft-skill Assessment on  Digital Simulators

Scores captured from simulation events

Singapore 2013

Digital Tools for Assessment used @ EMAS Academy for

ER Resource Management Course

Page 13: Soft-skill Assessment on  Digital Simulators

Importance of Soft-skills

Soft-skills are introduced through crew-resource-management courses

Soft-skillsWere first highlighted in the

aviation industry when even experienced pilots made errors!

Soft-skills (often referred to as non-technical skills) are now well-established in the aviation industry.

STCW 2010 Amendments require resource management courses from Jan 2012 for all COC holders

Singapore 2013

Page 14: Soft-skill Assessment on  Digital Simulators

Non-technical Skills Categories & Behavioural Markers

Assessing these skills are not easy and in aviation they use Behavioural Markers as seen and discussed in the following slides for these assessments.

Singapore 2013

Page 15: Soft-skill Assessment on  Digital Simulators

Examples of Behavioural Markers

NOTECHS > Human Factors > Categories > Error Handling

Singapore 2013

Page 16: Soft-skill Assessment on  Digital Simulators

Rating Scale for Behavioural MarkersSingapore 2013

Page 17: Soft-skill Assessment on  Digital Simulators

Development of Behavioural Markers (BMs)

Steps for developing BMs:

Propose a set of behavioural makers, considered to be importance to performance, for the content area.

Collect data on these markers after going through simulated or actual environments.

Compare and contrast these data sets from various focus groups.

Try & establish relationships between these behaviours and the errors encountered in practice.

From above processes select the most useful behavioural markers, which could impact team training interventions.

Singapore 2013

Page 18: Soft-skill Assessment on  Digital Simulators

Use of Behavioural Markers in Man Over Board Scenario

Behavioural Markers Form with BM Ratings

Singapore 2013

Page 19: Soft-skill Assessment on  Digital Simulators

Man Over BoardExercise – Run 1

Man Over BoardExercise – Run 2

Assessing BMs in Man Over Board Scenario

Singapore 2013

Page 20: Soft-skill Assessment on  Digital Simulators

Assessment Graph of BMs for Man Over Board Scenario

Singapore 2013

Page 21: Soft-skill Assessment on  Digital Simulators

Use of High-Fidelity Offshore Vessel Simulator for a BRM Session

Singapore 2013

Page 22: Soft-skill Assessment on  Digital Simulators

Thank You!

Disclaimer: This material includes forward-looking statements prepared by Ezra Holdings Limited (“Company”). The opinions, forecasts, projections or other statements other than statements of historical fact, including, without limitation, estimates of proved reserves of oil and gas, reserves potential and plans and objectives of management of the Company for financing, are forward-looking statements. Although the Company believes that the expectations reflected in such forward-looking statements are reasonable, it can give no assurance that such expectations will prove to have been correct. All forward looking-statements contained in this presentation are expressly qualified in their entirety by the cautionary statements contained or referred to in this section. Readers should not place undue reliance on forward-looking statements. Each forward looking statement speaks only as of the date of this presentation. Neither the Company nor any of its subsidiaries and associates undertake any obligation to publicly update or revise any forward-looking statement as a result of new information, future events or other information. In light of these risks, results could differ materially from those stated, implied or inferred from the forward-looking statements contained in this presentation.

Questions & Answers

Singapore 2013