MSHA Performance Analysis

Briefing Report Presentation

Joe BreighnerAllison Czapracki

Tangie GrayRashmi JainAbi Jones

October 23, 2006

Agenda

Statement of Work Background Performance Analysis Overview Drivers and Barriers Preliminary Data Task Analysis Design Approach Conclusion Next Steps

Statement of Work

The overall goal of this project is to develop a systematic and effective training strategy and course lessons for underground coal mine supervisors based on

State-of-the-art instructional design principles, processes, and learning technologies

The extensive and validated mine supervisor Job Task Analysis (JTA) developed by the Mine Safety and Heath Administration (MSHA) in cooperation with the U.S. Navy

Background

50% of the electricity produced in the U.S. is fueled by coal

Background

In 2004 58.3% of coal miners were above the age of 45

In 2004, 3.4% of coal miners were under the age of 25

Coal mine positions expected to increase by 10,000 over 20 years

“[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years.”

Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association

Background

Contributing factors to personnel shortage Diminishing pool of human resources Ever-changing production methods Increasing high technology environment

“How these skills will be gained in advance of employment is a continuous challenge,” Bruce Watzman

Mine Safety & Health Administration’s (MSHA) challenge: Formalize underground coal mine supervisor training program

Background

2005-06 Research The future high turnover in the coal mine industry The lack of trained and experienced coal mine

supervisors

2006-07 Immersion team to transition training prototype to accessible online training materials

The training must be 508 compliant Developed in Workforce Connections, a Learning

Content Management System (LCMS)

Performance Analysis

The performance analysis was conducted to

Analyze and validate the prototype created by the 2005-06 MSHA Immersion Team

Propose next steps for the task analysis and content analysis phases of the project

Performance Analysis

Process Held a meeting with members of the 2005-06

MSHA Immersion Team

Collected data from subject matter experts (SME), prototype evaluations, online resources, and extant data resources

Identified gaps in last year’s prototype from SME interviews

Identified the drivers that promote the project

Identified the barriers that hinder the project

Performance Analysis

Optimal situation Mine supervisors would possess

Overall knowledge of the mining process and specific knowledge in the following areas:

Safety issues Regulations Technical skills (e.g., ventilation/fluid dynamics,

roof and rib control) Management skills Organizational skills Logical thinking Problem solving

Performance Analysis

Optimal situation (contd…)

Mine supervisors would possess the ability to Communicate effectively and develop a good

rapport with co-workers

Respond appropriately and competently during emergencies and unusual situations

Job task analysis (JTA) spiders would be translated into an engaging, practical and effective training strategy

Performance Analysis

Actual situation Expected shortage of experienced mine

supervisor candidates due to attrition Few mine supervisor training programs are

available Current training programs are mostly

On-the-Job Training (OJT) Smaller mines do not have formal training

programs

Drivers Access to

SME’s, MSHA personnel, and mine environments Extensive mine safety resources Compiled data from 2005-06 MSHA team Target audience as usability and content testers Single expert source to validate training content

High number of mining fatalities during 2006

High rate of impending retirement of experienced miners

Critical role of mine supervisors and the complexity of associated tasks

Barriers

Limitations of LCMS in light of Section 508 and SCORM compliance

Access to experienced miners and mine supervisors as usability and content testers

Development cycle restricted to academic year

Need for supplemental training, on or off-site

Barriers

“Creativity” of mine supervisors, reliance on prior knowledge

Miners showed preference for face-to-face training over online training

Ongoing MSHA administration and support of training LCMS and bulletin boards (new equipment, procedures, safety regulations)

Preliminary Data

Human Resources Stakeholder

Mr. Jeffrey Duncan, MSHA Wants a training solution with “…a

management/engineering perspective [that goes] beyond compliance to understanding”

Stressed creating online training for underground coal mine supervisors

Training to include development of six training modules for 2006-07 in Workforce Connections

MSHA will position the training as professional development for miners

Preliminary Data

Human Resources (contd…) SMEs

Formative evaluations of the 2005-06 training prototype

Interviews

Preliminary Data

Non Human Resources Hard Data Resources

MSHA Statement of Work Title 30 Code of Federal Regulations Multimedia Training Materials NIOSH Latent Imaging Exercises Colorado State Mining Exam Preparation DVD Commonwealth of Pennsylvania  Mine Safety Multimedia Mine

Materials MSHA Informational Reports P&M Mine Job Task Analysis Section 508 Website

Online Resources http://www.msha.gov http://www.cdc.gov/niosh http://www.msha.gov/interactivetraining/tasktraining/index.html http://www.section508.gov

Task Analysis

Cognitive task analysis divided the twelve generic duties into two rule-using categories Procedural Principle

Further analysis of JTAs helped refine the task analyses for Pre-Shift Examination and Emergencies and Unusual Situations

Design Approach

Training Environment Proposal Visually stimulating and interactive

adaptive to the individual miner's level of experience

Customizable and flexible

Performance based

508 and Sharable Courseware Object Reference Model (SCORM) compliant

Rich with multiple views and guided scenarios

Design Approach

Web-based Electronic Performance Support System (EPSS)

Scenario-driven Strategy

Conclusion The performance analysis has provided:

An overview of the current state of the coal mining industry

A closer look at the coal mine supervisory workforce

A clearer understanding of the viability of the training prototype

Our challenge: bridging the gap between miners’ preference for “hands-on practice” and the cognitive-building advantages of computer-based training.

Next Steps

Continued Task Analysis

A continued review of extant data

A synthesis of the information collected

Work on the user interface presentation and functionality

Finalizing the instructional strategy for the entire training, as well as the multiple views and scenario based views.

 

Next Steps

Content Analysis

Synthesis of the information collected into applicable and appropriate training modules

Reviewing examples of MSHA courses in Workforce Connections

Selecting appropriate scenarios for the different lesson topics

Developing appropriate objectives and instructions to guide users through the modules

MSHA Performance Analysis

Briefing Report Presentation

Joe BreighnerAllison Czapracki

Tangie GrayRashmi JainAbi Jones