iata safety promotion indicators

8/20/2019 IATA Safety Promotion Indicators

1/27

Safety PerformanceIndicators

Stefano PROLAManager Safety and Flight Ops EUR IATA


2/27

Overview

SMS > why SPIs

Measuring Safety

Examples


3/27

SMS Basics

Safety is dependent on this “System”

working

SMS requires organizations to makedata-based decisions and actions

Dependent on the collection and analysis of correct

information

Must understand the system as a whole and the risks

associated with it

Shift of responsibility for safety risk mitigation

29 October 2015Proactive safety: from theory to practice 3


4/27

Fundamental Shift

Reactive to proactive management

Prescriptive to performance based management and

oversight



5/27

Shift to Performance Based

Management

New requirements

New roles

New needs



6/27

Performance Based Management

In context of operation• Domestic / International / Regional

• Wide-body / Narrow-body• Bulk load / Container load

• Cargo / Pax / Combi

• Risk tolerance of the organization

Complexity of the operation

An alternative means to prescriptive compliance



7/27

Why?

Proactive management

Technology improvements Vast majority of accidents / incidents related to

technology / human interface

Improvements in the understanding of

human factors Drill into causal factors



8/27

SMS purpose

“Safety Management processes identify hazards with the

potential to adversely affect safety” ~ ICAO SMM

Purpose is to improve safety performance

Also requirement for continuous improvement, system

must continue to evolve



9/27

ICAO SMS Framework - Annex 19Safety Policy and Objectives

1.1 – Management commitment and responsibility

1.2 – Safety accountabilities

1.3 – Appointment of key safety personnel1.4 – Coordination of emergency response planning

1.5 – SMS documentation

Safety Risk Management

2.1 – Hazard identification

2.2 – Risk assessment and mitigation



10/27

ICAO SMS Framework – Annex 19Safety Assurance

3.1 – Safety performance monitoring and measurement3.2 – The management of change

3.3 – Continuous improvement of the SMSSafety Promotion

4.1 – Training and education

4.2 – Safety communication



11/27


12/27

Measuring SafetyPerformance

“You cannot manage what you don’t

measure”How do you measure safety performance?


13/27

Definitions

Safety ~ the state in which risks associated with aviation

activities, related to, or in direct support of the operation

of aircraft, are reduced and controlled to an acceptablelevel - ICAO

Safety Performance ~ a State’s or Service Provider’s

safety achievement as defined by its safety performance

targets and safety performance indicators - ICAO SMM Ed3 Effective 2013



14/27

Definitions

Safety Performance Indicator ~ a data based safety

parameter used for monitoring and assessing safety

performance - ICAO SMM

Performance Measures ~ Metrics (or values) that are

set as a target (usually a number or rate) in order to

measure the level of operational performance being

achieved - IATA Reference Manual for Audit Programs(IRM)



15/27

IOSA Reference

ORG 3.2.1The Operator should have

processes for setting performance

measures as a means to monitor theoperational safety performance of the

organization and to validate the

effectiveness of safety risk controls.

[SMS] (GM)

1 September 2016 “should” > “shall”



16/27

Performance Measurement and

Monitoring Dependent on all SMS framework

requirements met Managing operational risks

Maintaining regulatory compliance



17/27

Measuring Safety Performance

Set measureable (SMART) safety objectives

Track performance

Compare against targets

Achievement of a target > improvement in performance



18/27

IOSA examples

Flight operations (e.g., landing tail strikes, unsatisfactory

line or training evaluations)

Operational control (e.g., fuel diversions due to fuel)

Engineering and maintenance (in-flight engine

shutdowns, aircraft component/equipment failures)

Cabin operations (inadvertent slide deployments)

Ground handling (aircraft damages due to vehicles or equipment)



19/27

SMS 3rd phase Doc 9859 SMM

“Develop high-consequence SPIs and associated targets

and alert settings.”

Typically focused on number of serious accidents /incidents

High profile

Easy to measure

Reactive• Does not expose systemic issues or hazards



20/27

Proactive Shift

SPIs measure performance of safety controls

Shift focus to precursors of serious events



21/27

SMS 4th phase Doc 9859 SMM

“Develop lower-consequence SPIs and associated

targets/alert settings”

Enhance the safety data collection and processingsystem to include lower-consequence events.

Establish lower-consequence safety/quality indicators

with target/alert level monitoring as appropriate.

Reach an agreement with the State oversight authority

on lower-consequence safety performance.



22/27

Data

Must measure leading and lagging indicators

Leading indicator ~ Metrics that provide information on

the current situation that may affect future performance Lagging Indicator ~ Metrics that measure safety events

that have already occurred including those unwanted

safety events you are trying to prevent

Established for any operational or maintenance area



23/27

Example ~ Long Landing (leading)

Identify touchdown points of ALL flights



24/27

Example – Unstable approach paradox

Extract from Data Report for Evidence-Based Training

“While airline Standard Operating Procedures (SOP’s)mandate a go-around if an approach is unstable, data

indicates that landing from an unstable approach may be

less risky.”

Landings that follow an unstable approach are usually

uneventful (98% land, 90% uneventful)

Missed approaches are rarely handled well



25/27

Summary SPIs not driven to simply get a “good score”

Must improve overall safety performance

Process approach focusing on inputs and their direct

impact on output(s) Results to be regularly reviewed and communicated

Can be established for virtually any operational or

maintenance area

Must be challenging and result in enhancing the SMS as

a whole



26/27

IATA Activity

Creation of SPI Guidance Material• Sample SPIs

• Supporting methodology Assist organizations in developing the means to verify

their safety performance against meaningful safety

objectives

Facilitate understanding of the need to look beyond

“events”



27/27

Thank you!


iata safety promotion indicators

Documents