ICAO State Safety Programme SSP Implementation Course

1
(No Transcript)
2
SSP A structured approach
Module 5 State ALoS
3
Objective

• At the end of this module, participants will be
  able to describe the concepts and dimensions
  underlying the acceptable level of safety (ALoS)
  related to an SSP

4
Contents

• Introductory concepts
• Acceptable level of safety (ALoS)
• ALoS related to an SSP
• Summary
• Questions and answers
• Points to remember

5
Introductory concepts

• The development and implementation of ALoS builds
  upon certain basic concepts of systems theory
• There is a hierarchy underlying the progression
  of these basic concepts towards the development
  and implementation of ALoS
• Understanding of the concepts and hierarchy is an
  essential foundation for the development and
  implementation of ALoS and the SSP

6
Introductory concepts The basic theory

• Safety as defined by Doc 9859
• Level of safety degree of safety of a system,
  representing the quality of the system,
  safety-wise, expressed through safety indicators
• Safety indicators parameters that characterize
  and/or typify the level of safety of the system
• Safety targets concrete objectives to be
  achieved
• Acceptable level of safety minimum degree of
  safety that must be assured by a system in actual
  practice
• Value of a safety indicator quantification of a
  safety indicator
• Value of a safety target quantification of a
  safety target

Safety is the state in which the risk of harm to
persons or property damage is reduced to, and
maintained at or below, an acceptable level
through a continuing process of hazard
identification and risk management
7
Introductory concepts Selection of safety
indicators

• The selection of appropriate safety indicators is
  an essential foundation for the development and
  implementation of ALoS
• The selection of safety indicators is a function
  of the detail to which the level of safety of the
  system is to be represented
• Meaningful safety indicators must be
  representative of the elements that characterise
  system safety
• Accidents/accident rates
• Incidents/incident rates
• Level of regulatory compliance

8
Introductory concepts The basic theory examples

• Safety indicators
• Fatal airline accidents/serious incidents
• Runway excursion events/ground collision events
• Development/absence of primary aviation
  legislation
• Development/absence of operating regulations
• Level of regulatory compliance
• Safety targets
• Reduction in fatal airline accident/serious
  incidents
• Reduction in runway excursion events/ground
  collision events
• Number of inspections completed quarterly

9
Introductory concepts The basic theory examples

• Value of safety indicators
• Rate/number Fatal airline accidents per
  number operations
• Rate/number Runway excursion events per
  number operations
• Rate/number Ground collision events per
  number operations
• Number inspections to operators completed
  timeframe ...

• Value of safety targets
• Reduction by/maximum fatal airline accidents
  per number operations
• Reduction by/maximum runway excursion events
  per number operations
• Reduction by /maximum ground collision events
  per number operations
• Minimum number of inspections completed
  timeframe

10
Introductory concepts A fundamental
differentiation

• Safety measurement
• Generally associated to the SSP
• Quantification of outcomes of selected high-level
  or high-consequence events
• Accident rates
• Serious incident rates
• Quantification of selected high-level State
  functions
• Development/absence of primary aviation
  legislation
• Development/absence of operating regulations
• Level of regulatory compliance
• A measure of achievement of high-level safety
  objectives of safety interventions and/or
  mitigations strategies

11
Introductory concepts A fundamental
differentiation

• Safety performance measurement
• Generally associated to an SMS
• Quantification of the outcomes of selected
  low-level, low- consequence processes
• Number of FOD events per number of ramp
  operations
• Number of ground vehicle events in taxiways per
  number of airport operations
• A measure of the actual performance of safety
  interventions and/or mitigation strategies,
  beyond accident rates and regulatory compliance

12
Introductory concepts A fundamental
differentiation

• Safety measurement
• Not a continuous process
• A spot check
• Conducted following pre-specified timeframes
• Safety performance measurement
• Continuous process
• Monitoring and measurement of selected
  operational activities necessary for the
  provision of services

13
Basic safety management SARPs

• The acceptable level of safety (ALoS) to be
  achieved shall be established by the State
• When establishing ALoS, consideration must be
  given to
• The level of safety risk that applies
• The safety risk tolerance
• The cost/benefits of improvements to the aviation
  system
• The public expectations in civil aviation system

14
Expressing the ALoS

• Values of safety indicators and values of safety
  targets
• Initial ALoS Quantitative action statements on
  selected high level/high consequence outcomes
  (safety measurement)
• Mature ALoS Quantitative action statements on
  selected high level/high consequence events
  (safety measurement) and low level/low
  consequence outcomes (safety performance
  measurement)

15
Examples of values of safety indicators and
safety targets based on safety measurement

• Values of safety indicators
• Number CFIT and approach landing accidents
  per number departures
• Number runway excursions per number
  operations
• Number ground collision accidents per year on a
  x-year rolling average
• Number of high-severity events captured through
  the State MOR yearly
• Number inspections to operators completed
  quarterly
• Number AIS facilities with QMS implemented
• Electronic filing of differences completed within
  number months/weeks

• Values of safety targets
• Reduce by/maximum CFIT and approach landing
  accidents per number departures
• Reduce by/maximum runway excursions per
  number operations
• Reduce by/maximum ground collision accidents
  per year on a x-year rolling average
• Minimum number of high-severity events captured
  through the State MOR yearly
• Minimum number inspections to operators
  completed quarterly
• Number AIS facilities with QMS implemented by
  time
• Electronic filing of differences completed within
  revised number months/weeks

16
Delivering ALoS Safety action plans

• Tools and means to deliver the safety targets of
  an SSP
• Operational procedures
• Technology
• Systems
• Training programmes

17
ALoS Mature SSP

• In the longer-term, once States develop safety
  data collection and analysis capabilities under
  the Safety Assurance component of the SSP, ALoS
  should reflect a combination of
• safety measurement
• safety performance measurement

18
Examples of values of safety indicators and
targets based on safety performance measurement

• Values of safety targets
• Reduce by/maximum number of level busts per
  number operations by date
• Reduce by/maximum Cat B and C runway incursions
  in 5 international State airports by date
• Reduce by/maximum number of TCAS/airprox events
  per number operations by date
• Reduce by/maximum number of non-conforming
  approaches (NCA) at 5 international State
  airports by date
• Reduce by/maximum the number of apron FOD
  events at 5 international State airports by
  date

• Values of safety indicators
• Number level busts per number operations
• Number Cat B and C runway incursions in 5
  international State airports per number
  operations
• Number TCAS/airprox events per number
  operations
• Number non-conforming approaches (NCA) at 5
  international State airports per number
  operations
• Number apron FOD events at 5 international
  State airports per number operations

19
ALoS Legal considerations

• Establishing ALoS related to an SSP
• does not replace legal, regulatory, or other
  already established requirements, but it must
  support compliance with them
• leaves unaffected the obligations of States, and
  does not relieve States from compliance with SARPs

20
ALoS Initial (Safety measurement)
Values of safety targets

• Reduce by/maximum CFIT and approach and landing
  accidents per number departures
• Minimum number inspections to operators
  completed quarterly
• ...

Action plans

• CFIT training package distributed to industry and
  supported by training courses
• Revision and if necessary update of hiring
  policy. Inspection manual updated
• ...

Values of safety indicators

• Number CFIT and approach and landing accidents
  per number departures
• Number inspection to operators completed
  quarterly
• ...

State
Will comply all applicable international standards
21
ALoS Mature (Safety performance measurement)
Values of safety targets

• Reduce by/maximum non-conforming approaches
  (NCA) at 5 international airports per number
  arrivals by date
• Reduce by/maximum Cat B and C runway incursions
  in 5 international State airports per number
  by date

Action plans

• Constant Descend Arrivals (CDA) procedures
  implemented Arrival procedures charts designed
  for stabilized approaches
• Installation of ASDE/X in 5 international State
  airports
• .

Values of safety indicators

• Number non-conforming approaches (NCA) at 5
  international airports State per number
  operations
• Number of Cat B and C runway incursions in 5
  international airports State per number
  operations

State
Will comply all applicable international standards
22
Transition from initial to mature ALoS

• Mature ALoS
• (Safety measurement and safety performance
  measurement)
• Quantification of outcomes of selected
  high-level/high-consequence events
• Quantification of selected high-level State
  functions
• Quantification of outcomes of selected
  low-level/low-consequence events

• State safety assurance
• Safety oversight
• Safety data collection, analysis and exchange
• Safety data driven targeting of oversight on
  areas of greater concern or need

• Initial ALoS
• (Safety measurement)
• Quantification of outcomes of selected
  high-level/high-consequence events
• Quantification of selected high-level State
  functions

23
Summary
State accepts and oversees individual service
providers SMS
Safety performance
Safety performance
Safety performance
Safety performance
Safety performance
SSP (ALoS)
State agrees and supervises individual service
providers SMS safety performance
Safety performance
Safety performance
Safety performance
Safety performance
Safety performance
State accepts and oversees individual service
providers SMS
24
Questions and answers

• State ALoS

25
Questions and answers

• Q Explain the fundamental differentiation
  between safety measurement and safety
  performance measurement?
• A
• Safety measurement
• Not a continuous process
• A spot check
• Conducted following pre-specified timeframes
• Safety performance measurement
• Continuous process
• Monitoring and measurement of selected
  operational activities necessary for the
  provision of services

Slide number 12
26
Questions and answers

• Q What are the tools and means to deliver the
  safety targets of an SSP?
• A
• Operational procedures
• Technology
• Systems
• Training programmes

Slide number 16
27
Points to remember

• The basic systems safety theory
• Safety measurement and safety performance
  measurement
• Initial and mature ALoS
• ALoS does not replace legal, regulatory, or other
  already established requirements

28
Module N 5 State ALoS