JAA Human Factors Interim Policy Seminar

1
JAA Human Factors Interim Policy Seminar

• Applicability
• Terry Newman

2
Applicability 

• This presentation is intended to help to identify
  whether the Special Condition is required.

3
English Lesson!

• Webster's Revised Unabridged Dictionary (1913)
• New
• Having existed, or having been made, but a short
  time having originated or occurred lately
  having recently come into existence, or into
  one's possession
• Novel
• Of recent origin or introduction not ancient
  new hence, out of the ordinary course
  unusual strange surprising

4
English Lesson!

• Webster's Revised Unabridged Dictionary (1913)
• New
• Having existed, or having been made, but a short
  time having originated or occurred lately
  having recently come into existence, or into
  one's possession
• Novel
• Of recent origin or introduction not ancient
  new hence, out of the ordinary course
  unusual strange surprising

5
English Lesson!

• Usage
• Everything at its first occurrence is new
• That which is a new sight is beheld for the first
  time
• That which is novel is so much out of the
  ordinary course as to strike us with surprise
• That is a novel sight which either was never seen
  before or is seen but seldom.

6
English Lesson!

• Usage
• We have daily new inventions, but a novel one
  supposes some very peculiar means of attaining
  its end. Novel theories are regarded with
  distrust, as likely to prove more ingenious than
  sound.

7
Final Example

• New world
• the land of the Western Hemisphere -- so called
  because not known to the inhabitants of the
  Eastern Hemisphere until recent times.
• Webster's Revised Unabridged Dictionary (1913)

8
Basis for a Special Condition

• Philosophy?
• See JAR 21.16 Special Conditions paragraph (a)
• an item may be regarded as novel if it has
  characteristics that did not exist within the
  state of the art upon which the JAR was based.
• in this case, characteristics with HF
  implications

9
Interpretation of Novel Feature

• Any change made to a flight-deck has the
  potential for creating a Human Factors problem
• a new piece of knowledge or technique may be
  required.
• To describe any one addition to the flight-deck
  as a "novel" feature may be an exaggeration.
• Consider only
• changes which take place on flight-decks which
  have not been hitherto envisaged
• do not have a parallel of experience in another
  field on which to judge them.

10
Categories of Novel Features

• Introduction of a new technology.
• Introduction of a new concept of interfacing with
  the crew, utilising either conventional or
  innovative technology.
• If a design feature is novel and introduces a new
  concept of operation or handling technique, then
  there may need to be an associated training
  requirement that forms part of the compliance
  substantiation.
• Different use of an equipment, with or without
  its integration in interfaces.
• Introduction of a new operational procedure.

11
a. Novel Technology

• A feature or function introduced into a
  flight-deck not previously been seen as a civil
  aviation task or capability
• Is effect transparent to the crew because the
  interface is familiar to them?
• Will they be required to adapt to the technology?

12
a. Novel Technology

• Examples
• a. the introduction of a head-up display to
  enable landing capability in poor weather
• b. the introduction of voiceless communications
• c.   new input devices (CCDs, touch-screen
  controllers).

13
b. Novel Concept

• modification which alters the manner of working
  of a crew
• may or may not be associated with a new
  technology.
• commonly apparent in use of increased automation
• relieve crews of tasks and/or monitoring
  functions for which they had been previously
  responsible.

14
b. Novel Concept

• No previous experience of the concept, nor effect
  on crews using the equipment. Needs
• a level of supporting research, or
  proof-of-concept testing.
• adequate investigation for any human performance
  limitations
• an assessment of the errors likely to occur in
  operation
• determination of any training or familiarisation
  that will be necessary due to change in
  commonly-accepted procedures.

15
b. Novel Concept

• Examples
• reduction in feedback to crews (less information
  displays, fewer system controls) on the
  assumption of high reliability
• automatic re-configuration of systems following
  malfunction
• the introduction of artificial intelligence
  software into a crew monitoring system. 

16
c. Novel Use of Existing Equipment

• use of an existing installed equipment for a
  purpose that was not previously intended.
• In its original certification the equipment is
  likely to have been addressed and investigated
  for a single purpose, and the procedures
  surrounding it will have been approved
• assumption that crews trained to behave in an
  anticipated manner
• usage change, system to be re-investigated for
  any safety implications emanating from new use or
  mis-use

17
c. Novel Use of Existing Equipment

• Examples
• a. the use for navigation purposes of a terrain
  / map display from a digital database, not just
  as the ground proximity warning for which it was
  intended or
• b. the use of a traffic collision and avoidance
  system (TCAS) for maintenance of separation,
  rather than purely for collision avoidance.  

18
d. Novel Procedures 

• new operational procedures
• to enable a greater capability,
• a higher density use of the existing air traffic
  system, or
• a method perceived to offer safety enhancements,
• mis-interpretations of design capability
• crews expect capabilities which do not exist or
  have not been evaluated
• programming and system integrity of the
  technology may not be consistent for all
  equipment in use (e.g. software integrity, route
  leg definitions)
• each procedure may require varying levels of crew
  monitoring or involvement, which may not be
  apparent to the crew.

19
d. Novel Procedures 

• Examples
• use of FMS (with or without GPS) to provide
  apparent precision guidance during approach
• use of FMS (with or without GPS) to establish
  vertical separation in departure and en-route
• Alternate use of flight controls for recovery
  from upset manoeuvres?

20
Effect on Crew Dependability

• In all four new or novel scenarios, the
  presence of any new technology, new concept,
  revised usage, or new procedures, is likely to
  influence and change general crew behaviour
  patterns for the future.
• as they have done in the past
• Most probable in areas of overall monitoring
  tasks and attention to detail
• Can, and does, result in misplaced
  over-confidence in achieved safety levels,
  together with an increased potential for error. 

21
Methods of Dealing with Novel Features

• Purpose of the next 2 days worth of lectures, but
• 2 views on potential for error
• design-induced
• crew-induced

22
Influence of Design Characteristics on Potential
for Crew Error

• Look for any tendency in the design to induce
  systematic errors, thereby risking an adverse
  outcome
• Consider effects on the ability of the crew,
  under both normal and non-normal conditions, to
• achieve the scheduled performance,
• reliably and consistently achieve the desired
  flight path during manual or automatic control,
• achieve the desired outcome from flight guidance
  or flight management systems, or
• achieve an appropriate state from the on-board
  systems

23
Influence of Crew on Potential for Human Error

• All respected literature indicates that
• the probability of the crew, individually or when
  acting together, making inadvertent single
  errors, or combinations of errors, can never be
  reduced to below a Probable frequency.

24
Influence of Crew on Potential for Human Error

• In setting minimum standards of performance for
  any individual crew member, the provision of
  additional specialised training cannot be
  guaranteed
• Acceptability of a feature cannot be predicated
  on a period of familiarisation, unless it is
  shown to be a repetitive task and will form part
  of the normal training.

25
Influence of Crew on Potential for Human Error

• Therefore, investigations to justify a design,
  together with conclusions reached, should be
  recorded, to indicate the reasons for the design
  option chosen, and show that
• Possible contentious choices were not based on
  one sole opinion, nor a very limited sample of
  opinions, but extensively researched, using
  objective targets and methods involving a
  representative sample of end users.