CompetencyBased Methods for Interoperable Training, Rehearsal, and Evaluation

1
Competency-Based Methods for Interoperable
Training, Rehearsal, and Evaluation

• Wink Bennett
• U. S. Air Force Research Laboratory
• Martin Castor
• Swedish Defence Research Agency

2
Overview

• The challenge
• Objectives
• What to train and measure
• Syllabus development
• Applications
• Way ahead

3
Challenge Transform Readiness for 21st Century
Warfighting
Goal Develop and apply scientifically principled
learning and aiding methods and technologies

• Demonstrate capabilities that are
• Adaptive to learner needs
• Instructionally and tactically rich
• Routinely accessible to warfighters
• Seamlessly integrated with live
  systems for
  continuous learning
• Sustainable with warehoused knowledge and
  managed events

4
Critical Things To Do

• Address Challenge within International Mission
  Training Research (IMTR) Context
• Determine What to Train and What to Measure
• Develop Common Measurement Metrics Methods
• Apply and Validate Approaches Within the IMTR
  program

5
What to Train and MeasureMission Essential
Competencies (MECs)SM Research

• Research questions
• Can knowledge, skill, and experience be
  specified?
• Can gaps be quantified?
• How should gaps be addressed?
• Importance to the warfighter
• Better definition of requirements and objectives
• Permits optimized application of sim and live ops
  media
• Enables proficiency-based requirements and
  assessments
• Current Status
• USAF pioneered process (see Colegrove Alliger
  2002)
• Multinational collaborations have validated
  generalizability of process and products
• Significant collaborations underway today (e.g.,
  IMTR)

6
The What and How of MECsSM

• What are MECs?
• How are they developed?

7
Diagram of Overall Mappings
Various package options OCA escort
missions Operating area restrictions OCA sweep
missions
Marginal cloud clearance New generation
threats Restricted weapons load Electronic
Countermeasures
MEC Force Organization
Flight Battle Management
Situational Awareness
Timeline
Communication

• Comm Standards
• Listens
• Prioritizes comm
• Sorts info
• Speaks clearly

• Follow on options
• Formation standards
• Mission objectives
• Package composition
• Phase of mission
• Time restrictions

• Friendly capabilities
• Package composition
• Anticipate problems
• Builds picture
• Interprets sensors

• Phase of mission
• Time restrictions
• ROE
• Time management

8
The MEC PayoffDefining Individual, Team and Team
of Teams Training Federates

• Daily tng for flights crews 2-ship ops is a
  quantum leap in sim tng

9
How Competency Based Syllabi Are Developed and
Evaluated

• MECs defined
• IPs and researchers define objectives
• Syllabus formed
• Scenarios/experiences
• Subject-matter expert validation
• Transferred to field
• Performance tracked

• A systematic process for learning
• Define competencies ?
• Specify objectives ?
• Identify triggers (experiences) ?
• Identify actions
  and outcomes ?
• Design scenario ?
• Fly scenarios ?
• Replay, debrief, assess ?
• Repeat and evaluate

10
Example metrics

• Kill ratios, missile hit ratios, distance of
  misses
• Time spent within MAR and N-pole
• Aim-9 and AMRAAM Clear Avenue of Fire measures
• AMRAAM employment measures, such as launch
  altitude, range, loft angle, mach, F-pole, DLZ
  reading, g-loading, A-pole
• Wingman position
• Chaff/Flare usage
• Sensor handling
• Mic usage
• Others

11
Application

• In the good old days, Swedish Airforce had 30
  type mission descriptions (blue prints), but new
  skills and knowledges are required for PSO
• Many possible applications for Swedish Armed
  Forces, e.g., Start of mission readiness
  certification process
• MEC process focuses at the right level of
  analysis
• Pilots from F17 (SWAFRAP), F7 and F21 very
  positive
• Possible integration into Swedish TTP document

12
MEC in development process
MEC
MEC
13
Way Ahead

• Develop a comprehensive training accreditation
  program
• Credit each training method / medium for the
  value added
• Develop / use right tools for the right purpose
• Train proficiency
• Exercise the system
• Incorporate training technology and science
• Institutionalize competency-based training
• Multinational ops defined standards
• Keep the value added parts of current training
• Management, policy, sustainment

14
Questions?
Winston.bennett_at_mesa.afmc.af.mil and
Martin.castor_at_foi.se