Test and Evaluation T

1
Test and Evaluation (TE) ForumIntroduction

• Geoff Sauerborn (TE Chair)
• 4 April 2006

2
TE ForumMission

• SISO
• Standards Development
• Education Idea Exchange
• Conference Committee, Simulation Interoperability
  Workshops (SIW), SIW Tutorials
• TE forum
• Education historically TE forums SISO niche
• Others sharing how they have solved MS TE
  issues
• Sharing of good ideas
• Applications of supporting technologies

TE Forum
3
TE ForumMission

• The Test Evaluation (TE) forum addresses uses
  of distributed simulation in test and evaluation
  (TE), including the integration of live entities
  with virtual and constructive simulations the
  integration of hardware-in-the-loop (HWIL),
  Integrated Systems Test Facilities (ISTFs), and
  other TE facilities with distributed
  simulations the use of simulation to test and
  evaluate C4ISR, Systems of Systems (SoS), Family
  of Systems (FoS), and interoperability and
  performance issues in using distributed
  simulation in TE applications.

4
TE ForumSupport to Standards Development

• Do no harm
• Dont make conflicting ambiguous standards
• Make an impact
• Not an intellectual exercise
• Dont create standards that no one knows about or
  cares about if they did know

Ø
Ø
Ø
5
TE ForumSupport to Standards Vision

• Do things that make sense
• When we do work towards a standard we shall make
  sure it has impact.
• We dont have to develop a new standard to
  support standards development
• Use Case studies
• Reporting on the impact that existing or
  developing standards have on TE

6
TE ForumSupport to Standards Vision

• Big targets of opportunity
• Modeling and Simulation in Distributed Test
  Environments
• How to better manage the data that is used in
  acquisition and MS in support of acquisition
  decisions.
• Collaborative Environments (CEs) "common set of
  data" "common tools" that represent the "thing"
• Distributed Product Descriptions (DPP).
• Distributed Systems Engineering Environment
  (DSEE)
• Distributed Mission Operations (DMO)
• How can we help?

SAPD
TRAIN
7
Data data data

• Areas of interest?
• Data standards (for MS interoperability)
• Follow-on Study group to the ANPDRS study group.
• VV impact data pedigree. JSF/DMSO report

Source Improving Information Quality and
Consistency for Modeling and Simulation
Activities, I/ITSEC 2004
8
Welcome

• TE Planning and Review Panel (PRP) Evaluators
• U.S. Army (1) Geoff Sauerborn (chair)
• U.S. Navy (1) Arman Tchoubineh (vice chair)
• Industry U.S. (1) Sharon Hardy (secretary)
• Industry U.S (1) Mike Charnoky
• ELECTIONS COMING ARE HERE
• SELF NOMINATE! (17 April - 5 May)
• WE are ALL eligible to vote and RUN.

9
WorkshopSessions

• TE Test Beds and MS Interoperability
• Large Distributed Test Environments The Big
  Picture
• Joint sessions with the RDE SAPD Forums (in
  Salon A1 back here)
• Standards Impact and Recommendations
• Lessons Learned
• Advancing Standards
• Frameworks Traceability and Confidence
• Joint session w/VVA

10
This morning

• TE Test Beds and MS Interoperability
• 0830-1000
• 114 TE in the Virtual World - David R. Pratt
• 103 Live-Virtual-Constructive (L-V-C) Fusion and
  Data Collection in a Classified Distributed Test
  Environment using the Test and Training Enabling
  Architecture (TENA) - Ryan Norman
• 126 Current to Future Force Test Bed - Corde
  Lane
• 1030-1200 move to Salon 1A (RDE TE)
• 104 Army Modeling and Simulation Infrastructure
  Characterization Preliminary Results - Max
  Lorenzo
• 038 Development of a Communications Effects
  Server Framework - Dennis Bergin
• 028 DIS Attributes - The Final Bridge To HLA Is
  Cross - Frank Hill

In Salon 1A
11
Tuesday Afternoon
- The Moody Blues

• Large Distribute Test Environments The Big
  Picture
• 1330-1500 Back here Salon 10 (TE and SAPD)
• 060 Distributed Test Event 5 in Support of the
  Army Cross Command Collaborative Effort and
  Future Combat System Integrated Test and
  Evaluation - Ralph Liebert
• 061 Technical Aspects of the Multi-Service
  Distributed Environment to Support Joint Test and
  Evaluation - Ralph Liebert
• 074 A Mixed Architecture for Joint Testing -
  Michael O'Connor Salon
  1A
• 1530 after the break Salon 10
• 099 Technical Challenges for a Seamless,
  Distributed, Live-Virtual-Constructive
  Environment for Testing Human Performance - Paul
  Tennant

In Salon 1A

• (TE and SAPD and RDE)

12
This afternoon

• Standards Impact and Recommendations
• 1600-1700
• 052 The Silent Battlefield - Let Voices Be Heard
  and Shots Ring Out! Frank Hill
• 004 An Optimized Multi-Instance Approach to
  High-Fidelity HLA Simulations with Strict Timing
  Requirements Jeff Lyons

13
Tomorrowmorning

• Lessons Learned
• 0830-1000
• 100 Integration of Live Assets in a Classified
  Distributed Test Environment Ryan Norman
• 021 Some Tactics, Techniques and Procedures for
  Simulating and Analyzing Net-centric Warfare
  Concepts - Representing Airspace Management Monte
  Porter
• 022 Some Tactics, Techniques and Procedures for
  Simulating and Analyzing Net-centric Warfare
  Concepts Managing the Network, and Working
  Together Monte Porter
• Advancing Standards
• 1030-1200
• 101 TADIL TALES Joe Sorroche
• 102 TADIL TALES II Joe Sorroche
• 018 Keeping up with the Military Scenario
  Definition Language (MSDL) Rob Wittman

14
TomorrowAfternoon

• Frameworks Traceability and Confidence
• Joint VVA TE
• 1330-1500
• 065 Instantiating the Missions and Means
  Framework Tools and Utilities, Standards and
  Specifications John Kearley
• 066 An AHP-Based FSE Method for Evaluating the
  Credibility of LSCS Simulation Shi-xia Sun
• 058 Process Modeling and Formalization for
  Credibility Evaluation of Large-Scale Complex
  System Simulation Shi-xia Sun

15
Your Forum

• You decide what are the areas of interest
• Help us guide this forum
• Be involved continue to submit papers,
• Study Groups Start one, join one.
• Product Review Panel Participate formally or
  informally.
• TE Reflector on www.sisostds.org.

16

• Share ideas
• Talk to each other

17
Backup slides
18
Data Changes ThroughoutAcquisition Lifecycle
DoDI 5000.2 - Figure 1. The Defense Acquisition
Management Framework
Data Updates
Achievable Technology Performance
Concept Refinements
Prototype
Limited Production
Product Improvements (PIP)