Visualization of IED TTPs

1
Visualization of IED TTPs

• James Cimino
• Chief Technology Officer, D2 TEAM-Sim

2
Agenda

• Brief Introduction
• The Birth of an idea
• Solution Objectives
• Functional Overview
• Demo
• Where Do We Go From Here

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
3
Who is D2?
Interactive Training, Education, Corporate
Communications

• Broadcast quality multimedia edutainment
• Provider to government and global leaders in
  healthcare, technology, financial services and
  other areas
• Unique combination of creative, production,
  education, marketing and technology
  professionals

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
4
The Tools We Create

• Video Documentaries
• Web-based Training Programs
• Blended Training Programs (incorporating
  classroom and web or other media)
• Marketing Training Rollouts to large audiences

And more!
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
5
Partial DoD Client List
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
6
The Birth of an Idea

• JIEDDO COTS Gaming evaluations
• RAND, 2007
• Sir, we are drawing in the _at_!ing dirt!
• Officer at I/ITSEC 2008
• Briefing to JIEDDO
• I/ITSEC 2008

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
7
Can we

• Allow a user to build a scenario
• Drag and Drop objects onto a 2D terrain
• Control the way the objects behave in a
  deterministic manner.
• Publish the file
• View the scenario in 3D

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
8
What looks Better?
B
A
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
9
Solution Goals

• Deployable Virtual Training Environment
• PC-Based
• COTS hardware and software
• Modular
• Low overhead
• Virtual simulations/gaming tools
• Easily transitioned to the Field
• Individual self-paced
• Team collaborative
• Cost effective
• Facilitates Transfer of Training

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
10
Solution Objectives

• Help close the Training gaps
• Created by rapidly changing enemys TTP
• The enemy changes TTP every 2 to 3 weeks
• Army Brig. Gen. Joe E. Ramirez, IED Defeat
  Seminar, Ft. Irwin
• The Flintstones are adapting faster than the
  Jetsons
• Rick Atkinson, Left of Boom
• Marine Corps Gazette
• Provide Initial and Sustainment Training
• 24-7 accessibility
• Realistic devices
• Home Station, pre-deployment and training In
  Theater
• Feedback

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
11
Solution Objectives

• Agile
• Facilitate the rapid and bi-directional
  distribution of evolving TTPs to the troops
• Home stationed
• Pre-deployment
• In Theater
• Net-Centric
• Provide information on-demand
• Right information
• Right place
• Right time!
• Enable timely war fighter decisions
• Enhance the Training Environment for Ground
  Combat Units
• Replicate complex environments
• The units are encountering today
• The units will encounter in the future

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
12
Data Flow
Start
New scenario is authored
Scenario pushed out to field.
Users access TTP
SME updatesscenario
Errors in TTP?
Yes
No
New Enemy TTP?
Yes
No
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
13
Scenario Builder

• 2D Top Down GUI
• Pallet of drag and drop objects
• Easy to create and edit TTPs
• Easy to distribute changes in TTPs over
  low-bandwidth connections
• Deploy only what has changed
• Minimum of an XML file
• Enables timely and accurate updates to friendly
  and enemy TTPs

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
14
What is a Scenario?

• Description
• Content that identifies the TTP and describes its
  use
• Terrain
• The representation of the environment that the
  TTP is to be portrayed
• Actors
• The actual components used to depict the TTP
  scenario, including
• Vehicles
• IEDs
• Soldiers
• Timeline
• central driving force behind all the actions that
  occur in the visualization.
• There will be one timeline for the scene itself
  and one for every actor within the scene.
• Events
• Actions to be taken by the various actors along
  the timeline

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
15
Upon Scenario Completion

• Publish the necessary files that can be
  consumed by the 3D Scenario Player
• These files will contain all actor, terrain and
  event information, including
• type
• starting position
• event type and time
• movement speeds

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
16
How Should It Work?
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
17
Map Nav Dir. Buttons Zoom Buttons
Terrain

Vehicles

Actors
These buttons can be clicked on to expand the
menu to see the items inside

IEDs

Misc

18
Map Nav Dir. Buttons Zoom Buttons
Terrain

Vehicles
-
These boxes will contain all 3D Entities
(actors) and Maps (terrains). Mouse over of
these objects should provide available information
Actors

IEDs

Misc

19
Map Nav Dir. Buttons Zoom Buttons
Object Placement
Terrain

Vehicles
-
Drag and drop functionality for placement of
objects. Once the X and Y location are
established a circular control for orientation
should appear around the unit to allow the user
to set the actors initial direction.
Actors

IEDs

Misc

20
Map Nav Dir. Buttons Zoom Buttons
Terrain
The Timeline 1 Layout

Vehicles

The timeline will be the central driving force
behind all the actions that occur in the
visualization. There will be one timeline for the
scene itself and one for every actor within the
scene.
Actors

IEDs

Misc

Each timeline will be labeled with the name of
the unit, a unique icon or both to show what
object the timeline refers to
Mouse Coord. X ?? Y ??
The red line represents the users current
position on the timeline. The user should be able
to move this line to scrub through the time
line. The positions and status of each unit
should be updated on the map appropriately as the
user progresses through the timeline.
21
Map Nav Dir. Buttons Zoom Buttons
Maps
The Timeline 3 Event Creation

Vehicles

Characters

1
2
Starting Point X 100 Y100
IEDs

Select End Point
Ending Point X 75 Y100
Misc

1
2
Move to Point
In this example a Move to Point event has been
selected for creation and the initial point is
marked on the map and the timeline. The point is
colored this shade of green to designate it as
belonging to this unit. Each unit will use its
own color on the map and timeline to remain
easily differentiable to the user at a glance.
The user will then be asked to select an end
point for the event.
Once the user has selected an end point the
application will calculate the amount of time
that this unit will take to cover this distance
and automatically populate the timeline with the
appropriately sized block .
Mouse Coord. X ?? Y ??
22
Map Nav Dir. Buttons Zoom Buttons
Terrain
The Timeline 4

Vehicles

Events will be shown by drawing dots at the end
points and creating a box in-between them to show
that the event is taking place during this time.
Events from different timelines can be tied or
grouped together in order to remain in the same
relative position if one or the other is moved.
Events can be ungrouped as well to allow
independent movement along the timeline. The user
will also have the ability to zoom in and out of
the timeline in order to isolate a span of time
as well as get a higher resolution view of the
events contained therein.
Actors

IEDs

Misc

1
2
Move to Point
When an event is moused-over information
pertaining to that event will appear. Type of
Event Start Time Units Current Position Event
Specific Information (i.e. Spline info, Duration,
etc.)
Mouse Coord. X ?? Y ??
23
3D Scenario Player

• 3D visualization of TTPs
• Ability to select the TTP to view
• Ability to select multiple camera perspectives
• Global
• Inside vehicles
• Forward
• Rear
• Ability to replay TTPs from any point in time
• Ability to submit feedback on TTP effectiveness

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
24
3D Scenario Player Features

• Reads all scene information from the published
  Scenario Builder files
• appropriate actors will be placed in their
  starting positions
• Event behaviors will be created for the requested
  actions.
• The user will have playback control
• Speed up or slow down time during the simulation
• Quickly review a TTP visualization
• Spend more time on a specific event within the
  visualization.
• Change vantage point
• Gods eye view
• Vehicle-specific view

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
25
Lets see a demo
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
26
Other Considerations

• Security
• Access control based upon user authentication
• TTP level
• Element Level
• Author, Reader, Editor
• Encryption
• Data Networks / Protocols
• Method of Delivery
• Web deliverable
• CD or DVD
• TTP 3D Player and Library
• Force-wide distribution
• Scenario Builder
• Limited distribution
• Alternate Viewer Platforms
• Integration with other systems

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
27
Whats Next?

• Data Sources
• LIDAR
• Google Earth
• Others???
• More Controls
• Playback
• Camera Controls
• Platforms
• iPhone
• Game Consoles
• Funding????

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
28

• Time-on-task is an important part of learning.
  The more time you spend rehearsing, exploring
  options, and studying outcomes, the better you
  will become at a skill. Games can add to that by
  encouraging soldiers to spend more time learning
  a skill.

Dr. Roger Smith, PEO STRI Video Games in Military
Training An Interview with Roger Smith by Alice
Atkinson-Bonasio August 29, 2008
D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
29
Train the Force

• As new tactics, techniques and procedures are
  developed, JIEDDO needs to train the force in
  theater for rapidly-deployed items and bring
  deploying troops up to speed prior to entering
  the theater.
• Defeat the network Defeat the device Train
  the force

D2 TEAM-Sim is a business unit of Appliedinfo
Partners, Inc., an SBE, WBE, SDB Business
30
Design Technology Effective Training