Kai Virtanen, Janne Karelahti,

1
Influence Diagram Game Modeling of Maneuvering
Decisions in One-on-One Air Combat

• Kai Virtanen, Janne Karelahti,
• Tuomas Raivio, and Raimo P. Hämäläinen
• Systems Analysis Laboratory
• Helsinki University of Technology

2
Maneuvering decisions in one-on-one air combat
¼
Outcome depends on all the maneuvers of both
players Þ Dynamic game problem
Objective Find the best maneuvering sequences
with respect to the overall goals of a pilot! -
Preference model - Uncertainties - Behavior of
the adversary - Dynamic decision environment
3
Influence diagram (ID) (Howard et al. 1984)

• Directed acyclic graphs
• Describes the major factors of a decision problem
• Widely used in decision analysis application
  areas

Time precedence
Informational arc
Alternatives available to DM
Decision
Random variables
Conditional arc
Chance
Probabilistic or functional dependence
Deterministic variables
Conditional arc
Deterministic
A utility function
Conditional arc
Utility
4
Influence diagram (continued)

• State of the world is described by attributes
• States are associated with
• Utility
• Probability
• Utility is a commensurable measure for goodness
  of attributes
• Results include probability distributions over
  utility
• Decisions based on utility distributions
• Information gathering and updating using Bayesian
  reasoning

5
Decision theoretical maneuvering models

• Single stage influence diagram (Virtanen et al.
  1999)
• Short-sighted decision making
• Multistage influence diagram (Virtanen et al.
  2004)
• Long-sighted decision making
• Preference optimal flight path against a given
  trajectory
• Single stage influence diagram game (Virtanen et
  al. 2003)
• Short-sighted decision making
• Components representing the behavior of the
  adversary
• New multistage influence diagram game model
• Long-sighted decision making
• Components representing the behavior of the
  adversary
• Solution with a moving horizon control approach

6
Influence diagram for a single maneuvering
decision
Adversary's Present State
Adversary's Maneuver
Adversarys State
Measurement
Combat State
Present Measurement
Present Combat State
Situation Evaluation
Present State
State
Maneuver
Present Threat Situation Assessment
Threat Situation Assessment
7
Influence diagram air combat game
White
Black

• Goals of the players
• 1. Avoid being captured by the adversary
• 2. Capture the adversary
• Four possible outcomes
• Evolution of the players states described by a
  set of differential equations, a point mass model
• Evolution of the probabilities described by
  Bayes theorem
• Resulting game optimal controls
• - the cumulative expected utility is maximized
• - feedback Nash equilibrium

8
Multistage influence diagram game
Blacks viewpoint
Combat state
White's viewpoint
stage t-1
stage t
9
Moving horizon control approach
Players states at stage t
Truncated influence diagram game lasting stages
t, tDt,, tKDt
Dynamic programming
KDt length of the planning horizon
Game optimal control sequences over stages t,
tDt, , tKDt
ttDt
Implement the controls of stage t
Players states at stage tDt
10
Numerical example

• Symmetric initial state
• Whites aircraft more agile
• White wins

Black
White
Altitude, m
X-range, m
Y-range, m
11
Conclusions

• The multistage influence diagram game
• Models preferences under uncertainty and multiple
  competing objectives in one-on-one air combat
• Takes into account
• Rational behavior of the adversary
• Dynamics of flight and decision making
• The moving horizon control approach
• gt Game optimal control sequences w.r.t the
  preference model of the players
• Utilization
• Air combat simulators, a good computer guided
  aircraft
• Contributions to the existing air combat game
  formulations
• Several computational difficulties are avoided
• Roles of the players are varied dynamically
• Producing reprisal strategies
• Planning fighter maneuvers

12
References

• Virtanen, K., Raivio, T., and Hämäläinen, R.P.,
  "Decision Theoretical Approach to Pilot
  Simulation," Journal of Aircraft, Vol. 36, No. 4,
  1999.
• Virtanen, K., Raivio, T., and Hämäläinen, R.P.,
  "Influence Diagram Modeling of Decision Making in
  a Dynamic Game Setting," Proceedings of the 1st
  Bayesian Modeling Applications Workshop of the
  19th Conference on Uncertainty in Artificial
  Intelligence, 2003
• Virtanen, K., Raivio, T., and Hämäläinen, R.P.,
  "Modeling Pilot's Sequential Maneuvering
  Decisions by a Multistage Influence Diagram,"
  Journal of Guidance, Control, and Dynamics, Vol.
  27, No. 4, 2004.