Phrenology Forum

1
2000 Spring SimulationInteroperability
WorkshopOutbrief Session
2
Federation Performance Session

• Duncan Miller, Chair
• Phil Zimmerman, Panel Chair

Total attendance 120 Papers and
presentations 3 Panel discussion on federation
performance
3
Goals for this Workshop

• Review metrics for characterizing
• Federation performance
• Federate performance
• Run-Time Infrastructure performance
• Discuss scalability of performance with
  federation size and complexity
• Consider lessons learned from the
  implementation, instrumentation, and analysis of
  the performance of diverse federations

4
Presentations

• Federation Performance Metrics Richard
  BriggsTutorial (condensed version)
• 00S-SIW-025 Optimizing the David
  ProchnowPerformance of an AnalysisFederation
  (Pegasus)
• 00S-SIW-058 DMSO and Pitch Rune SjostromRTI
  Performance for Real-TimeAir Entity Updates
• Panel discussion - authors and invited experts

5
Key Points

• Which performance metrics are important depends
  on the nature and objectives of the simulation
• Analysis federation (025) Maximize number of
  runs in the available time to improve
  statistical reliability of results and
  conclusions
• Real-time federation (058) Maximize number of
  entities that can be included within latency
  limits
• The real performance bottlenecks often turn out
  to be quite different from the initial suspects
  What helps a lot in one application mav have no
  effect in another.
• Instrument and analyze your federation collect
  and analyze data before drawing conclusions.
• Continue this topic as a special session or
  virtual forum in future SIWs

6
Which performance metrics are important depends
on the nature and objectives of the simulation

• Explanation performance turns out to be a
  very broad and multi-dimensional concept.
• Recommendation Define performance metrics that
  are critical for various purposes and classes of
  simulations

7
The real performance bottlenecks often turn out
to be quite different from the initial suspects

• Explanation In complex systems, the symptoms
  may be far removed from their underlying causes
• Recommendation Develop easy-to-use
  instrumentation tools and systematic approaches
  for evaluating federation behavior

8
Continue this topic as a special session or
virtual forum

• Explanation Over 90 of attendees indicated
  they would attend future sessions on this topic
• Recommendation Include this topic in the next
  Call for Papers