Event Processing in Complex RealTime Applications Break Out Group

1
Event Processing in Complex Real-Time
Applications Break Out Group

• EDA Symposium
• 14-16 March 2006
• Draft
• IBM Research
• Gartner
• Stanford University

2
Panellist

• Noah Ed Loy - Brigadier General (Ret) USAF
  (MITRE)
• Josh Collens - MITRE Corp
• Roger Loeb - MarTech Group
• Elan Oren - LeanWay
• Ronen Perlmuter - LeanWay

3
Application's Types

• DoD Command and Control
• Telecom
• Finance

4
What is Real-time?

• Is a property
• Guaranteed deterministic completion of an
  operation
• Is not necessarily
• Fast (low latency)
• But often appears in conjunction with latency
  requirements.
• The key is recognizing that the deadline is
  guaranteed.
• And if not achieved, requires some other action
  be taken, some exception be raised

5
Value of Using RT Event Processing

• In specific Domain Spaces i.e. DoD can not meet
  2010 Mission Requirements without RT CEP
• Address the latency Gap
• Become more proactive to predict future events
• Modelling based on historical data and current
  understanding of event cloud to predict near term
  outcomes with updating for continuous learning
• Real-time is relative term depending on required
  predicted outcome
• Extract to higher levels of abstraction for
  inference

6
Problem Space

• Inability to manage Latency and Determinism
• Lack of tools
• Large Data ingest
• High message traffic
• Large Legacy Domain
• Lack of temporal interlock
• Complexity or perception
• Ability to abstract
• Domains for determinism is a relative term
• Reactive versus proactive
• Take RT Event and compare against massive amount
  of history
• Simple patterns
• Making incremental change based on incremental
  pieces of data
• Must think of the problem at different levels of
  the stack (Vertical versus Horizontal)

7
Examining the Layers
Human
Model Optimization
Events
Persistent Queries

• Simple Patterns
• SQL
• XPath
• Filters

Real-time data
Peta-Bytes (History)
8
Market Drivers, Motivators, Challenges and Entry
Points

• Drivers
• Predictability
• Adaptability
• Dynamic
• Latency and Determinism management
• Motivators
• Tactical as well as strategic information
  advantage
• Get inside competitive decision loop
• Challenges
• Legacy Integration
• Cost
• Complexity
• Entry Points
• Start small

9
Market Segment Real-Time Event Processing

• Federal (DoD, DHS, Intelligence)
• Financial
• Industrial Automation
• Gaming
• Health Care

10
Where do we go from Here ?

• Better understanding of respective Domain space
  requirements and constraints
• Standards
• Tools
• Modelling
• Development
• Trace and Monitoring