Suggested Analysis Components for IAI CMU Studio Project

1
Suggested Analysis Components for IAI CMU Studio
Project
A. Gurson 09 September 2004
2
The Analysis Triad
3
Parsers What data do we have?

• Convert raw input data into structured data
• Usually one parser for each type of input data
• Store parsed data into structured (but
  uncorrelated) databases
• Could have some primitive internal correlation to
  generate structured data types from multiple raw
  data fields

4
Models What data are we expecting to have?

• Digitized Domain Knowledge
• Can be manually entered by an expert user or
  generated by a correlator from historical data
• Represents known trends or anomalies (i.e. the
  magnetic field over X lat Y lon always causes a
  satellite to temporarily lose communication
  capabilities)
• May need to be updated over time as correlator
  discovers consistent discrepancies between the
  model and parsed data

5
Correlators How do they differ?

• Compare parsed input data against model to
  determine possible anomalies or discrepancies
• Could be used to generate model from scratch from
  historical data
• Could have any number of correlators across
  different data sets, each looking for different
  trends/discrepancies
• Trigger communications (i.e. JMS events) with
  users when anomalies are detected
• Store correlated output data in correlated
  database

6
Possible Architecture
Event Channel
User 1
Receive Anomaly Events
Input Domain Knowledge Into Model
User n
GenerateAnomalyEvents
Query/ViewCorrelated Data
Query/View Raw Data
Models
M
M
Parsed Data
Correlated Data
PD
PD
PD
CD
CD
CD
ReadModel
C
Read Raw Data
P
P
P
Parsers
Correlators
C
Generate Model
Raw Input Data