Evaluating Behavior Change: Demonstrating the Effects of Training

1
Evaluating Behavior Change Demonstrating the
Effects of Training

• Patricia Gonzalez, OSEP

2
Big Picture

• The need for program evaluation within Federal
  agencies, including OSEP, has never been more
  pressing
• For IDEA Part D, OSEP depends on individual
  grantees for evidence of program effectiveness
• The vast majority of OSEP projects carry out at
  least one personnel preparation, professional
  development or training activity as part of their
  project therefore
• OSEP depends on grantees to produce evidence of
  the effectiveness of training activities

3
Logic Model Elements

• INPUTS
• ACTIVITIES
• OUTPUTS
• OUTCOMES

4
OUTCOMES
5
Issues in Measuring Behavior Change

• Who all participants or a sample
• What
• Use of evidence-based practices
• Fidelity measures to ensure practice is performed
  as trained
• Measures that demonstrate effectiveness of
  training (e.g., comparisons pre/post, with
  non-participants, against standard protocols or
  criterion)

6
Issues in Measuring Behavior Change

• Where in actual or simulated settings
• How observations, scored video tapes,
• self-recorded data
• Setting Events organizational support
• for change