CDC Perspective on Program Evaluation

1
CDC Perspective on Program Evaluation

• Maureen Wilce
• Field Services and Evaluation Branch
• Division of TB Elimination

2
What is Program Evaluation?

• systematic investigation of the structure,
  activities, or outcomes of TB control programs
• explores how and why those activities and
  outcomes are occurring
• promotes effective change and builds on existing
  program strengths

3
The time for evaluation is now

• History of data use for evaluation
• Californias TIP process
• Other program evaluation activities
• 2000 Institute of Medicine Report Ending Neglect
  calls for Measuring and reporting progress toward
  the elimination of TB
• National push to increase efficiency and
  effectiveness
• 2005 Cooperative Agreements explicitly require TB
  programs to self-evaluate

4
Why is Evaluation Needed More than Ever?

• Progress toward eliminating TB has slowed.
• New populations present new challenges.
• Resources are constrained.
• Evaluation is a core program function.

5
Benefits of Program Evaluation

• Evaluations help TB programs
• manage resources and services effectively
• understand reasons for performance
• assess and improve existing program practices
• build capacity
• plan and implement new activities
• demonstrate the value of their efforts, and
• ensure accountability

6
Using the CDC Framework forProgram Evaluation

• Evidence based
• Flexible and adaptable
• Promotes a participatory approach
• Focuses on using evaluation findings

6
7
Step 1 Involving Stakeholders Throughout the
Evaluation

• Stakeholders may be involved in
• Explaining the process and background
• Identifying priorities
• Collecting data
• Interpreting findings and developing
  recommendations
• Implementing results

8
Step 2 Describe the Program

• Creates a shared understanding of program
  activities and intended effects
• Describes how the program fits into the larger
  context
• Fosters discussion on
• common definitions and terms
• programs ability to make changes

8
9
Using a Logic Model to Describe TB Program

• A logic model is
• a graphic representation of the intended
  relationships of a programs activities and their
  intended effects
• a disciplined road map denoting the substance
  of a program and what it expects to achieve

10
(No Transcript)
11
Step 3 Focusing the Evaluation and Identifying
Evaluation Priorities

• Select one program component in an area that can
  most benefit from evaluation
• What are the top priorities of the program?
• What information is needed and why?
• How will the information be used and who will use
  it?
• Californias focus How well do California TB
  control programs evaluate contacts to
  smear-positive cases?

12
Step 4 Collect Data

• Select indicators to answer evaluation questions
• Select data sources
• Use existing data sources
• Collect additional data

13
Step 5 Justify Conclusions

• Analyze data
• Interpret results
• Stakeholders judge the results
• Make feasible, useful recommendations

14
Step 6 Ensure Use

• Share findings with stakeholders
• Develop action steps
• Implement recommendations
• Plan for re-evaluation

15
Using Evaluation to Improve Programs

• Highlight effective program components
• Recognize achievements
• Replicate successes
• Assess and prioritize needs
• Target program improvements
• Advocate for the program

16
Conclusions

• Evaluation is a way to make our program more
  accountable and use data for improvement.
• It should not be an overly-complicated or a scary
  process.
• Evaluation is a participatory process
• You have an important role!