Evaluation Plan

1
Evaluation Plan

• IPRC Evaluation Team
• Dr. Jeanie Alter
• Marcia Dias

2
Evaluation Basics

• CSAP goals
• 1) Prevent onset and reduce the progression of
  substance abuse
• 2) Reduce substance abuse-related problems
• 3) Build prevention capacity and infrastructure
  at the community level

3
Program Evaluation

• Program Evaluation - Determining the value or
  worth of a strategy
• Process Evaluation - monitoring the
  implementation of a strategy
• of curriculum lessons delivered or compliance
  checks conducted
• Outcome Evaluation - determining achievement of
  objectives related to perceptions, attitudes, and
  behaviors
• perceived peer approval of drug use, level of
  risk/harm associated with use, or use in the past
  30 days.

4
Getting Started

Outcome Objectives
Process Objective
5
Setting Objectives

• Expected outcomes
• Examine outcomes from EBP
• Communities Mobilizing for Change on
  Alcohol-Alcohol retailers increased
  age-identification checking and reduced sales to
  minors.
• Eighteen- to-20-year-olds were less likely to try
  to purchase alcohol, frequent bars, drink,
  provide alcohol to other teens, and be arrested
  for driving under the influence of alcohol
• Younger adolescents were not significantly
  affected by CMCA.

6
Setting Objectives

• Setting realistic outcome objectives
• Baseline rates from epi report
• HP2010 objectives
• 26-9 Increase the age (from 13.1 to 16.1 years
  of age) and proportion (19 to 29) of
  adolescents who remain alcohol free.

7
(No Transcript)
8
IPRC Assistance

• Bi-monthly onsite consultations and monthly
  telephone consultation
•  Mid-year and end-of-year feedback to Program
  Director, state-level evaluator, and DMHA
• Access to IPRC evaluation web page(s), online
  survey service, data analysis software, and
  materials from the IPRC Prevention Library.
  
• One on-site training and/or invitations to
  IPRC-sponsored trainings.
• As-needed phone consultation, IT support,
  research assistance, and document/tool
  development.

9
Workshop

• Divide into groups
• Group 1 (Jeanie) Tippecanoe, Monroe, Marion,
  Lake DFA
• Group 2 (Marcia D.) Wayne, Vigo, Delaware,
  Greene/Daviess
• Group 3 (Eric Wright) Geminus, Porter, Allen,
  St. Joseph
• Time to assist with
• Completing the logic model
• Selecting an intervention
• Drafting an evaluation plan (table and narrative)
• Design data collection tools