CLASS XIV

1
CLASS XIV

• Utilization of Evaluation Results, Other Issues
  and Trends

2
Upon completion of this class, students should
be able to

• Use impact data for accountability and marketing
  programs.
• Use process evaluation data for program
  improvement.
• Critically review own evaluation practice for
  improvement.
• Identify trends and issues within extension
  evaluation.

3
Evaluation Results

• Program outcomes and impacts
• Process evaluation data

4
Program Outcomes and Impacts

• Immediate outcomes
• Intermediate outcomes
• End results (Impacts)

5
Program Outcomes Impacts Can Be Used for

• Accountability purpose
• Marketing programs
• Making programmatic decisions
• Extension agents performance assessment

6
Accountability

• Evaluation results should be used to justify the
  resources invested in the program.
• Evaluation summaries could be used to inform key
  stakeholders and funding agencies about program
  results.
• This is important to secure their support for
  Extension.

7
Use of Impact Results for Marketing

• Outcome results are the benefits of a program
• Therefore, outcome and impact results can be used
  to
• Promote extension
• Recruit participants for future programs
• Market programs for potential funding agencies

8
Promote Extension

• Use available communication channels to inform
  stakeholders and public about evaluation results.
  This includes
• Writing impact statements and communicating those
  with stakeholders.
• Presentations
• Printing brochures
• Writing newspaper articles
• Publishing in newsletters
• Posting on the web
• Using local radio and TV programs

9
Recruit Participants for Future Programs

• When marketing brochures are developed for
  recruiting potential clients, it is important to
  include program evaluation results for
  highlighting program benefits.
• Quotes from participants generate powerful
  messages for potential audiences.

10
Market Programs for Potential Funding Agencies

• When applying for grants, it is important to
  share evaluation results for convincing potential
  funders about the success of programs.

11
Making Programmatic Decisions

• Impact evaluation results should be used to
  identify effective programs from ineffective
  programs.
• Based on the results, programs can be categorized
  into effective programs and ineffective programs.
  
• Effective programs are selected to expand and
  continue.

12
Extension Agents Performance Assessment

• Evaluation results witness the success or
  failures of extension programs.
• Therefore, evaluation results can be used as a
  criterion for extension agents performance
  assessment.

13
Process Evaluation Results

• Comparison of implementation data about inputs,
  outputs clients participation against targets
• Strengths weaknesses
• Constraints challenges
• Suggestions for improvements

14
Use of Process Evaluation Data for Monitoring
Programs

• Use of process evaluation data for fixing
  problems and guiding programs to achieve
  objectives is called program monitoring.
• Implementation data should be used to monitor
  programs throughout the implementation process.
• For example, if a program aimed to reach 150
  nursery farmers and reached only 75 farmers, then
  it is important to identify the reasons for the
  difference and fix it.

15
Use of Process Evaluation Data for Program
Improvement

• Program improvement is the main function of
  evaluation.
• Process evaluation tells
• What worked for the program and what didnt
• Challenges and barriers
• What changes are needed to achieve desirable
  performance levels
• This information should be incorporated into next
  program for achieving better results.

16
Meta-Evaluation

• Critical review of an evaluation is called
  meta-evaluation.
• Meta-evaluation is helpful to identify strengths
  and weaknesses of an evaluation.
• Critical review of every evaluation step is
  helpful for someone to identify strengths,
  weaknesses, problems and limitations of an
  evaluation.
• Meta-evaluation is helpful to identify problems
  and improve evaluation practice.

17
Extension Evaluation Trends

• Evaluation is becoming an essential part of
  extension programming.
• Extension stakeholders are demanding for KASA
  changes and higher levels of outcomes.
• Cost-benefit analysis is becoming an important
  part of evaluating programs.
• Extension organizations are adopting evaluation
  favored management policies.
• Technology is widely used in conducting
  evaluations.

18
Extension Evaluation Issues

• Lack of capacity to conduct quality evaluations.
• Lack of training
• Lack of tools and learning resources
• Lack of knowledge to design tools and analyze
  data
• Under utilization of evaluation results
• Lack of evaluation favored organizational culture

19
Summary

• Objectives
• Evaluation results
• Accountability
• Marketing
• Programmatic decision making
• Personnel appraisals
• Program improvement
• Program monitoring
• Evaluation trends
• Evaluation issues