VICTORIA CHILDREN FOUNDATION MONITORING AND EVALUATION SYSTEM

1
VICTORIA CHILDREN FOUNDATIONMONITORING AND
EVALUATION SYSTEM
March 2009
2
VICTORIA CHILDREN FOUNDATION

• Victoria Children Foundation (VCF)
• works to improve the quality of life of orphans
  and abandoned children in Russia.
• Founded in 2004
• Private Family Foundation
• Employs 53 staff
• Operates in 42 regions of Russia

3
VICTORIA CHILDREN FOUNDATION
MISSION STATEMENT We work to bring back genuine
parent love and care into disadvantaged families
we support children in their physical, spiritual
and intellectual development and help them to
obtain emotional balance, self-confidence and
trust.

• PROGRAM AREAS
• SOCIAL ORPHANGOOD PREVENTION
• FAMILY PLACEMENT OF ORPHANS AND ABANDONED
  CHILDREN
• SOCIAL AND LIFE SKILLS DEVELOPMENT OF CHILDREN IN
  PUBLIC CHILD CARE
• VOLUNTEERISM

6,5
CHILDREN REACHED
FINANCING (mln euros)
9900
6734
3,5
3851
2,4
2007
2008
2006
2006
2007
2008
4
ME FRAMEWORK OUR APPROACH
IMPACT
Performance monitoring allows to track how well
we are operating and programs are implemented
Program evaluation examines achievements of
program objectives in the context of other
aspects of program performance
5
ME FRAMEWORK PROGRAM AND ORGANIZATIONAL LEVELS
PARTICIPATION
INPUT
ACTIVITIES
OUTPUT
OUTCOMES
IMPACT
RESOURCES
PROGRAM PERFORMANCE
BENEFICIARIES
EXTENT TO WHICH GOALS HAVE BEEN ACHIEVED
PROGRESS TOWARD ACHIEVING IMPACT
EXECUTION OF ACTIVITIES AND OPERATIONS
ACTIVITIES PROCESSES PROCEDURES
ORGANIZATION CAPACITY
PARTNERS CO-IMPLEMENTERS
ORGANIZATIONAL PERFORMANCE
6
Performance measurement tool LOGFRAME

• Logic of the program strategy and indicators to
  monitor

Goal Objectives Outputs
Program Areas
Programs
Goal Objectives Outputs
Goal Objectives Outputs
Goal Objectives Outputs
Goal Objectives Outputs
Projects
Goal Objectives Outputs
7
Performance measurement tool BALANCED SCORE CARD
Social result
Expand the support
Restore the support
Preserve the support
Create the support
CHILDREN HAVE PRESERVED THE POSSIBILITY TO LIVE
IN THEIR BIOLOGICAL FAMILIES
CHILDREN LIVE IN FOSTER FAMILIES OR IN FAVORABLE
FAMILY ENVIRONMENT AND IN FOSTER_CARE
ADVANCING VOLUNTEERISM AS A SHARED SOCIAL VALUE
CHILDREN IN RESIDENTIAL CARE HAVE AN OPPORTUNITY
TO POSITIVELY DEVELOP
CREDIBILITY WITH CIVIL SOCIETY ACTORS
Stakeholders
RELATIONS WITH GOVERNMENT REGULATORS
FUNDER RELATIONS AND DIVERSIFICATIONS
VOLUNTEER ROLES AND RELATIONS
Process
PRODUCTIVITY AND EFFICIENCE
ORGANIZATIONAL OUTPUTS
ORGANIZATIONAL LEARNING AND INNOVATION
Resources/ potential
STAFF MORAL, CAPACITY, DEVELOPMENT
FINANCIAL INTEGRITY
8
PROGRAM RESULTS FRAMEWORK
Program impact Level
Improved Quality of Life of Orphans,
Abandoned and at Risk Children in Russia.
Program Outcome Level
Community Members / Orphans Increasingly Act On
Opportunities to Volunteer
Orphans Live and Develop in Supportive
Institutional Environments Assisted By
Caring/Responsible Parent Alternative Staff
At Risk Children Remain with/are Raised in
Supportive Environment by Biological Parents
Orphans and Abandoned Children Live with/are
Raised in Supportive Environments By
Caring/Responsible Parent Alternatives
Corporate and Other Citizen Volunteer Program for
Orphans Expanded
Program Output Level
Social and Life Skills Program Implemented Effect
ively in All Assisted Orphanages
Regional Projects for Family Placement Implemented
Effectively in All Locations
Comprehensive Patronage Pilot Project
Effectively Implemented in Two Rayons of Moscow
Orphan Participation In Community
Events/Service Programs as Volunteers Expanded
Project Output Level
Sports and Health Program Achieves its Planned
Results
Labor and Professional Skills Development Program
Achieves Its Planned Results
Home for Adequate Living Project Achieves
its Planned Results
Gifted Children Program Achieves Its
Planned Results
Social Skills Development Program Achieves Its
Planned Results
9
COMPREHENSIVE MONITORING AND EVALUATION SYSTEM
Purpose
- Manage for Results within organization -
Understand performance and problems - Timely
corrective action/redesign
Project Output Level
Exists/Is Being Used
- Demonstrate benefits to individuals - Mobilize
support and assistance - Understand performance
and problems - Timely corrective action/redesign
Program Output Level
Exists/Is Being Used
Program Outcome Level
- Demonstrate benefits to individuals -
Demonstrate benefits to community - Mobilize
support and assistance - Understand performance
and problems - Timely corrective action/redesign
- Demonstrate benefits to individuals -
Demonstrate benefits to community - Mobilize
support and assistance
Program Impact Level
10
PROGRAM OUTCOME AND PROGRAM IMPACT LEVELS
Challenges
Results are long term in nature. Results occur
after Orphans and At Risk Children graduate from
Victoria Foundation support, i.e., leave and live
as adults. Longitudinal research does not
provide information on impact needed in the short
and medium term Explaining Victoria
Foundations Program Impact requires a specially
designed research which is difficult and
expensive to implement
?
?
?
?
MSI
11
PROGRAM OUTCOME AND PROGRAM IMPACT LEVELS
Optimal Solution
? Monitor valid predictors of longer term
program outcomes with children currently
assisted by Victoria Foundation annually ?
Longitudinal tracking of changes in predictors
of social outcomes on children across program
years and after graduation from Victoria
Foundation assistance using low cost alumni
self-reporting monitoring tools. ? Agree on
whether to use social return on investment
approach on the program impact level
MSI
12
ME AS PART OF PROGRAM MANAGEMENT SYSTEM
MAIN PRINCIPLES

• Performance measurements and evaluations are
  conducted at various levels (project-level,
  program-level, program area- level)
• - Every project undergoes outcome and /or
  process evaluation
• Evaluations are conducted by external experts
• Evaluators are selected through open tender
  procedure
• Performance measurement results and evaluation
  findings are discussed at cross-program level
• Participative approach is applied at every stage
• Results and findings are communicated and
  reported to external and internal stakeholders
• The results and findings are made public

• It is embodied in Program Management Procedures
• It is part of the Foundation Annual Plan of
  activities
• (with allocated resources staff and
  budget)
• Decisions on further improvements are based on
  critical reflection on the lessons learned

13
WHY ME IS IMPORTANT What are the benefits?

• Strengthens accountability deliver greater
  transparency to our stakeholders, clearly
  communicate the results to the Board of Directors
  and donor community
• Promotes learning culture focused on improving
  services delivery and program effectiveness
• Improves foundations management, understanding
  of our works results, our success and failure
• Contribute to shared understanding of
  organizational goals and objectives (prog/admin,
  cross-program)

14

• THANK YOU

Elena Konovalova Head of Monitoring and
Evaluation Department Victoria Children
Foundation