HMIS

1
HMIS Program Performance Measurement February
1, 2008

• Matt White, Abt Associates Inc.

2
Learning Objectives

• Participants will understand the concepts of
  performance measurement as they relate to
  individual homeless assistance programs.
• Participants will understand the role of HMIS in
  measuring performance and evaluating program
  objectives.
• Participants will understand how to use
  performance measurement as a tool for instituting
  and managing program improvement strategies.

3
What is Performance Measurement?

• Performance measurement is a process that
  systematically evaluates whether your efforts are
  making an impact on the clients you are serving.

4
Multiple Levels of Performance Measurement
5
Performance Measurement Process
Should we adjust how we spend our resources?
How do we document our efforts?
Should we add or change use of resources to
expand our impact?
What did our efforts achieve?
6
Framework for Converting Program Goals into
Outcomes
Outcome ()
7
Converting Program Goals into Outcomes Example

• Program Goal Exiting clients into stable
  housing

Step 3
Step 2
Step 1
Persons who exited during the past year (N 40)
10 persons obtained stable housing
Obtain stable housing
25 obtained stable housing at exit
8
Look Out for Ambiguous Concepts
Developing and measuring performance outcomes
often invites ambiguous concepts into the process.
For example, what do we mean by

• obtaining stable housing?
• obtaining employment?
• increasing income?
• accessing services?
• becoming more self-sufficient?

Which data elements and responses will count?
9
HMIS Data Elements Are the Building Blocks of
Performance Measurement
10
Wherever Possible Use HMIS to Define Your Concepts
Based on the Destination HMIS data element, we
can define stable housing (narrowly) using the
following response categories

• Emergency shelter

• Apartment or house that you own

• Transitional housing

• Staying/living with family

• Permanent housing

• Staying/living with friends

• Substance abuse facility or detox center

• Hotel or motel voucher paid for without ES voucher

• Hospital (non-psychiatric)

• Foster care home or group home

• Jail, prison or juvenile detention center

• Place not meant for human habitation

• Room, apartment, or house that you rent

• Other

• Dont Know

• Refused

11
Group Exercise
Employment Program The goals of the program are
to help unemployed clients obtain employment and
help employed women get better jobs. During the
past year, the program served 6 (unduplicated)
persons
12
Define the Base Population for Each Goal
Goal 1 Achieve employment at exit
Goal 2 Retain employment at exit
13
Calculate the Outcome for Goal 1

• Program Goal 1 Obtain Employment at Exit

Step 3
Step 2
Step 1
All unemployed persons at entry who exited (N 3)
Achieve employment
2 persons achieved employment
67 achieved employment
14
Calculate the Outcome for Goal 2

• Program Goal 2 Improved Employment at Exit

Step 3
Step 2
Step 1
Persons who were employed at entry and exited (N
2)
Improve employment
1 person increased earnings
50 gained better employment
15
Performance Measurement Questions

• Measurements of program effectiveness
• Length of time from referral to program
  enrollment
• Length of time from enrollment to termination
• Cost of completing the program (by client, by
  household)
• Number (and profile) of clients/households
  obtaining housing.
• Number (and profile) of clients/households
  maintaining housing.
• Number (and profile) of clients/households
  relocating to more appropriate/affordable
  housing.
• Number (and profile of households who become
  homeless after receiving services.
• Length of time in permanent housing.
• Comparisons of time, cost, outcomes, and results
  for different client pop.s (household type,
  disability status)

16
Summary of Program Performance Measurement