Measuring and Monitoring Project

1
Goal Attainment Scaling

• Measuring and Monitoring Project
• Objectives

December 11, 2007 Ella Taylor Tom
Udell National Consortium on Deaf-Blindness The
Teaching Research Institute Western Oregon
University
2
Objectives for Webinar

• Understand what GAS is including benefits and
  uses.
• Understand the steps for developing a GAS.
• Understand how to implement a GAS to track
  progress.

3
(No Transcript)
4
What is Goal Attainment Scaling (GAS)

• A tool for tracking and recording the achievement
  of project activities.
• Regular use of a GAS across objectives and
  activities can be used to determine if
• (a) timelines are being met,
• (b) milestones or bench marks are met on a
  regular basis,
• (c) resources need to be reallocated,
• (d) new strategies are needed due to a shift from
  an intended outcome, or
• (e) new targets need to be developed with project
  officer.

5
Benefits of GAS

• Monitors improvement and achievement.
• Can be applied to all project outcomes and
  activities at any and all stages of
  implementation.
• Enables comparison between very different
  activities.
• Aligns with OSEPs Grant Performance Reports.
• Provides proposal reviews a snapshot of targets
  across all activities.

6
GAS Scores or Degrees of Achievement

• Level 2 Much higher than anticipated outcome.
• Level 1 Higher than anticipated outcome
• Level 0 Met anticipated outcome.
• Level -1 Less than anticipated outcome
• Level -2 Much less that than anticipated
  outcome

7
(No Transcript)
8
Comparison between very different activities.

• Difficult to compare outcomes of
• a. 85
• b. 25
• c. December 1st
• Giving a numeric value to each enables
  comparison
• a. 85 becomes 0
• b. 25 becomes -2
• c. December 1st becomes 1

9
Example of GAS (in back of Handout)
10
Steps in Developing a GAS

• Step 1 Develop objectives for the project.
• Step 2 Develop activities needed to met or
  complete each objective.
• Step 3 Set an anticipated outcome for each
  activity.
• Step 4 For each outcome, set targets for each
  degree of achievement.

11
Step 1 Develop objectives for the project.

• Driven by the RFP priorities the project must
  address.
• Statements describing each aspect of what a
  project will do.
• Lead to achieving the projects overall outcome
  or goal.
• Outline accomplishments that are critical for the
  project to be considered successful.
• Should be stated in terms of observable
  performance.

12
Do I develop degrees of achievement for
objectives?

• Average degree of achievement for anticipated
  outcomes.
• Percentage of anticipated outcomes met.

13
(No Transcript)
14
Step 2 Develop activities needed to meet or
complete each objective.

• Clear and specific language.
• Discrete steps.
• Logically lead to accomplishment of the
  objective.

15
Step 3 Set an anticipated outcome for each
activity.

• Set a standard of quality and/or quantity.
• Stated in observable and measurable terms.
• Acceptable evidence that the activity was
  completed.

16
How do I determine criteria?

• Use previous project data.
• Consider funding level.
• Consider available resources.
• Use project staff experiences.
• Use advisory committee input.

17
Do I set up the GAS for a quarterly, annual or 5
year review?

• Dependents on what decisions you need to make and
  what data you need to make decisions.
• Criteria for anticipated outcomes should be based
  on review period.

18
Step 4 For each outcome, set targets for each
degree of achievement.

• For each identified outcome targets are set for
  the degree of achievement scale.
• Level 0 Met anticipated outcome is simply the
  criteria set within the outcome.
• Levels -1 and -2 are lower degrees of success or
  achievement using the same measurement or
  criteria type. Conversely,
• Levels 1 and 2 are higher degrees of
  achievement that go beyond what is satisfactory
  for meeting the outcome and completing the
  respective activity.

19
Implementation

• Summarize and record data.
• Identify degree of achievement.
• Reflection.
• Planning.

20
Incorporating outcomes into project activities
Beginning Identifying what needs to be done
and selecting OPIs related to the needs.
Middle (1) Planning and delivering TA to meet
the needs. (2) Planning on how you will evaluate
effort.
End Documenting and evaluating your efforts to
determine your effects.
21
Reporting Example Effort Language

• Number of TA providers who received training
  about goal attainment scaling (n 50)
• Number of workshops conducted focusing on
  strategies to improve the use of goal attainment
  scales (n 4)

22
APR Example Effect Language

• Mean rating of TA providers reporting increased
  knowledge about goal attainment scales (m 4.0
  (5.0 scale) APR 40/50
• Mean rating of TA providers reporting progress in
  implementing strategies to use goal attainment
  scaling (m 3 (5.0 scale))APR 30/50)

23
APR (ED 524B report) languageProject Objective
Assess the impact of TA D activities
24
APR (ED 524B report) languageProject Objective
Assess the impact of TA D activities
25
APR (ED 524B report) languageProject Objective
Assess the impact of TA D activities
26
Example of GAS (in back of Handout)