Welcome to the Common Measures Webinar

1
Welcometo the Common Measures Webinar
Press 6 to mute your telephone Please dont put
your phone on HOLD In the chat box please enter
and send us your MWA or organization name, email
address, and the names of everyone participating
at your location. Thanks!! Well get started
soon!
2
AGENDA

• Webinar Housekeeping
• Introductions
• Common Measures TEGL 17-05
• Performance Measures
• VAPIS
• MIS Changes

3

TEGL 17-05
4
Establishing Common Measures

• Effort led by OMB as part of Presidents
  Management Agenda
• Linking Performance to budget
• Supporting effective programs
• Comparing similar programs across agencies

5
The Common Measures

• Adult Measures
• Entered Employment
• Employment Retention
• Average Earnings

Average Earnings become effective PY 2006 for
PY 2005, the measure is an Earnings Change
6
The Common Measures

• Youth Measures
• Placement in Employment or Education
• Attainment of a Degree or Certificate
• Literacy or Numeracy Gains

7
Common Measures Benefits

• Focus on the core purposes of the workforce
  system
• Break down barriers to integration
• Resolve questions regarding consistency and
  reliability of data
• Reduce confusion

8
PY 2005 Accountability

• Accountable for specific Common Measures
• Entered Employment Rate
• Employment Retention Rate

9
PY 2005 Accountability

• Accountable For specific WIA statutory Measures
• Average Earnings Gain/Replacement
• Adult and DW Employment and Credential
• OY Entered Employment, Retention, Earnings,
  Credential
• YY Retention, Skill Attainment, Diploma
  Attainment
• Customer Satisfaction (Participants and
  Employers)

10
PY 2005 Accountability

• Accountable for reporting on specific Common
  Measures
• Youth Attainment of Degree/Certificate
• Youth Placement in Employment Education

11
PY 2005 Accountability

• Reporting recommended for Youth Literacy/Numeracy
• Required beginning in PY 2006
• WIA performance accountability for PY 2005 still
  consists of the 17 measures
• With some changed definitions

12
Program Reporting

• In general, individuals who are eligible for a
  program and receive any service, should be
  reported in participant counts

13
Program Design Implication 1Long-Term
Participation

• Common Measure outcomes are unlikely to be met
  unless youth participate for extended periods

14
Program Design Implications 2Network of Services

• Since long-term participation is needed to
  achieve outcomes, more than ever, WIA youth must
  have access to a network of services, not a
  single program or provider

15
Program Design Implication 3Assessment

• Youth friendly assessments
• Tell youth why they are being tested and how test
  will be used
• Dont retest too soon
• Consider other assessments
• Remove the high-stake test pressure

16
Exclusions from Common Measures

• Institutionalized
• Health/Medical or Family Care
• Deceased
• Reserve Forces Called to Active Duty
• Relocated to a Mandated Program
• Invalid or Missing SSN

17
QUESTIONS
18
Performance Measures
19
Adult Common Measures

• Entered Employment
• Employment Retention
• Average Earnings

20
Programs Covered

• WIA Adult
• WIA Dislocated Worker
• Trade Act
• Wagner-Peyser
• VETS

21
Entered Employment Rate

• Definition For those not employed at
  participation, the percentage employed in the 1st
  quarter after exit

22
Entered Employment Rate

• Calculation Of those not employed at
  participation
• Number employed in 1st quarter after exit
• Number who exit during the quarter

23
Highlights of Adult Entered Employment Rate

• Excludes Adults employed at participation
• Employment at participation is based on
  information collected from the individual

24
Highlights of Adult Entered Employment Rate

• Those who received a notice of termination or the
  employer has filed a WARN or similar notice are
  considered not employed
• Transitioning Service Members (expected to retire
  within 12 months) are considered not employed

25
Highlights of Adult Employment Retention Rate

• Includes all those employed in the 1st quarter
  after exit regardless of employment status at
  participation
• Positive outcome requires employment in two
  post-exit quarters (does not have to be with the
  same employer)

26
Employment Retention Rate

• Definition For those employed in the 1st quarter
  after exit, the percentage employed in the 2nd
  and 3rd quarter after exit
• Calculation Of those employed in the first
  quarter after exit
• Number employed in the 2nd and 3rd quarter after
  exit
• Number who exit during the quarter

27
PY 2006 Average Earnings

• Definition For those employed in the 1st, 2nd,
  and 3rd quarter after exit, average six month
  earnings in the 2nd and 3rd quarter after exit

28
PY 2006 Average Earnings

• Calculation
• Of those employed in the 1st, 2nd and 3rd
  quarters after exit
• Earning from the 2nd and 3rd quarter after exit
• Number who exit during the quarter

29
Highlights of Adult Average Earnings

• Includes those employed in 1st, 2nd, and 3rd
  quarter after exit
• Only allowable data source is wage records

30
Highlights of Adult Average Earnings

• Those whose employment was determined based on
  supplemental data are excluded from the earnings
  measure
• WIA programs will use the current Adult Earnings
  Change measure for PY 2005

31
Youth Common Measures

• Placement in Employment or Education
• Attainment of Degree or Certificate
• Literacy/Numeracy Gains

32
Program Covered

• WIA Youth

33
Placement in Employment or Education

• Definition Of Those not in post-secondary
  education, employment, or the military at
  participation, the percentage in employment, the
  military or enrolled in post-secondary education
  and/or advance training/occupational skills
  training in the 1st quarter after exit

34
Placement in Employment or Education cont.

• Calculation
• Of those not employed, in the military, or in
  post-secondary education at participation
• Number of youth employed, in the military, or
  enrolled in post-secondary education and/or
  advanced training or occupational skills training
  in the 1st quarter after exit
• Number or exiters

35
Highlights of Youth Placement in Employment or
Education

• Excludes youth in employment, the military, or
  post-secondary education at participation
• Employment, military, and education status at
  participation is based on information collected
  from the individual
• Employment and military status in the 1st quarter
  after exit is based on wage records (supplemental
  data allowed)

36
Highlights of Youth Placement in Employment or
Education Continued

• Education status in the 1st quarter after exit is
  based on administrative records
• Youth in secondary school at exit are included,
  consistent with ETAs vision to ensure youth
  successfully complete their secondary education

37
Defining Specific Terms

• Post-Secondary Education A program at an
  accredited degree-granting institution leading to
  an academic degree.

38
Defining Specific Terms Continued

• Advanced Training/Occupational Skills Training

39
Attainment of Degree or Certificate

• Definition Of those enrolled in education at or
  during participation, the percentage who attained
  a diploma, GED, or certificate by the end of the
  3rd quarter after exit.

40
Attainment of Degree or Certificate

• Calculation
• Of those enrolled in education at participation
  or any time during the program
• Number or youth who attained a diploma, GED, or
  certificate by the end of the 3rd quarter after
  exit
• Number of exiters

41
Highlights of Youth Attainment of Degree or
Certificate

• Youth in secondary school at exit are included,
  which is consistent with ETAs vision to ensure
  youth successfully complete their secondary
  education

42
Highlights of Youth Attainment of Degree or
Certificate Continued

• Diplomas, GEDs, or certificates can be obtained
  during participation or at any point by the end
  of the 3rd quarter after exit
• Work readiness certificates will not be accepted
  for this measure

43
Defining Specific Terms

• Education Participation in secondary or
  post-secondary school, adult education programs,
  or any other organized program of study leading
  to a degree or certificate

44
Defining Specific TermsContinued

• Diploma Any credential accepted by the State
  educational agency as equivalent to a HS diploma
  also includes post-secondary degrees

45
Defining Specific TermsContinued

• Certificate Awarded in recognition of an
  individuals attainment of technical or
  occupational skills
• Does not include work readiness certificates or
  certificates awarded by local boards

46
Literacy/Numeracy Gains

• Definition Of those out-of-school youth who are
  basic skills deficient, the percentage who
  increase one or more education functioning levels
  within on year of participation

47
Literacy/Numeracy GainsContinued

• Calculation
• Of those out-of-school youth who are basic
  skills deficient
• Number of Youth participants who increase one or
  more educational functioning levels

Number of youth who completed a year of
participation (based on date of 1st youth service)
Number of youth who exit before completing a year
of participation
48
Highlights of Literacy Numeracy Gains Continued

• Only common measure that is not exit-based
• Excludes in-school youth and out-of-school youth
  who are not basic skills deficient
• Includes individuals with learning disabilities

49
Highlights of Literacy /Numeracy Gains

• A positive outcome means the youth must advance
  one or more ABE or ESL functioning levels
• Gains can occur in literacy or numeracy
• Educational levels are consistent with Department
  of Educations national Reporting System (NRS)
• Reporting begins July 1, 2006

50
About the Assessments

• The same standardized assessment must be used for
  pre- and post-testing

51
About the Assessments

• If a youth continues to be basic skills deficient
  after the first 12 months of participation, they
  should continue to receive training in literacy
  and/or numeracy skills

52
About the Assessments

• All out-of-school youth must be assessed in basic
  reading, writing, and math

53
About the Assessments

• Pre-testing must occur within 60 days of the
  first youth program service can use pre-test
  from up to six months prior to date of first
  youth service

54
About the Assessments

• Must use one of the assessment tools listed in
  Attachment C of TEGL 17-05

55
About the Assessments

• Youth should be post-tested by the end of one
  year of participation and compared to pre-test
  results obtained during the initial assessment

56
About the Assessments

• Youth should be post-tested and included in the
  measure at the completion of the 2nd year if they
  complete two years in the program

57
Exclusions from Common Measures

• A participant in any of the following categories,
  may be excluded
• Institutionalized
• Health/Medical or Family care
• Deceased
• Reserve Forces Called to Active Duty
• Relocated to a Mandated Program
• Invalid or Missing Social Security Number

58
WIA Program Accountability

• MWAs will continue to be held accountable for all
  current (17) WIA performance measures
• WIA Adult performance measures will utilize the
  Adult Common Measures definitions

59
QUESTIONS
60
V A P I S
VALUE ADDED PERFORMANCE IMPROVEMENT SYSTEM
61
VAPIS

• Provides adjusted performance data for the State
  and local areas.
• Predicts local area performance.
• Provides data to support identification of local
  area strengths and weaknesses, leading to system
  improvements.

62
Programs Included

• WIA Adult
• WIA Dislocated Worker
• Wagner-Peyser

63
Common Measures

• Entered Employment Rate
• Employment Retention Rate
• Average Earnings

64
Quarterly VAPIS Report by Program by Measure

• Actual and Adjusted performance results.
• Prediction of future performance results.
• Measure of Value Added by local area.

65
QUESTIONS
66
(No Transcript)
67
Participant Counts
For new enrollments in Wagner Peyser The system
will create a new enrollment in WIA
68
Participant counts
For new enrollments in WIA The system will
create a new enrollment in W-P
69
Participant Counts
For new enrollments in Trade The system will
create a new enrollment in W-P and WIA
70
Wagner-Peyser Changes
The Activity Assigned to Case Management will
now require a manual End Date entry.
71
Wagner-Peyser Changes

• Exit information will be available for
• User input.

72
Wagner-Peyser Changes

• All records will now have an Exit Date

73
WIA Changes
The pre registration screen will be altered to
capture Employment Status, Education Status, UI
Claim Data and Migrant Worker
74
WIA Changes
A new section for Youth Assessment data will be
added to the system
75
WIA Changes
A temporary Exit Date will be added for User
input
76
Conversion of Data
All WIA pre registration, pending Trade and
Wagner-Peyser records that are 91-days old or
more will be Exited
77
Conversion of Data
All other records will be checked to determine
if they can be considered a concurrent
participation
78
Conversion of Data
All records 90-days old or less will have a new
display page showing concurrent participation and
other information pertaining to when the record
will be Exited
79
Open Record Display Information 1
80
Open Record Display Information 2
81
Open Record Display Information 3
82
Exited Record Display Information
83
Exit from the System
The system will now Exit all records
84
Exit from the System
The Exit will occur 90-days after the latest
Activity has Ended and there are no GAPs or
Future Services planned.
85
Exit from the System
For concurrently enrolled participants all
records will have the same Exit Date.
86
Exit from the System
For concurrently enrolled participants if an
Exclusionary Exit reason is recorded in any of
the programs that Reason will be used for all of
the programs.
87
Questions
88
For More Information and Q AsPlease Visit

• www. Michigan.gov/bwptraining
• Common Measures