Reading Your Accountability Reports UPASS AYP

1
Reading Your Accountability Reports U-PASSAYP

• Utah State Office of Education
• August 2008

2
Utah Performance Assessment System for
StudentsU-PASS Accountability Plan
3
U-PASSAccountability Plan

• Student Participation
• 95
• Proficiency Score
• 80 - schools without a 12th grade
• 75 - schools with a 12th grade
• Progress Score
• 190 - schools without a 12th grade
• 180 - schools with a 12th grade

4
U-PASS Decision Tree
5
(No Transcript)
6
(No Transcript)
7
(No Transcript)
8
(No Transcript)
9
U-PASS Reports

• www.usoe.org

10
Elem/Mid School District
11
High School District
12
U-PASS language arts drill down page
School Name District
13
School Name District
14
School Name District
Elem/Middle School Name Address City, State Zip
15
High School Name Address City, State Zip
16
High School Name Address City, State Zip
17
A Guide to U-PASS Determinations
18
New for 2008 reports

• Progress drill down table for language arts

19
Progress Table

• New for 2008 Reports
• Language Arts
• Math
• Science
• Shows number of students in each progress cell

20
Progress Table Elem/Middle
21
Progress Table High School
22
Attendance Value Table
23
Accurate Data is Essential

• State-wide Student Identifier (SSID)
• Attendance

24

• Questions?

25
AYP School Reports
26
AYP Decision Tree
27
(No Transcript)
28
(No Transcript)
29
(No Transcript)
30
AYP Accountability Workbook2008 Approved June,
2008

• www.usoe.org

31
AYP Reports

• Grades 3 8
• Language Arts CRT
• Math CRTs
• Grade 10 language arts
• Grades 10 12 Algebra I and Geometry

32
Participation
33
Participation

• N size less than 40
• NOT Full Academic Year (FAY)
• Number of tests that do not have a final outcome
  of Absent divided by the total number of valid
  tests.
• Requirement 95 participation

34

35

36

37
Academic Achievement

• Language Arts
• Math

38
Students in AYP U-PASS School Reports

• Two large data collections
• 1) End-of-Year Clearinghouse,
• 2) Core CRT Files
• These Two Files Need To Match To Be On AYP
  U-PASS School Reports!
• SSID (majority of matches)
• or
• 6 Fields for Matching District, School, Last
  Name, First Name, Date of Birth, Gender

39
Academic Achievement
40
Academic Achievement

• n size is less than 10
• Full Academic Year (FAY)
• Confidence Interval 99

41

42

43
Safe Harbor

• Language Arts
• Math

44
Safe Harbor

• n size is less than 10
• 10 reduction in percentage of students not
  proficient
• Confidence Interval is 75

45

46

47
Safe Harbor

• Hispanic
• 2007 39 proficient 61 not proficient
• 2008 52 proficient 48 not proficient
• Safe Harbor - 10 reduction in the percentage of
  students not proficient
• 10 decrease 6.1
• 13 reduction in the percentage of students not
  proficient
• Made Safe Harbor

48
Safe Harbor

• Economically Disadvantaged
• 2007 42 proficient 58 not proficient
• 2008 53 proficient 47 not proficient
• Safe Harbor - 10 reduction in the percentage of
  students not proficient
• 10 decrease 5.8
• 11 reduction in the percentage of students not
  proficient
• Made Safe Harbor

49
Safe Harbor

• Limited English
• 2007 43 proficient 57 not proficient
• 2008 50 proficient 50 not proficient
• Safe Harbor - 10 reduction in the percentage of
  students not proficient
• 10 decrease 5.7
• 7 reduction in the percentage of students not
  proficient
• Made Safe Harbor

50
Additional Indicator

• Attendance
• Graduation Rate
• Only if Safe Harbor is needed

51
Additional Indicator

• Only used if safe harbor is needed
• N size is less than 40
• All enrolled students
• Attendance for grades 3 8
• Graduation Rate for grades 10 - 12

52
Attendance 93

• The goal for attendance is 93 for elementary and
  middle schools. Schools must meet this goal or
  improve from the previous year. Improvement is
  defined as any increase in this area.
• The attendance rate is the sum of days in
  attendance divided by the sum of days in
  membership for all students in the unit of
  accountability who were in membership for at
  least eleven (11) days and whose membership is
  equal to or greater than attendance (180 days).
  Membership includes self-contained SCRAM and YIC
  systems.

53
Graduation Rate 85.7

• The goal for graduation rate is 85.7 for high
  schools. Schools must meet this goal or improve
  from the previous year. Improvement is defined
  as any increase in this area. Graduation rate is
  delayed one year. 2008 reports include the
  graduation rate for the class of 2007.
• Business Rule
• Tracks the students in the graduating class of
  2007 individually from their 10th grade year in
  2005 and determines the final high school
  completion status of each student in 2007.
• The formula is simply the number of graduates in
  the class divided by the number of graduates plus
  dropouts in the class, with students who
  transferred out of the public education system
  excluded from the computation.
• Improvement
• For 2008 reports only, if a student group does
  not meet the required 85.7 for graduation rate,
  then attendance will be used to determine if the
  additional indicator shows progress.

54

55

56

57

58
Progress Calculation
59
Progress Calculation

• For student groups that do not meet the status
  AMO and do not meet the standard safe harbor
  requirement,
• A Progress (Safe Harbor Same Student) Calculation
  will be applied. This approach compares the
  performance of students in the student group
  enrolled for a full academic year that did not
  meet either the status or safe harbor targets
  with the performance of these same students in
  the prior year (as long as they were tested
  anywhere in Utah) to determine if there was a 10
  reduction in the percentage of these matched
  students scoring below proficient.
• This calculation will not include a confidence
  interval, and will only be applied when there is
  a 95 match rate for the student group.

60
Did the School make AYP?

• Language Arts?
• Math?
• AYP?
• Program Improvement?

61

62

63
Accurate Data is Essential

• State-wide Student Identifier (SSID)
• Attendance

64
LEA AYP Reports

• Two reports combined into one report
• Grades 3 8
• Grades 10 12
• Includes
• All students in the school report
• All students that were not included in the school
  report due to less than n size
• All LEA full academic year (FAY) students that
  moved between schools within the LEA that was not
  included in the school report due to enrollment
  less than 160 days.
• Business Rule
• An LEA will receive a report based on both 3-8
  and 10-12 grade AMO's.  An LEA must fail at both
  the 3-8 and the 10-12 grade for language arts or
  both 3-8 and 10-12 for math to fail AYP. 

65
LEA AYP Reports
66
LEA AYP Reports

• Program Improvement
• Business Rule
• An LEA is identified for improvement only when
  it fails AYP in the same subject for both grade
  spans for two consecutive years.
• Title I Program Improvement document

67
Appeal Process
68
Enhanced Research Disk
69
State Education Research File
70
Questions?