PENNSYLVANIA ACCOUNTABILITY SYSTEM PRACTITIONERS MEETING MAY 13, 2003

1
PENNSYLVANIA DEPARTMENT OF EDUCATION
a higher standard a brighter future
2
PENNSYLVANIA ACCOUNTABILITY SYSTEM
3

• To create a system
• that is demanding,
• fair and resilient.

To create a system that is demanding, fair and
resilient...
4

• To create a system
• that is demanding,
• fair and resilient.

And is aligned with the requirements of NO CHILD
LEFT BEHIND.
5
Q
UESTIONS ADDRESSED

• WHY HAVE ACCOUNTABILITY?
• WHAT MAKES A GOOD ACCOUNTABILITY
• SYSTEM?
• WHAT ARE THE INDICATORS?
• WHAT ARE THE TARGETS?
• HOW ARE CALCULATIONS MADE?
• WHAT HAPPENS TO SCHOOLS THAT MEET
• TARGETS, AND TO SCHOOLS THAT DO NOT?

6
W
HY HAVE ACCOUNTABILITY?
7
F
ACT

• States with strong accountability systems have
  made the greatest and most consistent gains in
  student achievement, and have had greater success
  in closing the achievement gap.

8
HAT MAKES A GOOD ACCOUNTABILITY SYSTEM?
W

• Performance Indicators
• For each school and district
• Incentives
• For schools/districts that meet or
• exceed performance targets

9
HAT MAKES A GOOD ACCOUNTABILITY SYSTEM?
W

• k

• Assistance
• For struggling schools and districts
• Consequences
• For persistently unacceptable performance
• Public Reporting of Results

10
EQUIREMENTS OFNO CHILD LEFT BEHIND
R

• 100 of students proficient by 2014
• Adequate yearly progress (AYP) goals
• Disaggregating data
• Rewards, supports, sanctions

11
HAT ARE THE INDICATORS?
W

• Student Achievement
• Participation Rate In
• Assessments
• Attendance K-8
• 4-year Graduation Rate
• Secondary

12
SSESSMENTS
A

• GRADES, SUBJECTS
• SY 2002-03 - Grades 5, 8 and 11 Reading and
  Math
• SY 2003-04 - Add Grade 3
• Reading and Math
• SY 2005-06 - Add Grades 4, 6, 7 Reading and
  Math
• SY 2007-08 - Add Grades 4, 7 10
• Science

13
SSESSMENTS
A

• All students tested, with
• accommodations as
• appropriate
• One statewide test at
• each subject and grade
• level.

14
W
HAT ARE THE PERFORMANCE TARGETS?
15
DEQUATE
P
A
Y
ROGRESS
EARLY
READING Proficient by Year

• -

45 54 63 72 81 91 100
2004 2003 2002
2007 2006 2005
2010 2009 2008
2014
2011
2012
2013
16
DEQUATE
P
A
Y
ROGRESS
EARLY
MATH Proficient by Year

• -

35 45 56 67 78 89 100
2004 2003 2002
2007 2006 2005
2010 2009 2008
2014
2011
2012
2013
17
O
THER AYP MEASURES

• 95 participation rate Now
• Attendance, K-8
• Target is improvement, up to 95
• 4-year graduation rate, secondary
• Target is improvement, up to 95

18
EET AYP BY
M

• PROFICIENCY TARGETS
• School
• Subgroup
• 95 PARTICIPATION
• GROWTH IN ATTENDANCE and
• GRADUATION

19
ALCULATION RULES AYP
C

• All students must be tested.
• AYP calculated by averaging grade spans for 2
  years, and by using current year data, and
  determined by whichever is higher. This method
  increases reliability and validity.

20
ALCULATION RULES AYP
C

• Accountable for
• Students enrolled Oct 1 through last day of
  testing
• Up to 1 may take PASA
• Proficiency test required for ELL
• Students Test data counts after 1 year

21
ALCULATION RULES AYP
C

• Every school accountable
• annually regardless of
• school size
• N of 40 for subgroup accountability
• For very small schools,
• will combine data for
• 2-3 years
• N of 10 for reporting

22
AFE HARBOR
S

• If a school or subgroup does not
• meet proficiency criteria, but DOES
• reduce the proportion of below-
• proficient students by 10 or more,
• it will be considered to have
• met AYP.

23
AFE HARBOR
S
EXAMPLE

• Below proficient 2002 90
• Safe Harbor Target 2003
• 90 x 1/10th 9
• 90 - 9 81

24
Pennsylvanias Accountability System Will Also
Honor Significant Growth.
25
ROWTH TARGETS
PA PERFORMANCE INDEX
G

• Measures growth across all levels
• not just from Basic to Proficient
• Starts each school and subgroup at its own
• 2002 baseline.
• Aims for 100 proficient in 2014

26
SES OF PA PERFORMANCE INDEX
U

• Will use to determine eligibility for
• rewards and recognition
• Negotiating with USDOE to use as an
• alternative AYP measure

27
ALCULATING A PPI SCORE
C
28
AMPLE SCHOOL A
S
Math
29
NNUAL PPI TARGETS
A

• Goal of 100 by
• the year 2014
• Annual Growth
• Target
• 2014 goal (100)
• minus baseline,
• divided by 12

30
NNUAL PPI TARGETS
A
EXAMPLES

• 2014 2002 Annual
• Goal Baseline PPI Target
• (100 - 52) ? 12 4.0
• (100 - 60) ? 12 3.3

31
W
HAT HAPPENS WHEN SCHOOLS MEET TARGETS?

• Schools receive
• rewards and
• recognition after two
• consecutive years of
• meeting targets

32
W
HAT HAPPENS WHEN SCHOOLS MEET TARGETS?

• Schools receive
• freedom from some
• reporting requirements
• and mandates after 4
• years of meeting targets

33
W
HAT HAPPENS WHEN SCHOOLS MEET TARGETS?

• Meeting either PA
• PPI targets or APY
• targets qualifies

34
W
HAT HAPPENS WHEN SCHOOLS DO NOT MEET TARGETS?
Schools begin to receive supports and
consequences after not meeting targets for two
consecutive years.
35
S
CHOOL IMPROVEMENT

• 1st year (of not meeting targets) Warning
• 2nd Year School Improvement I
• 3rd Year School Improvement II

36
S
CHOOL IMPROVEMENT

• School Improvement Year I
• - School Choice
• - School Assistance Team
• - School Improvement Plan
• School Improvement Year II
• - Same, Plus Supplemental Services
• - Additional Technical Assistance

37
C
ORRECTIVE ACTION

• 4th Year of not meeting Targets
  Corrective Action I
• 5th Year Corrective Action II
• 6th Year Governance Changes

38
C
ORRECTIVE ACTION I

• Same as school
• improvement plus
• major changes in
• leadership, curriculum,
• or other strategies.

39
C
ORRECTIVE ACTION II

• Same, plus plan for significant
• governance changes
• reconstitution
• chartering
• privatization
• other major governance changes

40
Y
EAR 6 OF NOT MAKING TARGETS
41
E
XITING
A school exits from the cycle when it
meets targets for two consecutive years.
42
N
OTIFICATION APPEALS

• Preliminary notification of
• districts and schools
• Early August
• 30 day turn-around process for
• appeals guidelines will be
• provided by PDE

43
D
ISTRICT AND STATE ACCOUNTABILITY

• Under NCLB, districts are
• accountable for the same goals as
• schools, with comparable rewards,
• supports, and sanctions
• States are also
• accountable for the
• same goals

44
Increased Demand Increased Support
Increased Results!
45
F
OR FURTHER GUIDANCE
Visit www.state.pa.us
46
PENNSYLVANIA DEPARTMENT OF EDUCATION
a higher standard a brighter future