Oklahoma State Testing Program OSTP and Achieving Classroom Excellence ACE Update

1
Oklahoma State Testing Program (OSTP) and
Achieving Classroom Excellence (ACE) Update

• Joyce DeFehr, Executive Director State Testing
• Office of Accountability and Assessments
• State Department of Education
• Joyce_DeFehr_at_sde.state.ok.us
• [phone]

2
Testing Overview

• The purpose of the Oklahoma School Testing
  Program (OSTP) is to assess students mastery of
  the Priority Academic Student Skills (PASS).
• The Oklahoma Core Curriculum Tests (OCCT), the
  Oklahoma Modified Alternate Assessment Program
  (OMAAP) and the Oklahoma Alternate Assessment
  Program (OAAP) for Reading and Mathematics are
  accountability tests required by the 2001 Federal
  No Child Left Behind (NCLB) legislation.

3
Who Participates?

• Every student enrolled in a tested grade level in
  an Oklahoma public school must participate in
  testing.
• All students will be administered either
• The general Oklahoma Core Curriculum Test (OCCT)
  with or without accommodations, or
• An alternate assessment
• Oklahoma Modified Alternate Assessment Program
  (OMAAP) tests with or without accommodations.
• Oklahoma Alternate Assessment Program (OAAP) or
  portfolio assessment.

4
OCCT General Assessments for Grades 3 - 8
Federal and State mandated tests results used in
accountability calculations
Federal and State mandated tests
State mandated tests
5
OCCT General Assessments for End-of-Instruction
(EOI)
Federal and State mandated tests results used in
accountability calculations
State mandated tests
6
OMAAP (Modified) Assessments Grades 3 - 8
Federal and State mandated tests
Federal and State mandated tests results used in
accountability calculations
18
7
OMAAP Modified Assessments for End-of-Instruction

Federal and State mandated tests results used in
accountability calculations
State mandated test
8
Modified Assessments

• Tests are based on the regular state tests with
  modifications.
• Tests are aligned with PASS.
• Tests are intended for gap students for whom
  the general OCCT and the OAAP assessments are
  inappropriate.
• Students represent roughly two percent (2) of
  the student population.

9
Modified Assessments

• The goal is to provide a test that is comparable
  to OCCT but more accessible for students with
  disabilities.
• Candidate students can be determined using the
  Criteria Checklist for Oklahoma's Alternate
  Assessments.

10

• Testing Updates

11
Standard Setting and Cut Scores

• Standard setting is the process that allows
  experts to make judgments about the content that
  a student should know and be able to do in order
  to be classified in a specific performance level.
  
• Cut scores are necessary for the categorization
  of student test scores into the four performance
  levels utilized in Oklahoma Advanced,
  Proficient/Satisfactory, Limited Knowledge, and
  Unsatisfactory.

12
Standard Setting

• Purpose for Grades 3 8 Reading and Mathematics
• Increase rigor by raising standards for Grades 3
  8 student achievement on the OCCT as a means to
  be more competitive at the national and
  international levels.
• Vertically align proficiency expectations for
  students on the OCCT test for Grades 3 8.
• Align student expectations on the OCCT more
  closely with student expectations for the
  National Assessment of Educational Progress
  (NAEP).

13
Standard Setting (cont).

• Standard settings were conducted in June for the
  following subjects.
• OCCT Grades 3 8 Reading and Mathematics
• OCCT EOI ACE English II, ACE Biology I, and ACE
  U.S. History
• OMAAP EOI U.S. History

14
Delivery of 2009 Spring Reports

• OCCT Grades 3 8- August 10 14
• OCCT EOI ACE Algebra I, ACE Algebra II, ACE
  Geometry, and ACE English III- July 6
• OCCT ACE English II, ACE Biology I, and ACE
• U. S. History- August 10
• OMAAP Grades 3 8 and EOI- July 10
• EOI U.S. History- early August

15
2009 2010 Testing Dates OCCT and OMAAP Grades
3 8

• February 24, 2010- Grades 5 and 8 Writing test
• April 12 23, 2010- Paper/pencil,
  multiple-choice tests
• Online extended one week until April 30 for Grade
  7 Geography and Grade 8 Mathematics and Reading.

16
2009 2010 Testing Dates OCCT and OMAAP EOI

• Winter
• November 30, 2009 December 18, 2009-
  paper/pencil
• Online extended one week until January 8, 2010
• Writing test on December 8 9, 2009
• Trimester
• January 18, 2010 February 5, 2010- paper/pencil
• Online extended one week until February 12, 2010
• Writing test on January 26 27, 2010
• Spring
• April 19, 2010 May 7, 2010- paper/pencil
• Online extended one week until May 14, 2010
• Writing test on April 20 21, 2010
• Summer
• June 7, 2010 July 30, 2010

17
Testing Rules

• New rules for test security and validity include
  the following
• Districts failing to return materials in a timely
  fashion may be penalized with additional costs,
  and test scores for the individual school(s)
  and/or district may be declared invalid.
• Districts failing to complete answer documents or
  incorrectly completing answer documents may be
  penalized with additional costs.
• Districts may also receive a deficiency on their
  district accreditation report.

18
Testing Rules (cont).

• New rules for OSTP scope and general
  administration include the following
• All EOI assessments must be taken once the
  corresponding course of instruction has been
  completed.
• In order to meet Federal NCLB legislation, all
  students prior to graduating from high school
  must take the Algebra I, Biology I, and English
  II assessments regardless of whether instruction
  has been taken, unless otherwise exempt.
• Beginning with the 2008 2009 school year, Full
  Academic Year (FAY) will be defined as continuous
  enrollment beginning within the first ten days of
  the school year without an enrollment lapse of
  ten or more consecutive days.

19
Testing Rules (cont).

• Exemptions and exceptions related to EOI
  graduation requirements include the following
• Students may graduate from a public high
  school with a standard diploma by demonstrating
  mastery in the state academic content standards
  for Algebra I English II and two of the
  following five Algebra II, Biology I, English
  III, Geometry, and U.S. History by attaining at
  least a satisfactory or proficient score on the
  EOI tests or in the following way

20
Testing Rules (cont).

• Step One Students will be provided remediation
  opportunities and will either
• Retake the EOI test or
• Score satisfactory or proficient on a State Board
• of Education approved alternate test which can
  be taken prior to or subsequent to the EOI test.

21
Testing Rules (cont).

• Step Two Students who do not achieve a
  satisfactory or proficient score through Step One
  will continue to receive remediation
  opportunities and will either
• Retake EOI test or
• Score satisfactory or proficient on a State Board
  of Education approved alternate test or
• Demonstrate mastery of the subject matter through
  an end of course project designed by the State
  Department of Education (SDE) and approved by the
  State Board of Education using rubrics approved
  by the State Board of Education.
• Students who do not meet the graduation
  requirements through Step Two may repeat Step Two
  as necessary.

22
Testing Rules (cont).

• A student may take more than one alternate test
  to meet the graduation requirement.
• School districts will document a students
  failure to participate in remediation and to
  complete test retake opportunities.
• The State Board of Education has the authority to
  waive one or more of the requirements for an
  individual student if the Board determines that
  extenuating circumstances justify the waiver for
  an EOI test.

23
Testing Rules (cont).

• Students who do not receive instruction in
  Oklahoma public schools may demonstrate mastery
  in required subjects in the following ways.
• Submit documentation of proficiency on an
  equivalent state end-of-instruction test in the
  state in which instruction was received.
• Attain at least a satisfactory or proficient
  score on an Oklahoma EOI test.
• Meet the approved level of proficiency on an
  alternate test.
• Demonstrate mastery through an end of course
  project.

24
Testing Rules (cont).

• Students on an Individualized Education Program
  (IEP) may demonstrate mastery of state academic
  content standards through a modified proficiency
  score on the state assessment(s) as established
  by the IEP team.
• Any deviation from the standard conditions,
  accommodations, or proficiency score on the state
  assessments(s) must be established on the
  students IEP and recorded on the students
  cumulative record.
• Beginning with the 2011 2012 school year,
  districts will report to the SDE, by school site,
  the number of students issued standard diplomas
  based on exceptions and exemptions.

25
Testing Rules (cont).

• Districts will maintain an ACE Demonstration of
  Mastery cumulative record for students who do not
  attain at least a satisfactory or proficient
  score on any of the required EOI tests.
• All school districts shall use this cumulative
  record uniform document or all information
  required on this document must be contained
  within the districts student information system.

26
Testing Rules (cont).

• The SDE will provide an electronic version of
  this cumulative record to the districts.
• This cumulative record will accompany the student
  when transferring to a new district.
• For each student who meets the graduation
  requirements, the students transcript will read
  This student has met the graduation requirement
  of demonstrating mastery in the state academic
  content standards.

27

• Implementation of ACE Recommendations

28
ACE Implementation

• Item development for the 2008 2009 school year
  has incorporated the alignment and
  Depth-of-Knowledge (DOK) recommendations at all
  levels and subjects assessed.
• Additional items will be developed at the DOK
  level 3 to meet the increased distribution of
  these items on assessments beginning at Grade 6
  and above.
• Standard setting for ACE English III, ACE
  Geometry, and ACE Algebra II was conducted in
  summer of 2008.

29
ACE Implementation (cont).

• Standard setting for ACE English II, ACE Biology
  I, and ACE U.S. History was conducted in summer
  2009.
• The performance level descriptors approved by the
  State Board of Education and recommended by the
  ACE Steering Committee will be used to define and
  help set cut scores for these assessments.

30
ACE Implementation (cont).

• Performance levels for OCCT assessments are as
  follows
• Unsatisfactory - The student does not perform at
  least at the Limited Knowledge level.
• Limited Knowledge The student demonstrates
  partial mastery of the essential knowledge and
  skills appropriate to the grade level, course, or
  level of education, as applicable.
• Proficient The student demonstrates mastery of
  appropriate grade-level subject matter and that
  students are ready for the next grade, course, or
  level of education, as applicable.
• Advanced The student demonstrates superior
  performance on challenging subject matter.

31
ACE Law

• Students who do not score at least at the
  satisfactory level shall be afforded the
  opportunity to retake each test up the three (3)
  times each calendar year.
• Winter/Trimester
• Spring
• Summer