200708 PostTest Workshop

1
2007-08Post-Test Workshop

• Wisconsin Student Assessment System
• and Accountability Updates

2
Workshop Overview

• Topics
• General Information
• WKCE
• WAA-SwD
• ACCESS
• AMAOs
• NAEP
• Adequate Yearly Progress (AYP)
• Questions Answers
• Send your questions anytime

3
If you cannot hear the presenter check to be sure

• The volume on MediaSite is turned up. The
  Volume button is located below the speaker box
• The volume on your computer is turned up. Adjust
  on the toolbar on lower right side of screen
• Contact your IT Staff

4
Getting Around in MediaSite
5
OEA Website

• OEAs Web site - http//dpi.wi.gov/oea
• Organized by Accountability, Assessments, and
  Resources
• DAC Corner
• MediaSite/Webcast Trainings
• DAC correspondence
• DAC responsibilities and New DAC information
• Calendar/Important Dates
• Quick contacts

6
OEA Website
7
Update Your Contact Information

• DACs will receive a DAC Update Form via email on
  May 1, 2008
• Please complete this form by May 31, 2008
  return (even if you are not a new DAC as this
  keeps our email records current. )

8
Online Reporting System (ORS)

• To access data through the ORS (TurnLeaf site)
  new DACs may receive usernames passwords, from
  Phil Cranley at [phone]. All other DACs
  should have their usernames and passwords.
• The ORS 101 presentation covers general use and
  navigation and is available in the DAC corner of
  the OEA website at http//dpi.wi.gov/oea/webcasts.
  html

9
TEST SECURITY

• During WKCE Item Analysis Workshops Data
  Retreats
• Test books from this year and previous years have
  LIVE ITEMS and should be secured at all times
• NO COPIES should be made!
• Participants must sign a Confidentiality
  Agreement Form available at http//dpi.wi.gov/oea/
  dacforms.html

10
TEST SECURITY continued

• Do NOT alter/modify items for student practice or
  any other use There are released items
  available for use at (http//dpi.wi.gov/oea/releas
  eitems.html)
• Account for and secure all test books
• Explain consequences of security violations to
  participants
• More information is available in the Test
  Security Webcast training at http//dpi.wi.gov/oea
  /webcast.html.

11
Fall 2008 Testing Window

• Fall 2008 WKCE WAA-SwD testing window is
  October 27 November 28
• Testing windows through 2014-15 are available at
  http//dpi.wi.gov/oea/calendar.html.

12
Fall 2008 Testing Window

• Testing for both the WKCE and the WAA-SwD may not
  begin before the testing window based on the
  recommendation of the Wisconsin Technical
  Advisory Committee.

13
Fall 2008 Testing Window

• DPI suggests scheduling the WSAS during the first
  2 weeks of the window and using the remaining
  time to give make-ups. This will eliminate some
  of the problems with students moving in the
  middle of the window.

14
Participation in the WKCE or the WAA-SWD

• Beginning with Fall 2008 a student must
  participate in either the WKCE or the WAA-SwD
  based on the decision of the IEP team as to which
  set of standards is appropriate for that student.
• A student who is taught from the Extended Grade
  Band Standards must take the WAA-SwD.
• A student who is taught from the Wisconsin Model
  Academic Standards must take the WKCE.
• A student may not take part of the WKCE and part
  of the WAA-SwD
• Please consider this prior to the testing window
  and during IEP planning.

15
Accommodations

• The Accommodation Matrix (describing allowable
  testing accommodations and practices) will be
  updated and re-posted shortly. See
  http//dpi.wi.gov/oea/pdf/accom08.pdf.
• Braille Reading the reading test to newly blind
  students
• Minor Clarifications
• The matrix will also appear in the Guide for
  District Assessment Coordinators (DAC Guide),
  distributed before Fall 2008 testing.

16
Wisconsin Knowledge and Concepts Examination

• (WKCE)

17
Review of 2007-08 WKCE Testing

• The Office of Educational Accountability (OEA)
  would like to thank you for your work in ensuring
  a successful timely administration in
  conjunction with other responsibilities
• WKCE Test books were returned on time
• RES was earlier to allow for IPRs in districts by
  the end of February.

18
WKCE Development Process

• Extensive input from Wisconsin educators is part
  of the year-round development process of the
  WKCE
• Passage review
• Item content and bias review
• Range finding
• ELL Translations

19
WKCE Scale Scores

• 2007-08 WKCE scale scores remain the same as
  2005-06 administration.
• Scale scores are available online at
  http//dpi.wi.gov/oea/wkce-crtcuts.html

20
Schedule for the Release of the 2007-08 WKCE data

• Phase III (final set of reports) are available
  and were posted on the Online Reporting System
  (ORS) website on April 21.
• Phase II reports were available through ORS on
  March 28.
• Individual Profile Reports (IPRs) were shipped to
  districts on February 29, and should have been
  sent home to parents shortly after receipt in the
  district.

21
Public Release of Data

• No public release of WSAS data is permitted until
  May 30, 2008.
• This date is later this year due to the late
  administration of the WAA-SwD and the need to
  wait until WAA-SwD Standard Setting was held in
  April.
• Results may be shared internally with educators
  but not released to the public
• WINSS will be updated with the 2007-08 data on
  May 30, 2008.

22
Fall 2008 WKCE

• Fall 2008 WKCE testing times similar to last year
• Science will still be tested only at 4, 8, 10
• Two WKCE test books at grades 4, 8, 10
• After testing, please check for merged records
  during Record Editing System

23
Wisconsin Alternate Assessment for Students with
Disabilities

• (WAA-SwD)

24
WAA-SwD

• The Office of Educational Accountability (OEA)
  would like to thank you for your work in ensuring
  a successful timely administration in
  conjunction with other responsibilities
• THANK YOU!

25
WAA-SwD Development Process

• Extensive input from Wisconsin educators is part
  of the year-round development process of the
  WAA-SwD
• Extended Grade Band Standards
• Item Content and Bias Review
• Standard Setting

26
WAA-SwD Standard Setting

• A process that lets experts make judgments about
  the content that students in each achievement
  level should know.
• Achievement standards define what students should
  know and be able to do at each proficiency
  achievement level (minimal, basic, proficient,
  advanced) .
• Extended Grade Band Standards

27
Review of 2007-08 WAA-SwD

• Overall, positive feedback and a successful
  administration
• WAA-SwD Trainings
• Extended Grade Band Standards
• WAA-SwD Administration
• First time administration concerns
• Correct quantity of materials per grade level
  we are addressing this with our vendor

28
WAA-SwD Survey Results

• Approximately 500 educators participated in the
  survey
• 77 were classroom teachers
• How long did it take to PREPARE for the test
  administration. In general, Mathematics, Reading,
  and Science
• 73 0-29 minutes
• 23 30-59 minutes
• 3 60-89 minutes
• 2 90 or more minutes
• Percentages are rounded

29
WAA-SwD Survey Results

• How long did it take your student to COMPLETE the
  test per content area (indicate average if more
  than one student)?
• In general, Mathematics, Reading, and Science
• 21 0-29 minutes
• 52 30-59 minutes
• 20 60-89 minutes
• 7 90 or more minutes
• Percentages are rounded

30
WAA-SwD Survey Results

• How appropriate was this test in measuring the
  academic knowledge of the students to whom it was
  administered?
• 21 Too difficult
• 48 Appropriate
• 31 Too easy
• Percentages are rounded

31
WAA-SwD Survey Results

• Some comments
• I liked this assessment much better than those
  we have used in the past. I felt that it gave an
  accurate picture of my student's abilities.
• Much preferred giving a test like this as
  opposed to having to collect evidence. Like the
  extended band standards also.
• In general I felt the test was appropriate.
  The range of the students abilities that will be
  taking this test makes it difficult to develop a
  test that is appropriate for all students.
• I am very happy that we now have expectations
  for students with cognitive disabilities. I like
  the changes but do see the difficulties some
  teachers are having administering it to very
  severe students.

32
Schedule for the Release of the 2007-08 WAA-SwD
data

• WAA-SwD Individual Profile Reports (IPRs) have
  been sent out to districts and should be arriving
  shortly. IPRs should be sent home to parents
  shortly after receipt.
• District Assessment Coordinators will be able to
  check the WAA-SwD reports on the Online Reporting
  System (ORS TurnLeaf site).

33
Individual Profile Reports
34
Public Release of Data

• No public release of WSAS data is permitted until
  May 30, 2008.
• This date is later this year due to the late
  administration of the WAA-SwD and the need to
  wait until WAA-SwD Standard Setting was held.
• Results may be shared internally with educators
  but not released to the public
• WINSS will be updated with the 2007-08 data on
  May 30, 2008.

35
Fall 2008 WAA-SwD

• Performance-Task assessment
• Reading and Mathematics at grades 3-8, and 10
• Science at grades 4, 8, and 10
• Rater Form Assessment
• Social Studies and Language Arts/Writing at
  grades 4, 8, and 10
• Knowledge and skills inventory
• Record the results on the WAA-SwD answer document
• WAA-SwD will be given during the SAME window as
  the WKCE.

36
Fall 2008 WAA-SwD

• Participation Checklist
• IEP Team decision
• A student must participate in either the WKCE or
  the WAA-SwD based on the decision of the IEP team
  as to which set of standards is appropriate for
  that student.
• Available at http//dpi.wi.gov/sped/assmt-waa.htm
  l

37
Participation Checklist
38
WAA-SwD Questions?

• Office of Educational Accountability
• Brian Johnson
• brian.johnson_at_dpi.wi.gov
• 608-267-1290
• Kristen Kehoe
• kristen.kehoe_at_dpi.wi.gov
• 608-267-3164

• Special Education Team
• Sandy Berndt
• sandra.berndt_at_dpi.wi.gov
• 608-266-1785
• Eva Kubinski
• Eva.kubinski_at_dpi.wi.gov
• 608-266-2899

39
English Language Learners

• (ELLs)

40
Assessment of English Language Learners

• Spanish and Hmong Pilot Translations - DPI
  provided for 2007 administration
• 2008 Administration similar to 2007 with
  incorporated suggestions from survey and
  educators
• ELL students will continue to take the WKCE with
  allowable accommodations

41
Accommodations for ELLs

• Spanish Hmong Pilot testing scripts and audio
  recordings
• Survey indicated that the scripts were used in
  more frequency than the audio recordings
• Audio recordings were useful to some but had some
  technical quality issues.
• Will re-evaluate process and procedures for next
  years administration.
• Content-specific word-to-word glossaries in
  Spanish and Hmong

42
Accommodations for ELLs

• Accommodations Matrix
• DPI recognizes that 15 of the Wisconsin ELL
  population speaks a language other than Spanish
  or Hmong. Districts who serve students who speak
  languages other than Spanish or Hmong may use
  qualified translators to provide oral translation
  support to students.

43
Assessment of ELL Students

• For Fall 2008 use same procedures as Fall 2007
• ELL Levels 1 and 2 less than 1 year in country
  must take Mathematics and Science may take
  Reading
• Levels 1 and 2 more than 1 year in country must
  take Mathematics, Science, and Reading

44

• a

45
ACCESS for ELLs

• New Electronic data clean-up window was used due
  to district requests.
• April 15-April 25
• All paper reports will be delivered the week of
  May 12.
• After paper reports are delivered districts will
  have two more weeks to make any additional
  corrections.

46
ACCESS for ELLs

• 2008-2009 Testing Window
• December 1, 2008- February 13, 2009

47
ELL AMAOs - What are they?

• Annual Measurable Achievement Objectives (AMAOs)
  for the Attainment of English Language
  Proficiency
• AMAOs are used for Title III Accountability not
  for AYP

48
Specific Targets for each AMAO

• AMAO 1 ? Progress ELP Assessment
• AMAO 2 ? Attainment
• AMAO 3 ? Title I AYP ? Content Assessment
• Must meet each of the required indicators to meet
  AMAOs. If one of the components is not meet than
  the district or consortium does not meet their
  AMAO.

49
ELL AMAO Calculations

• Three specific AMAO target areas have been
  established under the law
• AMAO 1 Progressing in English language
  acquisition annual increases in the number or
  percentage of students making progress in
  learning English
• AMAO 2 Exiting or reaching English language
  proficiency annual increases in the number or
  percentage of students attaining English language
  proficiency by the end of each school year
• ELL exit rate is calculated as
• 100 of students who achieve ELP level 6
• 100 of students eligible to achieve Level 6
• AMAO 3 ELL-Adequate Yearly Progress (AYP)AYP
  for the ELL subgroup (under Title I) in meeting
  grade-level academic achievement standards in
  English Language Arts (Reading) and Mathematics
• The above Title III AMAOs are not used for
  school/district accountability (AYP purposes).

50
AMAO Timeline

• AMAO results will be distributed at the beginning
  of the school year.
• 30-day appeal process after results are given to
  districts.

51
ELL Assessment Questions

• ELL Assessment
• Brian Johnson
• brian.johnson_at_dpi.wi.gov
• 608-267-1290
• ELL Accountability (AMAOs)
• Susan Ketchum
• susan.ketchum_at_dpi.wi.gov
• 608-267-0245

52
Looking Ahead to 200809 NAEP
53
200708 School Year NAEP Testing
54
200809 School Year NAEP Testing
55
200809 School Year NAEP Testing

• Main NAEP
• Grades 4 and 8
• Reading, mathematics, and science
• State and national results
• Nationwide, 500,000 public school students at
  each grade
• Grade 12
• Reading, mathematics, science
• National results
• Nationwide, about 100,000 public school students

56
200809 School Year NAEP Testing

• Pilot Studies
• Grades 4 and 8
• Reading, math, U.S. history, geography, and
  civics pilots
• Science Interactive Computer Test (SICT) and
  Hands On Tasks (HOT)
• Nationwide about 13,000 public school students
  per grade
• Grade 12
• U.S. history, geography, and civics pilots
• Science Interactive Computer Test (SICT) and
  Hands On Tasks (HOT)
• Nationwide about 6,000 public school students

57
200809 School Year NAEP Testing

• Selected districts and schools will receive
  notification of NAEP participation in late May.
• Letters will be mailed to District
  Superintendents, Administrators, DACs, and
  principals in early May.
• Assessment date notification sent in June
• Additional information on the assessments will be
  provided in early Fall.
• Contact Abby Potter aubree.potter_at_dpi.wi.gov,
  608-267-5153

58
Adequate Yearly Progress

• (AYP)

59
Determining AYP 2007-08
Schools districts must meet criteria for four
AYP objectives
95 of total of students enrolled in the tested
grades
Test Participation
74 Proficiency Index (FAY)
Reading
Mathematics
58 Proficiency Index (FAY)
90 of statewide average or growth 80
graduation or 85 attendance
Other Indicator
(Attendance/graduation)
60
2007-08 AYP Notification

• Only districts/schools that are in one or more of
  the following four categories will be notified in
  writing of their preliminary AYP status by June
  6, 2008
• missed AYP for 2007-08, or
• are identified for improvement at the school or
  district (SIFI or DIFI), or
• missed AYP in 2006-07 and have now met AYP in all
  areas, or
• were identified for improvement previously and
  are now in satisfactory status.

61
2007-08 AYP Notification

• The letters for schools in those four categories
  only will be sent to the district administrators
  and copied to principals and district assessment
  coordinators in those districts.
• All Wisconsin districts may access and print all
  their AYP sheets from the ORS website after June
  30. The DAC is responsible for distributing these
  within the district, as no printed copies will be
  mailed. Be sure someone in your district has the
  ORS password and is available to do this if the
  DAC is not available.

62
2007-08 AYP Notification

• For complete information on how Adequate Yearly
  Progress is calculated, see http//dpi.wi.gov/oea/
  annrvw08.html.
• For information on sanctions that apply to
  schools or districts identified for improvement,
  see http//dpi.wi.gov/oea/doc/sifilevels.doc.

63
AYP Changes for 2007-08

• Adequate Measurable Objectives (AMOs) for Reading
  and Math have gone up more students must be
  proficient to make Adequate Yearly Progress
  (AYP).
• Reading - 74
• Mathematics - 58
• These AMOs will stay in effect for 2008-09 and
  2009-10.

64
Determining AYP Annual Measurable Objectives
(AMOs)
Required Proficiency by 2013-14 100
2007-08 AMOs go up
74
58
Proficient/Advanced
37
Reading
Mathematics
2010-11
2011-12
2012-13
2013-14
2001-02
2009-10
2002-03
2003-04
2004-05
2005-06
2006-07
2007-08
2008-09
65
Changes for AYP in 2007-08
New beginning in 2007-08 cell size of 40 for
students with disabilities
Minimum cell size 2007-08
66
Changes for AYP in 2007-08

• The US Department of Education now allows states
  to include exited students with disabilities
  (SwD) in the Students with Disabilities
  subgroup, if they have been exited within the
  past two years.
• Wisconsin will add these exited special education
  students into the denominator only if the school
  benefits.
• For example
• A school has 60 SwD and misses AYP. When 10
  exited SwD are added back in, they have 70 SwD,
  and when it is recalculated they now make AYP.
• If a school makes AYP without the exited
  students, those students are not added into the
  denominator.

67
Growth and AYP

• Some states are beginning to use growth models as
  part of calculating AYP.
• WI will be eligible beginning 2008-09.
• Research studies are under way to explore how our
  data works with different approaches to growth
  modeling.
• Currently approvable growth models used by some
  states do not produce significantly different
  results from the current status approach of NCLB.
• WI is exploring multiple approaches to growth to
  prepare for potential broader options that might
  be allowable pending any changes that could come
  with NCLB reauthorization.

68
(No Transcript)