CATS Update

1
CATS Update Administration Code Training, Fall
2008

• LaRue County Schools
• District Assessment Coordinator
• Amanda Reed, Ext. 1126

2
Pre-Test

• Work together at your table to decide if each
  situation listed is appropriate or inappropriate.

3
Assessment Update/Testing Windows

• No Changes in CATS Assessments for 2008-2009
• Fall 2008, September 15 26
• 8th Grade EXPLORE (now it counts!!!)
• 10th Grade PLAN
• 12th Grade On-Demand Writing
• ACCESS for ELLs, Jan 5 Feb 13
• English language proficiency test
• ACT, March 10
• 11th Grade
• Spring 2008, May 4 May 15 (LCHS 1 week early)
• Grades 3 8, 10, 11 KCCT
• Grades 4, 7 12 Writing Portfolio
• HOWEVER, Changes are coming for 703 KAR 5080
  Administration Code for Kentuckys Educational
  Assessment Program

4
Which Code When?

• Draft Changes to Administration Code will go to
  Kentucky State Board of Ed. in October
• Fall CATSOld Admin Code
• Only impacts 12th grade On-Demand
• Explore and Plan have their own guidelines we
  must follow since they are national tests
• Spring CATSNew Admin Code
• No substantial change in writing portfolio
  guidelines

5
Purpose

• To review the appropriate practices for the state
  assessment system as defined in the
  Administration Code for Kentuckys Educational
  Assessment Program (703 KAR 5080)

6
Allegations, 2008

• NONE FOR
• LaRUE COUNTY!!!!!!!!
• THANK YOU FOR FOLLOWING THE GUIDELINES IN YOUR
  MANUALS, INCLUSION DOCUMENT, ADMINISTRATION
  CODE

7
Rationale, pg. 3

• Professional Ethics
• 704 KAR 20680
• Educational Defensibility
• Activities to increase students ability to apply
  content, not just increase test scores
• Student Ownership
• All work done entirely by the student
• Note inclusion of writing portfolio materials

8
Appropriate Assessment Practices, pg. 4

• Requires Training
• Read, Sign and Comply Annually
• Prior to portfolio development (writing
  portfolios and alternate assessments)
• Review before Spring Assessments
• Includes documents and administration manuals
  specific to state-required assessment components

9
Test Security, pg. 5-7

• No one shall take notes about or discuss the
  content, concepts, or structure of any secure
  test item.
• No deliberate reviewing or reading of test items
  by an individual or group is permitted.
• Destroy notes, rough drafts created by students
• Dont share information about items

10
Test Security (continued)

• Released items can be used
• Security issues with technology
• Electronic devices with wireless communication
  or imaging capabilities (cell phones/cameras)
  shall not be accessible to students during
  testing
• Good Faith Effort
• Scanning student responses for stray marks/good
  faith effort is acceptable
• Reading entire student responses is NOT
  acceptable, nor is scoring student pre-writing or
  rough drafts

11
Test Security (continued)

• Alert papers, pg. 5
• Central Office, School Office, Classroom
• Test manuals to proctors early, BUT test booklets
  may not be given to proctors until the first day
  of scheduled testing in the school
• Test booklets shall be double-locked in
  classrooms
• Test booklets outside of locked storage must be
  attended at all times
• Procedures for Reporting Errors, pg. 7
• Example Grade 4, Reading Form 1A, Multiple
  Choice number 2, page 30, no correct answer
  choice provided

12
Classroom Materials, pg. 7-8Classroom materials
shall not provide a testing advantage to any
student.

• During the year, materials may be posted in
  classrooms for instructional purposes HOWEVER
• Materials containing content information or
  strategies for solving problems must be removed
  or covered from classroom walls, bulletin boards,
  or other surfaces (e.g. ceilings, floors, blinds,
  windows, and clothing) during testing sessions.
• Periodic Tables or materials without content or
  strategies for solving problems need not be
  removed or covered.

13
Classroom Materials (Continued)

• Why the change in classroom materials?
• NCLB KY was one of only a few states that were
  allowing content to stay up on walls
• EPAS System (Explore, PLAN, ACT) Attempt to
  establish consistency and limit confusion
• What Ifs?....dont know yet
• Word walls, ORQ steps, student work,
  multiplication tables, etc.
• YES Motivational posters are fine.

14
Classroom Materials (cont.)Exception for IEP,
504, PSP

• Dictionaries/thesauri
• On-demand Writing test ONLY
• Calculators
• Students may NOT share calculators
• Calculators required for KCCT math, but allowed
  for all KCCT
• Gr. 8 10 calculators allowed on Explore and
  PLAN math, but not science
• Students may only use the types of calculators
  specified in testing manuals

15
Classroom Materials, pg. 7-8 Exception for IEP,
504, PSP

• Shall not distribute any information or
  materials that are not sent or specified
• Exception Blank writing or graph paper, blank
  (clear or colored) overlay sheets, and bookmarks
  free of content (stop signs) may be given to
  students at their workstationsTHATs IT!!

16
Administration Practices, pg. 9-10
General Instructions Do your best. Get
Started. Stay on Task. Assistance or
Evaluative Comments You can do better.
17
Administrative Practices (Cont.)

• No one shall coach, edit, or point out errors in
  student work on the open response or multiple
  choice portions of the test. on-demand as well
• Appropriate interaction with students is still
  permissible in for writing portfolios.
• No evaluative statements
• Beware of body language!

18
Supervision Test Order, pg. 10-11

• During testing, proctors shall circulate
  throughout the testing site to monitor students
  as they work, verifying that students are working
  appropriately and individually. Principals
  district administrators shall ensure that proper
  monitoring occurs.
• Watch for work-aheads, work-behinds
• Make sure students complete all parts for that
  session
• Students SHALL NOT be allowed to move about the
  room during testing
• A student SHALL NOT be left alone in a room to
  take a test
• Space in the testing location SHALL NOT limit the
  proctors ability to circulate and monitor
  students during testing

19
Supervision Test Order, pg. 10-11

• Monitor Lunch, restroom breaks
• Same grade, same section, same time
• Follow time limits in testing Manuals for
  extended time, follow school procedures
• Students cannot transport secure materials
• Illness during assessment session
• Normal instruction should continue during testing
  windows, pg 12

20
Disciplinary Practices Student Motivation, pg.
12

• Re-administering for disciplinary purpose
• The original responses, along with the rewritten
  ones clearly marked NOT TO BE SCOREDITEMS
  RETAKEN FOR DISCIPLINARY PURPOSES, shall be
  submitted to the testing contractor.

21
Good Faith Effort, pg. 13

• Checklist communicated to students parents
  prior to testing
• No evaluative statements
• Feedback may not be given to students until after
  test materials have left the building
• Checklist may include a pre-writing requirement
  however, the type of pre-writing used shall be
  determined by the studentPre-write activities on
  state assessments shall not require students to
  develop a complete first draft.

22
Rewards, pg. 13

• Rewards for scores on good faith effort
  checklists or performance on state assessments
  shall be consistent with those applied within the
  regular curriculum or within the larger school
  program in general and attainable year round for
  student achievement.
• Reward systems implemented solely for state
  assessments are not permitted.

23
Writing Portfolio Development, pg. 13-15

• Teachers/Peers may
• Ask questions to clarify, indicate position of
  errors, share scoring rubric
• Teachers/Peers may not
• Make direct corrections, revisions, working after
  completion date (First day of testing window)

24
Writing Portfolios, pg. 13-16

• Teachers allow ample time for preparation of
  portfolio entries in the classroom and may allow
  some student work outside of classhowever
  excessive time shall not be spent on portfolio
  development and conferencing.
• Typewritten pieces are not required for the
  Writing Portfolio. Pieces can be handwritten.
• If typewritten is desired, students should type
  their own Writing Portfolios unless physically
  unable to do so.

25
Writing Portfolios, pg. 13-16

• When signing and scribing is used, the exact
  words of the student should be written down.
  The student can then work on editing and adding
  needed articles, conjunctions, etc.
• Cookie Cutter pieces are a violation of
  administration code
• Teachers are responsible for continuing the
  development of writing portfolios for transfer
  students.

26
Writing Portfolio Scoring, pg. 16

• Assigning scores of NAPD to portfolios prior to
  official scoring sessions is prohibited although
  classroom grades are acceptable for individual
  writing pieces.
• Who can be an official scorer?
• Certified staff
• Teacher or administrator certification
• Employed by district
• May be on leave of absence or a sub
• Current year training

27
Inclusion of Special Populations, pg. 17

• Inclusion Doc. 703 KAR 5070 (under revision)
• Accommodations provided during state assessments
  must
• Have occurred regularly during the year (roughly
  weekly)
• Be consistent with the students up-to-date IEP,
  504, or PSP (Area of ID, Goals, PLEP,
  Accommodations marked)
• Alternate Assessment
• Student Ownership
• Proctors must complete specific training
• Assessments are secure materials
• Accommodations/assistive devices consistent with
  classroom instruction
• All work must be complete by the established
  deadline

28
Additional Information, pg. 17-20

• Violations of the Administration Code, pg. 17-19,
  see next four slides
• Review of Secure Materials, pg. 19-20
• No longer allowed at the district level only
  upon request of KDE
• Reporting Nonacademic Information, pg. 20

29
Violations of Administration Code, pg 17-19

• All allegations, or perceived inappropriate
  testing procedure or behavior, should be reported
  to the Building Assessment Coordinator (BAC) and
  then to the District Assessment Coordinator
  (DAC).
• If the DAC is the one not following proper
  procedure and does not correct or report the
  situation, then a call or email can be placed to
  Patsy Kenner by any concerned person
• In LaRue County, most of our allegations have
  been self-reported when someone realizes they
  have made a mistake. We operate under an honor
  system. If you believe you have made a mistake,
  report it to your BAC so we can handle it
  appropriately.

30
Steps in an Investigation

• Allegation referred to CATS Allegations
  Coordinator
• KDE staff reviews allegation and/or director
  contacts superintendent requesting more
  information
• KDE staff conducts investigation using the Code
  of Ethics (Administration Code) as the standard
  by which a practice is measured as appropriate or
  inappropriate

31
Steps in an Investigation

• KDE staff interviews district personnel, collects
  notarized statements and supporting documents
• CATS Allegation Coordinator writes report
• Board of Review reviews findings in report and
  makes recommendation to Commissioner
• Commissioner writes letter to District
  Superintendent with his decision.
• Scores may be lowered for individual students or
  schools as a result of educator action

32
Steps in an Investigation

• Name of educator(s) involved sent to Education
  Professional Standards Board (EPSB)
• EPSB contact person(s) named in investigation