Reporting Testing Irregularities Online

1
Reporting Testing Irregularities Online

• Turning Challenges into Opportunities

2
Brief History of OTISS

• System developed in 2005-06
• Phase 1 implemented in Spring 2007
• Three LEAs reported testing irregularities online
• Grade 3 Pretest
• Incorporated feedback to increase usability and
  enhance user manual

3
Brief History of OTISS (Contd)

• Implemented Phase 2 in Fall 2007
• Used by 25 LEAs to report EOC testing
  irregularities
• Regional Accountability Coordinators (RACs)
  trained
• Online training sessions conducted
• Forms redesigned
• Iterative process of using feedback to improve
  system

4
Definition of Opportunity

• opportunity   (op'?r-too'ni-te) noun, plural
  -ties.
• a situation or condition favorable for attainment
  of a goal
• a good position, chance, or prospect, as for
  advancement or success

5
Opportunities

• Saves time
• Less paperwork
• More secure
• Less faxing
• Less filing
• Defined process eliminates guesswork

6
Definition of Challenge

• challenge (chal'?nj) n.  
• A test of one's abilities or resources in a
  demanding but stimulating undertaking a career
  that offers a challenge.

7
Challenges

• Managing passwords
• Virtual training
• Technophobia
• E-mail notification
• Testing Irregularity Categories
• Updating system and user manual

8
Challenges (Contd)

• Challenges are addressed in three ways
• System modification (Ex E-mail character
  increase)
• Training/User Manual Update(Ex Managing
  passwords)
• Sometimes both(Ex Student Information)

9
Testimonials

• Bob WillDirector of Accountability
  NCWISEWilkes County Schools
• Donna Clelland Director of Testing and
  Accountability Asheboro City Schools
• Melissa Moose System Testing Coordinator
  Catawba County Schools

10
Chain of Command
11
Scenario 1

• A teacher asks a School Test Coordinator for
  information on how to enter an irregularity at
  the Basic Reporting level.

12
Scenario 2

• A LEA Test Coordinator receives an e-mail from a
  School Test Coordinator requesting passwords for
  his/her school.

13
Scenario 3

• A fire alarm disrupts a whole class being tested.

14
Scenario 4

• A LEA Test Coordinator classifies a testing
  irregularity and sees the following message
• Download the attached investigative
  checklist. Conduct the investigation in
  accordance to the checklist. Additionally, click
  on the "Return to School" button to send the
  irregularity to the school so the school can
  conduct an investigation. The school will be
  instructed to print, sign, and return the
  irregularity to the LEA Test Coordinator for
  completing the documentation of this
  irregularity.

15
Scenario 5

• A School Test Coordinator receives an
  irregularity in his/her New/Pending box sent back
  from the LEA with the following text
• Download the attached investigative checklist.
  Conduct the investigation in accordance to the
  checklist. Re-submit the irregularity to the LEA
  TC. Print the irregularity, complete signatures
  and send to your LEA test coordinator.

16
Fun Questions

• Can you name the band and/or the name of the song
  playing when you entered the room?
• How is the song related to the online reporting
  of testing irregularities?

17
The Time is Now

• Kudos to Julien Alhour!
• Many thanks to Dr. Garner for working on the
  blueprints with TSAC!
• System enhancements in process
• Contact me to schedule online training
• Brian_Swiger_at_ncsu.edu
• Thank you for attending the OTISS presentation!