Online Testing: STC Examiner Training

1
Online TestingSTC / Examiner Training

• Westmoreland County Public Schools
• Department of Instruction and Assessment
• Jason Breeden
• November 15, 2006
• NON-Writing FALL 2006

2
Agenda

• Online Testing Overview
• Online Testing Procedures
• Manipulatives
• Resources/Training
• Early Warning System
• Accommodations
• Paper/Online Comparison

3
Online Testing Overview

• Web-based
• Secure test delivery
• Locks down desktop
• Screen Saver disabled
• Single item format
• 800x600 screen resolution
• Ability to review
• Pre-cache test
• Save answers

4
Procedures for Online Testing

• STC controls sessions, test tickets, and reports
  from office
• Examiners sign out test tickets, report test
  interruptions, monitor test session
• Technology support available at each school
  during testing
• Monitor bonnets/partitions may be used for
  additional security
• Monitor turned off if student temporarily leaves
  room
• Alternate location used for extended time

5
Procedures for Online Testing

• Examiner may assist with directions about how to
  use TestNav
• Students raise hand at end of test
• Examiner checks Review Screen to ensure all
  questions answered
• Students Exit if temporarily leaving the test or
  if test is not to be scored
• Moving to alternate location or different
  computer
• Became ill during test and not returning to
  finish
• Students Submit if finished testing and test is
  to be scored

6
TestNav Review Screen

• Exited tests are not scored and can be resumed or
  stopped by STC
• Submitted tests are scored and cannot be changed
  to a different status

7
TestNav Confirmation Screens

• Summary screen lists number of items unanswered
  before moving forward
• Final confirmation screen confirms that the test
  should be exited/submitted

8
Student Testing Status
9
Online Test Tickets

• Must be signed out/in as secure materials
• Equivalent to test booklet
• Not valid until session started
• Not valid if student exits until resumed
• Not valid after test submitted
• Mark absent students with large A

10
Recommendations

• Notify parents of online testing opportunities
• Provide web addresses for TestNav Tutorial,
  eTools Live, and ePAT
• Use test tickets to assign seats in lab
• Have login screen showing on monitors when
  students enter lab
• Do NOT allow students to close last screen until
  all students are dismissed from testing location

11
TestNav Login Screen

• When logging into TestNav
• Test user name and password not case sensitive

12
Test Security Guidelines

• ALL individuals involved in testing (paper/pencil
  OR online) must read, understand, and sign new
  Test Security Guidelines
• Includes a statement that the person signing
  understands if test security procedures are not
  followed his or her license may be suspended or
  revoked

13
Online Manipulatives

• All manipulatives allowed for a test are
  available as online tool except graphing and
  scientific calculators
• Students may use handheld formula sheets
• Science and mathematics tests will have
  straight-edge tool available
• Science and mathematics ePAT applications now
  include straight-edge tool

14
Online Manipulatives

• No manipulatives should be used by students
  during online tests that involve touching,
  writing on, and/or tracing on computer monitor
• Examples of such manipulatives not allowed
  include patty paper, tracing paper,
  transparencies, dry erase or overhead markers

15
Resources for Online Testing
16
Resources for Online Testing
17
Student Training

• Scheduled and conducted by STC or trained
  teachers
• Begin at least 3 weeks prior to SOL tests
• Notify DDOT of scheduled training for
  infrastructure setup

18
Student Training Options

• TestNav Tutorial for overview of application
• Training test used for simulating live testing
  environment with TestNav security
• Audio training test for practice with media
  controls
• ePAT for content review/remediation and TestNav
  tool and navigation training
• eTools Live for specific practice with online
  manipulatives

19
ePAT Home Page
20
Early Warning System

• Alerts Examiner/student when connection to
  testing server is interrupted or save locations
  not valid
• Ability to save student responses when
  interrupted
• Message appears on screen at time of interruption
  and automatically saves responses to encrypted
  file
• Student permitted to continue testing
• Answers submitted to testing server when
  connection reestablished
• Response file automatically erases after answers
  uploaded

21
Lost Connection 1
22
Lost Connection 2
The connection to the testing server was lost
during testing and the response file was
successfully saved locally to the designated save
location.
23
Incorrect Student Status
The connection to the testing server was lost
after the student completed the test and after
all responses were successfully received by the
testing server, but before the students testing
status could automatically be changed to
Stopped.
1st
Retry Normal Exit first, then contact Jason
24
Save Location Invalid
The student launched TestNav, but TestNav
determined that a designated save location is
no longer valid. Contact Jason
25
Student Status Error
When the student launched TestNav, TestNav
detected a saved response file, but the students
status is set to Resume (instead of Resume
with File). Contact Jason
26
No File Found
The students test status is set to Resume with
File on the Resume With File screen, but no
saved response file for this student was found in
the designated save location. Contact Jason
27
Corrupted Save File
A student with a Resume with File status
launches TestNav to resume a test, but TestNav
detects that at least one of the saved response
files is invalid. Contact Jason
28
Early Warning System Triggers

• TestNav has tried three consecutive times to
  transmit a response and was not successful.
• The TestNav client fails to fetch an item file
  after three consecutive attempts.
• TestNav client has not received a confirmation of
  a successful or unsuccessful transmission in 180
  seconds while the student is testing.
• The TestNav client has not received a
  confirmation of a successful or unsuccessful
  transmission of responses within 30 seconds of
  the student a) submitting the test, or b) exiting
  the test (either intentionally or by a security
  breach).

29
Reporting Test Interruptions

• Examiner identifies cause of interruption
• Student intentionally Exited from test
• Test exited for unknown reason
• Students computer lost connection (EWS screen)
• Students save location invalid (EWS screens)
• Examiner contacts STC to have student resumed
• Inform STC of cause of interruption
• STC resumes student based on cause
• STC contacts technology if necessary
• Examiner has student log back into test

30
Accommodations Overview

• Accommodations provided if specified in students
  IEP, 504 management tools, or LEP SOL
  Participation Form
• Same procedures apply to paper and online
• Some accommodations not available for online
  testing

31
Accommodations Available
32
Accommodations Not Available
33
Read-aloud Presentation

• Examiner receives Proctor test ticket for each
  session (printed on colored paper)
• Examiner reads test from separate workstation
• Examiner answers NO questions
• Examiner submits test at end of session
• Read-aloud session tape recorded
• Examiners test not scored

34
Online Audio Presentation

• Proctor Caching must be used
• Audio control box appears with media player
  controls
• Headphones required if more than one student
  present
• Test items played as each question viewed
• Audio Training Test available for training
  students before testing

35
Sample Audio Item
36
Paper/Online Comparison
37
Paper/Online Comparison
38
Questions?

• 493-8099
• breedenjs_at_wmlcps.org