Online Test of Computer Skills Update

1
Online Test of Computer Skills Update
Information on Other Online Assessment Efforts
February 15 16 2006 Accountability
Conference Greensboro, NC

• Presenters
• Scott Ragsdale
• Randy Craven

2
Session Purpose

• Cover the results of the Pilot Administration of
  the Online Test of Computer Skills
• Review the current/recent events
• Review the Computer Skills Alternate Assessment
• Review the spring 2006 test activities
• Review the Physics Online Feasibility Study
• Review EOC Online 2006-07

3
2005 Online Test of Computer SkillsPilot
Administration

• Purpose of the pilot administration was to deploy
  the operational Online Test of Computer Skills
  with delayed reporting
• LEAs were requested to test all 8th grade
  students so that standard setting could be set on
  census data
• Provided high stakes data for standard setting

4
2005 Pilot Administration Results

• 109,584 students tested
• 99 students completing administration
• 98 of students finished in 130 minutes or less
• 432 experimental items/embedded 18 items for
  each student
• 99 SIQ data collected for Students Tested

5
2005 Pilot Administration Results

• 120,157 students registered for Online Test of
  Computer Skills
• 302 students registered for Computer Skills
  Alternate Assessment
• 745 schools with 8th grade students tested
• 97 schools with non-8th grade students tested
• 3,094 non-8th grade students tested

6
2005 Pilot Administration Results Percentage of
Platforms Used
7
2005 Pilot Administration Results

• 679 Teachers responded to surveys for
  experimental items
• 375 schools provided teacher survey responses
• Total Teacher Surveys Completed 44 of schools
  with successful completions
• 568 Help Desk tickets created for Computer Skills
  or NCDesk
• 263 Help Desk tickets created for NCRegistration
• 166 Help Desk tickets classified as irregularity
  or misadministration processing

8
Current/Recent Activities

• Pilot Administration Completed
• Computer Skills Alternate Assessment Bias Review
  and Form Review
• North Carolina Computer Skills Advisory Committee
• Standard Setting Process
• Recommendation to the State Board of Education

9
Next Steps

• NCDPI Report of Activities and recommendation of
  standards to the State Board of Education
• March 1-2 State Board of Education Action on
  First Read
• March 6 Release Scale Scores and Pass/Fail
  status to LEA Test Coordinators
• March 6 Scores released via NCRegistration and
  available in CSV format

10
Adjustments to Spring 2006 Testing

• NCDesk Update
• Client side and server side adjustments to reduce
  error messages presented to students during the
  test
• Continue button re-labeled to Next Section
• Before Next Section button is activated, students
  will be required to check that they understand
  they will not be able to return to the section
• Resuming students returned more often to the last
  item acted upon
• No students permitted to be returned to a section
  once completing the test

11
Adjustments to Spring 2006 Testing

• LEA Test Coordinators will have the ability in
  NCRegistration to reset tests
• Reset ID number for tracking purposes
• Put reset ID number on misadministration
  documentation
• Only students not passing or not having begun a
  test will be allowed to test

12
Next Administration Notes

• Spring Semester Testing Window
• March 20, 2006 June 16, 2006
• Summer Testing Window
• July 1, 2006 July 28, 2006
• Sight impaired may have to use the Computer
  Skills Alternate Assessment until JAWS
  compatibility issues are resolved
• No Teacher Survey needed for Spring

13
Score Reporting Schedule Spring 2006
14
Computer Skills Alternate Assessment

• Proficiency test used to meet standard
• Comparable standard to Online Test of Computer
  Skills
• Who should do this?
• Must register student(s) in NCRegistration to
  receive materials
• Files available on TNN
• Local scanning/scoring
• SIQs to be completed on NCRegistration

15
EOC-Physics Online Feasibility Study

• Register students in NCRegistration beginning in
  April
• Browser-based online assessment
• More info on http//cuacs8.mck.ncsu.edu/physics
• Virtual Simulations used on last 4 items
• 1 Flash Format
• 2 Java Format with files to load
• Soft section breaks unlike Online Test of
  Computer Skills students can navigate forward
  and backward across the entire test until
  completed
• SIQ completion required before student can be
  started
• Standard administrations to be completed on the
  same day

16
EOC Online 2006-07

• Optional
• Entire SchoolSubject must either use all online
  or all paper-pencil
• NCDPI is planning to print enough materials for
  all students in the state to take paper-pencil
  tests.
• Registering Scheduling to be done on
  NCRegistration
• Format follows Physics Feasibility Study (with
  adjustments)
• SIQs required to be completed in order to test
• Students will have to complete on the same day
  unless they have an accommodation recorded in SIQ
• Technical problem can be allowed as a valid
  reason for letting a student return on another
  day. This process will have to be set up in
  NCRegistration.
• May need to have a lottery for number of students
  and/or session slots a per subject per day
  quantity will likely have to be established in
  order to keep the test servers responsive to
  students.
• 3 week window at end of course for student
• 6 week window that will be open for sessions to
  be scheduled for fall and spring

17
Thank You!

• The success of one is most often the result of
  the struggle and resolve of a thousand.

18
Q A

• Online Test of Computer Skills
• Computer Skills Alternate Assessment
• EOC-Physics Online Feasibility Study
• EOC Online 2006-07

19
Additional Resources

• http//cskills.ncsu.edu/nccs/
• http//cskills.ncsu.edu/ncdesk/
• http//www.ncpublicschools.org/curriculum/computer
  skills/
• http//community.learnnc.org/dpi/tech/
• http//www.ncpublicschools.org/accountability/test
  ing/computerskills/
• http//tps.dpi.state.nc.us/