Virginia Substitute Evaluation Program The VSEP Process

1
Virginia Substitute Evaluation ProgramThe VSEP
Process

• August 2008
• Administrators Update Workshops
• Virginia Department of Education

2
Agenda

• What is VSEP?
• For whom is VSEP appropriate?
• Steps in the VSEP Process
• Appeal, Resubmission

3
Virginias Assessment Program Options for
Students with Disabilities
4
What is VSEP?

• Alternative to paper-pencil or online SOL test
• Grade level assessment
• Measures the SOL on the test blueprint
• The student provides evidence of achievement
  through the Course Work Compilation
• The student may earn verified credit
  
• The student may earn numeracy/ literacy
  certification for a Modified
  Standard Diploma

5
VSEP Trends 2007-2008

• 252 Course Work Compilations scored
• 51 fall, 201 spring
• 36 school divisions participated

6
VSEP Trends 2007-2008
CWCs by Content Area

• Literacy 21
• Numeracy 47
• English Reading 18
• English Writing 16
• Earth Science 30
• Biology 20
• World Geography - 25

• Va. US History 12
• World History I 23
• World History II - 2
• Algebra I 32
• Geometry 5
• Algebra II 1

7
VSEP Trends 2007-2008

• Fall Pass Rates
• Literacy.... 50 Numeracy.... 91
• EOC. 50
• Total59
• Spring Pass Rates
• Literacy 95 Numeracy.72
• EOC..74
• Total76
• Overall Pass Rate.....72

8
Pass Rates by Content Area
9
Who? - Eligibility Criteria

• The decision is made by the IEP Team/ 504
  committee.
• The student has a current IEP or 504 Plan.
• The student is enrolled in a course or has
  passed a course that has an SOL EOC
  test and/or the student is pursuing a
  Modified Standard Diploma and seeking
  certification to meet the
  literacy and/or numeracy requirements.

10
Who? - Eligibility Criteria

• The impact of the students disability
  demonstrates to the IEP team or 504
  committee that the student will not be able to
  access the SOL assessment(s), even with
  accommodations, and requires a substitute
  evaluation.
• All accommodations listed have been
  considered for use with the student in
  the course/content submission area.

11
Eligibility

• Justification for determining eligibility for the
  VSEP should not be based on the following
• students disability
• belief that the student may fail the test
• belief that the student does not
  need this assessment to be promoted to the next
  grade or to graduate
• student is reading or is
  performing below grade level

12
Eligibility

• Justification for determining eligibility for the
  VSEP should not be based on the following
• belief that the experience will be too stressful
  for the student
• students behavior prohibits taking the
  test with a group or
• student has not mastered all of the
  curricula that are covered in the
  assessment(s).

13
Steps in the Process

• During the IEP Team meeting or 504 Committee
  meeting
• Consider assessment options
• Consider all appropriate accommodations before
  considering VSEP.
• Discuss how the student accesses the
  SOL content.
• Consider the VSEP criteria on a test
  by test basis.

14
End of Course Content Areas

• English Writing
• English Reading
• Algebra I
• Algebra II
• Geometry
• Biology

• Earth Science
• Chemistry
• Virginia and United States History
• World History I
• World History II
• Word Geography

Grade 8 Content Areas Required for the Modified
Standard Diploma Reading (literacy
assessment) Mathematics (numeracy assessment)
15
Steps in the VSEP Process

• During the IEP Team meeting or 504 Committee
  meeting
• Inform the parents and the student
• Discuss with the parents and student
• SOL Test Blueprint
• Types of evidence allowed
• Scoring rules
• Date for submission of CWC
• Fall January 9, 2009
• Spring May 22, 2009

16
Required Forms

• At the IEP Team/ 504 meeting
• Intent to Submit a Substitute Evaluation
• Criteria
• Accommodations
• Justification Statement
• Signatures

17
Intent to Submit a Substitute Evaluation

• Criteria
• Consider the criteria for VSEP on a test-by-test
  basis.
• If no is checked, the student is not eligible
  for VSEP.

18
Intent to Submit a Substitute Evaluation

• Accommodations
• Check all accommodations that the team
  determines the student requires.
• These accommodations are required for
  daily instruction and assessment.

19
Justification Statement

• Provide a justification statement and reference
  documentation as to why the IEP team or 504
  committee has determined that the impact of the
  students disability prevents access to
  the SOL assessments even with
  accommodations.

20
Justification Statement

• Teachers should reference data in the students
  cumulative record including the most recent
  psychological evaluation, medical reports,
  learner characteristics, and/or teacher
  observations. This justification statement
  should be unique and individualized for the
  student.

21
Justification Statement

• The Justification Statement should include
• a brief overview of the students disability
• the impact of the disability on the students
  classroom performance and
• the accommodations that have been used
  in classroom, division, or state
  assessments, and impact on the
  students performance.

22
Sample Justification Statement

• Kimberly
• 12th grade student
• learning disability in mathematics

23
Evaluation Plan/ Worksheet

• New for 2008-2009
• One for each VSEP course/ content area
• Replaces the Evaluation Plan form from previous
  years
• Lists the standards according to
  the SOL Test Blueprint
• Teacher(s) need to list only the method or
  product for evaluation.

24
Evaluation Plan/ Worksheet

• Include the completed and signed
  Evaluation Plan Submission Form.
• CWC should be organized according to
  the Evaluation Plan/ Worksheet.
• Teacher(s) may use the Evaluation Plan /
  Worksheet to monitor the CWC throughout
  the course.

25
Virginia Substitute Assessment Program Evaluation
Plan/ Worksheet End of Course Reading Name
__________________________ State Testing
Identifier (STI) ______________ Course Content
Teacher __________ Special Education
Teacher_________________ Directions This
Evaluation Plan will explain how the student will
demonstrate individual achievement of each SOL
addressed in the test blueprint. Each SOL stem
and bullet should be addressed in this plan. The
plan should address evidence for the CWC over the
duration of the course and must reflect a
complete demonstration of the skills and
knowledge related to the standards addressed in
the test blueprint. It should contain the
methods or products used to demonstrate
achievement of the standards. The plan should be
unique and individualized for the student.
Submit one copy with the Evaluation Plan
Submission Form. Use your copy to monitor the
CWC throughout the semester.
26
(No Transcript)
27

• Journal entries in response to newspaper
  articles, manuals, journals, essays, etc.
• Audio tape of Sam reading a speech.
• Audio journal in response to biographies and
  autobiographies.
• Vocabulary quizzes.

• .

• Plagiarism worksheet.
• Research Power Point presentation.
• Research notes.
• Research report writing quiz.

• Research report writing quiz.
• Technology use test.
• Technology use worksheet.

• .

• Worksheets on skimming manuals, newspapers, and
  catalogs.
• Informational sources test. (short answer items)

• .

28
Evaluation Plan/ Worksheet

• The Evaluation Plan/ Worksheet forms are
  available at
• www.doe.virginia.gov/VDOE/Assessment/VSEP/Workshee
  ts/indexvsep.htm

29
Approval Process

• The teacher should submit to the DDOT
• Intent to Submit a Substitute Evaluation
• Justification Statement
• Evaluation Plan Submission Form
• Evaluation Plan/Worksheet
• The DDOT will submit the packet to VDOE

30
Approval Process

• Approval/ Denial form should be returned to DDOT
  within 10 days.
• Has been revised to make it easier
  to determine area(s) that need to be
  corrected in the packet.
• May collect evidence once the
  Evaluation Plan is approved.

31
Course Work Compilation

• Student should provide evidence for each SOL and
  SOL bullet in the SOL Test Blueprint
• Vary the types of evidence
• Include the types of evidence that the
  student uses to demonstrate knowledge
• Organize evidence according to the
  Evaluation Plan/ Worksheet.

32
Types of Evidence

• Work samples
• Multiple choice evidence is not allowed.
• Audio/ video
• Indicate the file type when submitting evidence
  on DVD
• Anecdotal records
• Interviews
• Data charts/ graphs
• Captioned photographs
• The caption should describe student
  performance.

33
Organization of the CWC

• Use the SOL Test Blueprint as a guide to
  organizing the CWC.
• Teachers may indicate where the evidence for a
  particular standard may be found on the piece of
  evidence.
• Teachers should indicate the accommodations used
  on the evidence.

34
Organization of the CWC

• A piece of evidence may be photocopied to be
  placed under more than one reporting category.
• Remember to grade each piece of
  evidence (including media) so that correct
  responses are clearly indicated.

35
World Geography
36
Tips for Teachers - Evidence

• Evidence must be student-generated
• Cannot be copied from text, computer, charts,
  etc.
• Cannot be homework, take-home
  test, etc.
• Examples on the evidence cannot
  provide answers

37
Tips for Teachers - Evidence

• Can only consider group work when the individual
  achievement of the student is clear
• Make sure the evidence relates to the SOL
  being defended
• Look at the verb(s)

38
Tips for Teachers - Evidence

• Include evidence for each item in the stem and
  bullet.
• Include evidence for all SOL in the Test
  Blueprint.

39
Tips for Teachers SEI Tags

• Evidence must include a correctly completed SEI
  Tag
• Without the SEI Tag, the evidence cannot be
  considered
• Put the SEI Tag on the DVD case, not
  the DVD
• Label the DVD with a pen with the
  information from the SEI Tag
  including file format.

40
Tips for Teachers

• Accommodations
• Document accommodations on the evidence.

41
Tips for Teachers

• Picture Captions
• Captions
• Clearly indicate the students
  level of correctness or
  achievement.
• Only photos with captions can be
  considered in scoring.

42
Tips for Teachers

• Grading
• All work samples graded by the teacher.
• Clearly identify correct and incorrect answers.
• Letter grade, numerical grade, evaluative
  comments, as determined by the
  teacher

43
Tips for Teachers

• Grading
• Other evidence (audio, video, anecdotal
  record, etc.)
• Include a statement of accuracy describing
  the students level of achievement of
  the SOL.
• Ungraded work cannot be
  considered in scoring.

44
Prepare to Submit the CWC

• Required forms
• Evaluation Plan Approval/ Denial Form
• Approved
• Course Work Compilation Submission Cover Sheet
  and Affidavit
• Signed by all staff who contributed to the CWC
• Signed by the building administrator or designee

45
Prepare to Submit the CWC

• VSEP Teacher Checklist
• Administrators Checklist
• Completed Course Work Compilation Submission
  Checklist

46
VSEP Appeal Process

• Purpose to ensure that the score assigned is an
  accurate representation of student achievement
• Parent or school personnel may make the
  request

47
VSEP Appeal Process

• A VSEP score may be appealed if
• If the student failed AND
• There is evidence the CWC should have
  received a higher score.
• at least two division staff members who are
  familiar with the VSEP rubric review
  the CWC and agree that it should have
  received a higher score.

48
RESUBMISSION

• A students failed CWC may be resubmitted.
• Evaluation Plan should address only the
  reporting categories that received low
  scores in the original submission.

49
RESUBMISSION

• Resubmit the entire CWC
• Include all evidence for reporting categories
  that were scored previously and not changed
• Include the new evidence for reporting categories
  that were previously scored less than adequate
• Include the affidavit from the previous
  submission and a new affidavit for the new
  evidence

50
Questions

• Contact Information
• Division of Student Assessment and School
  Improvement
• Office of Test Administration, Scoring, and
  Reporting
• 225-2107
• Student_Assessment_at_doe.virginia.gov