FCAT Science

1
FCAT Science

• High School Test Grade 11
• How did this happen?
• Why didnt I know?

2
History of Grade Choices

• Original 1999 Legislation
• Grades 4, 8, and 10
• DOE Recommendation
• Grades 5, 8, and 10
• Rationale
• Reading and Writing at Grade 4
• Mathematics and Science at Grade 5

3
Grade 10 Concerns

• Content Advisory Committee
• Concerns from the beginning
• What Science of the SSS can be taught and tested
  by March of Grade 10?
• Item Review Committees
• Can we include these items if all students have
  not had instruction?
• Rangefinding Committees
• Can we require this top score point if all
  students cant be expected to know this ?

4
1 Test Administration History

• 2002 Field Test
• Item writing challenges
• Test construction challenges
• Hard to find top score responses to performance
  tasks

5
2 Test Administration History

• 2003 First Scores Reported
• Interpretation Comparing to the State scores
• Low percent answering questions correctly
• Lots of blank performance tasks
• Questions
• Lack of learning?
• Lack of consequences? (Student/School)

6
3 Test Administration History

• 2004 Second Scores Reported
• Performances somewhat improved
• Preparing for Standard Setting Fall 2004
• Pre-standard setting meeting January 2004
• What performance represents on-grade level
  performance? Above grade level? Below grade
  level?
• Grade 10 Group Struggled with on grade level
• What content is on-grade level for all 10th
  graders?

7
FCAT Science Performance
Grade Year Avg. Correct
5 2003 57
2004 55
8 2003 51
2004 53
10 2003 49
2004 51
8
4 Field Test at Grade 11

• Question Could the items developed for grade 10
  be used at grade 11 without additional field
  testing.
• March 2004 test was used (same as 10th)
• Statistical sample of 3,000 identified
• Ten schools from 8 districts were included
• Findings (late July) An acceptable Grade 11
  test can be built using existing statistical data
  from the items developed and field tested for
  Grade 10.

9
DOE Policy Considerations

• Keep test at Grade 10 Expect less science
• Move to Grade 11 Expect more science
• Instructionally valid
• Statistically appropriate
• Legally challengeable (law says grade 10)
• Test both grades
• 10th to conform to the law
• 11th to collect data for standard setting
• Cost for adding grade 11 - 1.2 million

10
Move to Grade 11

• Pros
• Test will have more instructional validity
• Better scores are more likely
• Content advisory and administrative support
• Recommended by science teachers and curriculum
  specialists

• Cons
• Hard to motivate juniors
• Too much testing of juniors already
• No student consequences
• Logistical challenges of test administration with
  reading/math retakes

11
Thinking About Consequences

• Inclusion in A school accountability (2006-07)
• Should there be student consequences?
• Pass for graduation
• Diploma endorsement (high scores)
• Require Level 1 (2?) students to pass another
  science course prior to graduation

12
So, where are we?

• Plans under way to change law and rule
• Changes student consequences also?
• Administer in Grade 11 in 2005
• Set standards for Grade 11 in Fall 2005
• Report scores in 2005 and 2006
• Include in A School Accountability in 2006-07

13
Questions?

• Dr. Cornelia S. Orr, Director
• Assessment and School Performance
• cornelia.orr_at_fldoe.org
• 850/245-0513