JUST READ, FLORIDA

1

JUST READ, FLORIDA!
2
National Assessment of Educational Progress
(NAEP)

• The Nations Report Card
• Nations only measure of student
• achievement in the United States
• that can be used to
• Compare the performance of students in Florida
  with the performance of students across the
  nation and in other states
• 2. Track changes over time

3
NAEP

• Has produced National results for grades 4, 8,
  and 12 since 1969
• Has produced state-level results at grades 4 and
  8 since 1990
• Has produced results for Trial Urban Districts
  (TUDA) since 2002
• Does not produce student-, school-, or
  district-level results, except for the 10 TUDAs

4
Current OrganizationStructure of NAEP
5
Federal Legislative Reference

• No Child Left Behind Act of 2001 (NCLB)
• Section 111(c)(2) of NCLB requires
  states/districts who receive Title I funding to
  participate in biennial State NAEP assessments of
  4th and 8th graders in Reading and Mathematics,
  beginning with the 2002-2003 school year.

6
State Legislative Reference

• Florida State Statute 1008.22 (2)
• The Commissioner of Education shall direct
  Florida school districts to participate in the
  administration of NAEP . . . both for the
  national sample and for any state-by-state
  comparison programs .
• State legislation requires all selected schools
  to participate in all NAEP assessments.

7
NAEP Components
STATE (Public) (Grades 4 8)
8
NAEP Assessment Schedule
9
NAEP Frameworks

• The American Institute of Research (AIR) develops
  the NAEP frameworks.
• The National Assessment Governing Board (NAGB)
  approves and adopts the frameworks after they
  have been reviewed and critiqued by teachers.
• Each framework describes the content and format
  of the 4th, 8th, and 12th grade assessments.
• There are frameworks for each of the content
  areas assessed by NAEP.

10
NAEP Design Item Development

• Items are based on the subject area frameworks
  approved by the National Assessment Governing
  Board (NAGB).
• Items are developed by teachers, subject area
  specialists, and assessment experts.
• Items meet professional standards for testing.
• Experts review items for technical/statistical
  quality, content quality, bias, and sensitivity.

11
How Floridas School Sample is Selected

• Step 1 Lists of schools are obtained from the
  National Center for Education Statistics Common
  Core of Data (CCD).
• Step 2 Schools are grouped into strata by two
  primary characteristics
• Type of location (central city, urban fringe,
  rural)
• Minority enrollment (white, African-American,
  Hispanic)
• Step 3 Within strata, schools are ordered by a
  measure related to achievement.
• Step 4 A proportional sample is selected
  systematically from the ordered list.

12
Floridas Measure of Achievement

• Grade 4
• Mathematics average scale scores for all
  students, grade 4, in 2005
• Grade 8
• Median household income because the match rate
  for achievement scores for 8th grade was less
  than 70

13
How is the Student Sample Selected?

• A list of all 4th or 8th grade students enrolled
  at the sampled schools is submitted
  electronically to Westat from the FLDOE, based on
  the October FTE.
• 90 of selected students must participate in the
  assessment or a make-up session is scheduled.
• Students exempted by their parents are not
  replaced and are not used to calculate the
  assessment participation rate.

14
NAEP 2007

• NAEP assessments will be administered in Florida
  from
• January 22 through February 21, 2007.
• Assessment will only take 90 minutes of a
  students time.
• Assessment is administered by a team from Westat,
  the NAEP administration contractor for the US DOE
  and National Center for Education Statistics
  (NCES).
• Parents must be notified prior to the assessment.

15
Sampling Schools and Students

• 350 Florida public schools in 52 districts will
  participate in some type of NAEP Assessment in
  2007.
• At grade 4 Reading and Mathematics
• Floridas sample will include 167 schools.
• Schools can elect to take all students (up to
  120).
• If there are more than 120 4th graders, NAEP
  will select a sample of 62 students to assess.
• At grade 8 Reading, Mathematics, and Writing
• NAEP will select a sample of 93 students at each
  of the 161 Florida schools included in the
  sample.
• At grade 12 Reading, Mathematics, and Writing
• Floridas sample will include 31 high schools.
• 75 students from each school will be selected to
  participate.

16
NAEP Inclusions and Accommodations

• NAEP has included students needing accommodations
  since 1998.
• Students with disabilities and limited English
  proficient students are to be included in NAEP
  based on an IEP/504 Accommodations Plan/LEP Plan
  team decision.
• Most frequent accommodations with NAEP
• Extra testing time
• Individual or small group administrations
• Large print booklets
• Does not include reading aloud of passages or
  questions on the NAEP reading assessment.
• Assessment must be completed in one day.
• Assessment is not available in Braille unless the
  district or state provides it.

17
Analysis and Reporting

• National, State, and Trial Urban District
  Assessment (TUDA) results.
• NAEP scores are reported in two ways by Scale
  Scores and by Achievement Levels
• No student, classroom, or school results are
  provided
• No district results are provided except for the
  TUDAs
• Subgroup, state, and national comparisons can be
  made
• Relationships between student proficiency and
  certain background variables are available

18
NAEP Scale Scores

• Scale scores provide a comparison of student
  performance with regard to a group (e.g., the
  nation) or a subgroup (e.g., LEP) on a set of
  items.
• Scale scores
• Reading and Mathematics scale score range is
  0-500
• Science and Writing scale score range
• is 0-300
• Scale scores are reported as an average for
  groups of students and may obscure progress or
  problems related to student performance across a
  distribution of scores.

19
National NAEP Scale Scores for Grades 4 and 8
Reading

• National NAEP average reading scale scores are 2
  points higher in 2005 than in 1992
• at both grades 4 and 8.

20
National NAEP TrendsGrade 4 Reading

• White students scored higher, on average, in
  reading than their African-American and Hispanic
  peers.
• African-American and Hispanic students each
  scored higher, on average, in 2005 than in 2003.
• Score gaps between white and African/American
  students and between white and Hispanic students
  narrowed between 2003 and 2005.

21
National NAEP Trends Grade 8 Reading

• White, African-American, and Hispanic students
  scored higher, on average, in reading in 2005
  than in 1992.
• The score gap between white and Hispanic students
  decreased by 2 points between 2003 and 2005.

22
Florida Compared to the NationNAEP 2005 Scale
Scores Grade 4 Reading
Of the 52 states and other jurisdictions that
participated in the 2005 4th grade reading
assessment, students average scale scores in
Florida were higher than that of 15
jurisdictions, not significantly different from
that of 19 jurisdictions, and lower than that of
17 jurisdictions.
23
Florida Compared to the NationNAEP Scale Scores
1998-2005 Grade 4 Reading
Florida improved from scoring below the National
Average in 1998 to above the National Average in
2005.
24
Florida Compared to the NationNAEP 2005 Scale
Scores Grade 8 Reading
Of the 52 states and other jurisdictions that
participated in the 2005 8th grade reading
assessment, students average scale scores in
Florida were higher than that of 5
jurisdictions, not significantly different from
That of 11 jurisdictions, and lower than that of
35 jurisdictions.
25
Florida Compared to the NationNAEP Scale Scores
1998-2005 Grade 8 Reading
Florida grade 8 performance parallels and
continues to score below the National
performance.
26
NAEP Grade 4 Reading 1998 - 2005Florida and the
Nation Average Scale ScoreRace/Ethnicity
27
NAEP Florida and the Nation Grade 4 Reading 1998
- 2005

• Performance Gaps Between
• Average Scale Scores
• by Race/Ethnicity

28
NAEP Grade 8 Reading 1998 - 2005Florida and the
Nation Average Scale ScoreRace/Ethnicity
29
NAEP Florida and the Nation Grade 8 Reading 1998
- 2005

• Performance Gaps Between
• Average Scale Scores
• by Race/Ethnicity

30
NAEP Achievement Levels

• NAEP Achievement Levels (ALs) try to identify
  what students should know and be able to do at
  various achievement levels.
• Advanced, Proficient, Basic, and below Basic
  indicate NAEP achievement levels. Each is
  determined by cutpoints established by
  professional educators and NAGB.
• The number or percentage of students in the
  population at large or in subpopulations can be
  reported by the four achievement levels.
• Results show how different groups are performing
  in relation to each other and over time.

31
National Percentage of StudentsPerforming at
NAEP Achievement Levels Grade 4 Reading 1992 -
2005

• Grade 4 percentage of grade 4 students
  performing at or above Basic increased from
• 60 percent in 1992 to 63 percent in 2005

32
National Percentage of StudentsPerforming at
NAEP Achievement Levels Grade 8 Reading 1992 -
2005

• Grade 8 percentage of grade 8 students
  performing at or above Basic increased from
• 68 percent in 1992 to 71 percent in 2005

33
Florida Compared to the Nationat or Above Basic
Grade 4 Reading 2005
Of the 52 states and other jurisdictions that
participated in the 2005 grade 4 reading
assessment, the percentage of students scoring at
or above Basic in Florida was higher than that
of 15 jurisdictions, not significantly different
from that of 19 jurisdictions, and lower than
that of 17 jurisdictions.
34
Florida NAEP Achievement Levels Grade 4 Reading
1992 - 2005
Florida has a greater percentage of students
scoring at Basic and Above in 2005 than does the
Nation.
35
Florida Compared to the Nationat or Above Basic
Grade 4 Reading 1998 - 2005
Florida went from scoring below the National
average in 1998 to scoring above the National
average in 2005 at the Basic and above
achievement level.
36
Florida NAEP Achievement Levels Grade 4 Reading

• The percentage of students in Florida who
  performed at or above the NAEP Basic level was 65
  percent in 2005. This percentage was not
  significantly different from that in 2003 (63
  percent) but greater than that in 1992 (53
  percent).
• Florida is one of six states that had more than a
  10 point increase in the percentage of low-income
  students that performed at the Basic level or
  higher between 1998 to 2005.

37
Florida Compared to the Nationat or Above Basic
Grade 8 Reading 2005
Of the 52 states and other jurisdictions that
participated in the 2005 grade 8 reading
assessment, the percentage of students scoring at
or above Basic in Florida was higher than that
of 4 jurisdictions, not significantly different
from that of 13 jurisdictions, and lower than
that of 34 jurisdictions.
38
Florida NAEP Achievement Levels Grade 8 Reading
1998 - 2005
Florida has a smaller percentage of students
scoring at Basic and above than does the Nation.
39
Florida Compared to the Nationat or Above Basic
Grade 8 Reading 1998 - 2005
Florida grade 8 performance parallels and
continues to score below the National
performance.
40
Florida NAEP Achievement Levels Grade 8 Reading

• The percentage of students in Florida who
  performed at or above the NAEP Basic level was 66
  percent in 2005. This percentage was not
  significantly different from that in 2003 (68
  percent) and in 1998 (67 percent).

41
NAEP AND FCAT

• FCAT measures student performance on selected
  benchmarks, as defined by Floridas SSS
• NAEP reports on the performance of groups of
  students at a given time - and across time -
  without specifying how a subject should be taught

42
FCAT and NAEP Grade 4 Reading by Achievement
Level 1998 - 2005
Percentage of students scoring at Level 3 and
above on FCAT and Basic and Above on NAEP
increased between 1998 and 2005.
43
FCAT and NAEP Grade 8 Reading by Achievement
Level 1998 - 2005
Performance of grade 8 students has been flat on
both the FCAT and NAEP.
44
FCAT and NAEPGrade 4 Reading 1998 - 2005
Race/Ethnicity
White, African-American, and Hispanic students
all improved from scoring lower on the FCAT than
on NAEP in 1998 to higher on the FCAT than on
NAEP in 2005.
45
FCAT and NAEPGrade 8 Reading 1998 - 2005
Race/Ethnicity
White, African-American, and Hispanic students
continued to score higher on NAEP than on the
FCAT.
46
The Nations Report Cardhttp//www.nces.ed.gov/na
tionsreportcard/
47
NAEP Websites

• Floridas NAEP website
• http//firn.edu/doe/sas/naephome.htm
• NAEP website
• http//nces.ed.gov/nationsreportcard/
• NAEP Data Explorer
• http//nces.ed.gov/nationsreportcard/nde/
• NAEP Questions Tool
• http//nces.ed.gov/nationsreportcard/itmrls

48
NAEP Coordinator Contact Information

• Michele Sonnenfeld
• NAEP State Coordinator
• Florida Department of Education
• [phone]
• SC 205-0787
• FAX [phone]
• SC 205-0781
• Michele.Sonnenfeld_at_fldoe.org