Northwest Evaluation Association

1
Northwest Evaluation Association

• Measures of Academic Progress
• MAP

MI-1
2
Informing Decisions with Useful DataAllan
OlsonNorthwest Evaluation AssociationLinda
ClarkMeridian School District (ID)Mike
PattersonNorthwest Evaluation Association
3
Many Purposes for Assessment

• External accountability
• Instructional planning
• Screening for special needs
• Monitor progress toward standards
• Promotion Graduation Decisions
• Reporting to parents
• Program Improvement

4
Components of an Ideal Assessment System

• Accurate for every student
• Measures growth over time
• Timely and useful reports
• Aligned with standards
• Useful for internal accountability
• Useful for external accountability

MI-4
5
Design of Conventional Assessments

• Measure average students in a grade
• Purpose is external accountability
• Not standards aligned
• Weak for cross-grade or longitudinal comparisons

Adult Reading
x
x
x
x
x
5th Grade
x
x
x
x
x
x
x
x
x
x
Beginning Literacy
MI-5
6
Achievement Level Tests

• Challenging and appropriate level for every
  student
• Aligned with standards
• Purposes
• internal accountability
• External accountability
• Measure growth in student achievement

Adult Reading
Adult Reading
x
x
x
x
x
5th Grade
5th Grade
x
x
x
x
x
x
x
x
x
x
Beginning Literacy
Beginning Literacy
MI-6
7
Features of MAP Test

• Dynamically developed for each student
• Standards aligned
• Accurate for all students
• Immediate results
• Measures growth
• Test up to 4 times a year

Adult Reading
MAP Test
250
x
x
-
-
-
-




x

215
x

x
5th Grade
x
x
x

x
x
x
x
x
x
x
150
Beginning Literacy
MI-8
8
RIT (Rasch Unit) Scale

• Achievement scale
• Equal interval
• Used to show growth across grades and over time
• Referenced to instructionally useful information
• Norm referenced

Adult Reading
MAP Test
250
x
x
-
-
-
-




x

215
x

x
5th Grade
x
x
x

x
x
x
x
x
x
x
150
Beginning Literacy
MI-8
9
Uses and Benefits of MAPIn the classroom

• Estimates what students know and can do
• Helps teachers create instructional focus
• Intake testing for new students
• Helps teachers group for instruction
• Identifies students with special needs
• Monitors progress toward state and/or local
  standards
• Provides information about student growth over
  time

MI-9
10
Uses and Benefits of MAPFor educational programs

• Monitors progress toward state standards
• Monitors the effectiveness of regular and special
  programs
• Provide longitudinal information about the
  performance of students and groups of students
• Provides direction for school improvement
  planning
• Provides useful information for reporting to all
  stakeholders

MI-10
11
MAP Reports

• Class Reports
• Individual Student (Parent) Reports
• School Summary Reports
• District Summary Reports
• Dynamic Reports
• Growth by quartile per-grade and subject
• Disaggregated by gender, race, program, etc.

MI-12
12
NWEA Training Continuum

• Administration and Implementation
• Interpreting Reports
• Use of Growth Data
• Advanced Workshops/Coaching
• National Members Seminar
• State Member User Groups

MI-15
13
NWEA Partner Districts
Over 500 districts in 25 states
WA
MT
MN
OR
ID
WI
RI
WY
MI
CA
IA
PA
NV
NE
IL
OH
IN
CO
VA
AZ
AR
NM
SC
TX
AK
MI-2
14
Franklin S.D. Math
15
Franklin S.D. Reading
16
Franklin S.D. Language
17
(No Transcript)
18
(No Transcript)
19
(No Transcript)
20
(No Transcript)
21
(No Transcript)
22
(No Transcript)
23
Support Systems

• IT technical assistance
• Training for implementation and use of data
• Conventional norms, growth norms, quartile growth
  norms
• Performance-standards alignment studies
• Long term relationship to improve learning

24
State Performance Standards Criteria Aligned to
the NWEA RIT Scale
25
Standards Alignment

• Administer NWEA Measures adjacent to state tests
• Apply various methodologies to estimate the
  states performance criteria
• Select the methodology that has the best fit to
  the data
• Using normal growth for each grade and subject,
  estimate appropriate off-grade benchmark
  criteria

26
State Meeting Standards for Reading Locations
on the NWEA RIT Scale
180
Grd 3
Grd 8
Grd 9
Grd 10
Grd 4
Grd 5
Grd 6
Grd 7
27
Some ProblemsBecome Evident

• Grade 3Mathematics Standards
• State 1RIT 184, 40th Percentile
• State 2RIT 199, 48th Percentile
• State 3RIT 209, 77th Percentile
• Grade 8Reading Standards
• State 1RIT 221, 39th Percentile
• State 2RIT 227, 57th Percentile
• State 3RIT 232, 72nd Percentile

28
Some Additional Problems Become Evident

• One StateReading Standards
• Grade 3RIT 193, 37th Percentile
• Grade 5RIT 209, 43rd Percentile
• Grade 8RIT 227, 57th Percentile
• Grade 10RIT 236, 68th Percentile
• Another StateReading Standards
• Grade 4RIT 207, 56th Percentile
• Grade 7RIT 226, 65th Percentile
• Grade 10RIT 227, 44th Percentile

29
NWEA Mission

• Partnering to help
• all kids learn

MI-3
30
State Meeting Standards for Math Locations on
the NWEA RIT Scale
260
250
240
230
220
210
200
190
180
Grd 3
Grd 4
Grd 5
Grd 6
Grd 7
Grd 8
Grd 9
Grd 10