DataDriven Leadership

1
Data-DrivenLeadership
Preparing New Principals November 24, 2008
2
ROI Multiple Perspectives

• Item Analysis Report
• Diamond Report
• Student Listings

3
ROI Multiple Perspectives

• Item Analysis Report
• Diamond Report
• Student Listings
• PANS Report

4
ROI Multiple Perspectives

• PANS Report

5
PANS Report
6
What are PANS?

• Prerequisite and Necessary Skills

7
What is a Prerequisite and Necessary Skill?

• An FCAT Content Focus skill that must have been
  mastered prior to answering a given question
  correctly.

8
Where did the PANS taxonomy come from?

• FDOE identified a content focus for each FCAT item

9
How were the PANS aligned to the SSS Diagnostic
Tests?

• By analyzing each question on each test to
  determine which FCAT Content Focus skills were
  present.

10
How many PANS are in an item?

• Typically 3 to 5

11
Sunshine State Standards
Item Specifications
PANS
12
Sunshine State Standards
Item Specifications
13
Sunshine State Standards
Item Specifications
PANS
14
Subject District or Schools Grade Teachers
Classes Sections
Groups
15
Conclusions and Inferences
2.18
What is the ROI? The number of additional
questions that would likely be answered correctly
were that PAN Skill mastered.
16
Conclusions and Inferences Details and Facts
2.18
1.88
What is the ROI? The number of additional
questions that would likely be answered correctly
were that PAN Skill mastered.
17
Conclusions and Inferences Details and Facts
2.18
1.88
0.12
Others
18
(No Transcript)
19
(No Transcript)
20
(No Transcript)
21
(No Transcript)
22
(No Transcript)
23
(No Transcript)
24
(No Transcript)
25
Student Names
One PAN All Students (who missed this PAN)
26
One Student All PANS (answered incorrectly)
27
Student A
28
Student B
29
(No Transcript)
30
Yes, but . . .
31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
Grade 8 math
35
(No Transcript)
36
Yes, but . . .
37
(No Transcript)
38
How do we best use PANS Report?
Your Turn
39
High PANS ROI

• Focus on those skills that could or should be
• Reviewed to determine true level of mastery
• Reinforced as new material is introduced
• Retaught (whole class, small group, individual)
• Know how PANS are related to grade level
  benchmarks and integrate them into the
  instructional context for those benchmarks using
  the item specifications
• Monitor PANS along with benchmarks

40
Low PANS ROI

• Focus on grade level benchmarks
• Know that PANS are NOT the excuse for lack of
  success on current benchmarks
• Know how PANS are related to grade level
  benchmarks and integrate them into the
  instructional context for those benchmarks using
  the item specifications

41
ROI Multiple Perspectives

• Item Analysis Report
• Diamond Report
• Student Listings
• PANS Report

42
ROI2 _ Return on Instructional Investment

• Item Analysis
• Strengths and weaknesses
• Major Distractors
• Diamond Report
• Low Hanging Fruit Missed OTL
• Compared to others
• Compared to self
• Test Skill Improvement Timing, Gridding, etc
• PANS Report
• ROI on Prerequisite and Necessary Skills

43
SROI _ Student Return on Investment

• Low 25
• Double points for learning gains (Triple)
• Zone 2/3
• Double gain/loss proficiency and learning gains
• Movers/Shakers/Stable
• Hernandez lists

44
Data Decision Making

• Big Picture
• Management Matrix
• ROI
• Diamond
• PANS
• SROI
• Student Listings

45
Instructional Context

• Collaboration
• Learning Teams
• Reflection
• Sharing

46
SROI _ Student Return on InvestmentNow What?

• Low 25
• Double points for learning gains (Triple)
• Zone 2/3
• Double gain/loss proficiency and learning gains
• Movers/Shakers/Stable
• Hernandez list