Formative Summative

1
Formative / Summative

• Should an assessment do both?
• Can an assessment do both?

2
Who does PTs ?
2

• Germany Aachen, Berlin, Bochum, Koln, Munster,
  Witten
• Netherlands Maastricht, Njimigen, Utrecht,
  Groningen, Leiden.
• Belgium Ghent
• UK Manchester, Peninsula,Keele
• Finland Tampere, Helsinki
• Canada McMaster.
• New Zealand Otago
• USA Kansas
• South Africa Pretoria
• Ecuador Quito
• Brazil San Paulo

3
Logistics - Delivery
3

• Delivery Methods
• Paper
• All together?
• Venues
• Delivery of Results

4
Logistics - Delivery
4

• On Line ?
• Security
• Equivalent tests

5
Results
5

• How, when and where.
• Automate as much as you can
• Students want them tomorrow
• If summative then performance must be reviewed
  before release of results.

6
Progress Decisions
6

• For summative how tight can you make them
• Based on relative decisions
• Is that fair?

7
Progress Test Results
Correct
78
79
3
2
1
Tests
8
Universiteit Maastricht
scoring
mean
-0.5 s.d.
- ½ sd
-1 s.d.
- 1 sd
D
S
S
U
mean
9
Results
9
10
Universiteit Maastricht
scoring
15th percentile.
- ½ sd
5th percentile
95th percentile
- 1 sd
B
S
S
U
E
mean
11
Scoring

• Bottom 5 - Unsatisfactory grade
• Next 10 - Borderline
• Remainder Satisfactory, except top 5 graded
  Excellent

12
But !

• This is a longitudinal assessment and individual
  test scores aggregate. Decisions are made on
  aggregate scores NOT individual tests

13
Aggregation
14
Results

• Students receive results electronically
• Atlas

15
Student Results
16
Progress decisions

• End of year decisions
• Aggregate satisfactory progress
• Aggregate unsatisfactory do not progress
• ?
• Decision rules, but often reviewing profiles

17
Progress Test Z scores
18
Progress Test Z scores
19
Progress Test Z slope
20
Progress Test
21
Progress Test Repeat