PIRLS 2006

1
PIRLS 2006

• Ina V.S. Mullis and Michael O. Martin
• 46th IEA General Assembly
• Helsinki, 10-13 October, 2005

2
PIRLS 2006

• Assessment of Reading Comprehension
• Grade 4
• Trends for 2001 Participants
• Baseline Data for New Countries
• Background Questionnaires

3
Major Accomplishments

• Since Last General Assembly
• Conducted Ambitious Field Test
• PIRLS 2006 Is Ready for Data Collection
• High-Quality Assessment of Reading Comprehension
• Not too Late to Join PIRLS!

4
Countries that Developed and Field-tested PIRLS
2006

• Austria
• Belgium
• Bulgaria
• Ontario, Canada
• Quebec, Canada
• China
• Chinese Taipei
• Denmark
• England
• France
• Georgia
• Germany
• Hong Kong, SAR
• Hungary

• Norway
• Poland
• Qatar
• Romania
• Russian Federation
• Scotland
• Singapore
• Slovak Republic
• Slovenia
• South Africa
• Spain
• Sweden
• Trinidad Tobago
• United States

Iceland Indonesia Iran Israel Italy Kuwait Latvia
Lithuania Luxembourg Macedonia Moldova Morocco Net
herlands New Zealand
5
RDG (Reading Development Group)

• Sue Horner (England)
• Dominique Lafontaine (Belgium, French)
• Jan Mejding (Denmark)
• Gabriella Pavan de Gregorio (Italy)
• Selene Tan (Singapore)
• Renate Valtin (Germany)
• Karen Wixon (United States)
• Galina Zuckerman (Russian Federation)

6
QDG (Questionnaire Development Group)

• Marc Colmant (France)
• Meng Hong Wei (China)
• Bojana Naceva (Macedonia)
• Larry Ogle (United States)
• Knut Schwippert (Germany)
• Ragnar Solheim (Norway)

7
PIRLS 2006 Assessment Specialists

• Ann Kennedy
• PIRLS Coordinator
• TIMSS PIRLS International Study Center
• Marian Sainsbury
• Reading Coordinator
• National Foundation for Educational Research
• Patricia Donahue
• Reading Consultant
• Educational Testing Service

8
Major Activity Conducting Ambitious Field Test

• What?
• Reading Comprehension Assessment
• 12 Passages
• 6 Literary
• 6 Informational
• 151 Items
• 80 Constructed Response
• 71 Multiple Choice

9
Major Activity Conducting Ambitious Field Test

• What? (Cont.)
• Questionnaires
• 4 Questionnaires
• Parents
• Students
• Teachers
• Schools

10
Major Activity Conducting Ambitious Field Test

• Where?
• 42 Countries
• 5 Continents
• 33 Languages

11
Major Activity Conducting Ambitious Field Test

• Who?
• 1,200 Schools
• 45,000 Students
• 2,000 Teachers
• 39,000 Parents

12
Major Activity Conducting Ambitious Field Test

• When?
• Scoring Guide Development and Training January -
  March 2005
• Pilot Test All Seven English-speaking Countries
• Scoring Guides and Training Materials Task Force
  Uses New Scanning Methodology
• NRC Training March 2005, Skopje

13
Major Activity Conducting Ambitious Field Test

• When? (Cont.)
• Data Collection March - April 2005
• Data Processing and Analysis
• May - July 2005
• RDG Review Results for Passages and Items/Scoring
  Guides July 2005, Berlin

14
Major Activity Conducting Ambitious Field Test

• When? (Cont.)
• QDG Review Results for Questionnaires July 2005,
  Stavanger
• NRC Review of All Instruments August 2005,
  Hamburg
• All Instruments Distributed to NRCs August 2005
  Web and CD

15
PIRLS 2006 Assessment

• 10 Passages
• 5 Literary (2 Trend, 3 New)
• 5 Informational (2 Trend, 3 New)
• 126 Items
• 62 Constructed Response
• 64 Multiple Choice
• Total Assessment Time
• 6 Hours 40 Minutes

16
PIRLS 2006 Passages/Blocks
17
PIRLS 2006 Assessment

• Assessment Time per Student
• 80 Minutes
• Two 40-minute Sessions with Break
• One Passage per Session

18
Assessment Booklet Design
19
Scales for Reporting Reading

• Purposes for Reading
• Reading for Literary Experience
• Reading to Acquire and Use Information
• Processes of Comprehension
• Retrieval and Straightforward Inferencing
• Interpreting, Integrating Evaluating

20
PIRLS 2006 Assessment

• 4 Questionnaires
• Parents
• Students
• Teachers
• Schools

21
PIRLS 2006 Assessment

• Curriculum Questionnaire
• NRCs
• Online Data Collection
• Encyclopedia
• Chapter from Each Country

22
Schedule Upcoming Events

• Oct-Dec 2005 Southern Hemisphere Data
  Collection and Scoring Training
• Mar 2006 6th NRC Meeting, Luxembourg
  Scoring Training (NH)
• Mar-Jun 2006 Northern Hemisphere Data
  Collection

23
Schedule Upcoming Events

• Dec 2006 7th NRC Meeting, New Zealand
  Review Data and Reporting Plans
• Jun 2007 8th NRC Meeting, Quebec
  Review Draft Report
• Oct 2007 Publish PIRLS 2006 Encyclopedia

24
International Report

• Release
• December 2007

25
PIRLS 2006

• Ina V.S. Mullis and Michael O. Martin
• 46th IEA General Assembly
• Helsinki, 10-13 October, 2005