PIRLS 2006

1
PIRLS 2006

• Ina V.S. Mullis and Michael O. Martin
• 47th IEA General Assembly
• Amiens, France
• 9-12 October, 2006

2
PIRLS 2006

• Assessment of Reading Comprehension
• Grade 4
• Trends for 2001 Participants
• Baseline Data for New Countries
• Background Questionnaires

3
Major Accomplishment

• Since Last General Assembly
• Completed Data Collection!

4
Countries that Participated in PIRLS 2006Data
Collection

• New Zealand
• Norway
• Poland
• Qatar
• Romania
• Russian Federation
• Scotland
• Singapore
• Slovak Republic
• Slovenia
• South Africa
• Spain
• Sweden
• Trinidad Tobago
• United States

Hong Kong, SAR Hungary Iceland Indonesia Iran Isr
ael Italy Kuwait Latvia Lithuania Luxembourg Maced
onia Moldova Morocco Netherlands

• Austria
• Belgium, Flemish
• Belgium, French
• Bulgaria
• Canada, Alberta
• Canada, British C.
• Canada, Nova Scotia
• Canada, Ontario
• Canada, Quebec
• Chinese Taipei
• Denmark
• England
• France
• Georgia
• Germany

5
RDG (Reading Development Group)

• Sue Horner (England)
• Dominique Lafontaine (Belgium, French)
• Jan Mejding (Denmark)
• Gabriella Pavan de Gregorio (Italy)
• Selene Tan (Singapore)
• Renate Valtin (Germany)
• Karen Wixon (United States)
• Galina Zuckerman (Russian Federation)

6
QDG (Questionnaire Development Group)

• Marc Colmant (France)
• Bojana Naceva (Macedonia)
• Larry Ogle (United States)
• Knut Schwippert (Germany)
• Ragnar Solheim (Norway)

7
PIRLS 2006 Assessment Specialists

• Ann Kennedy
• PIRLS Coordinator
• TIMSS PIRLS International Study Center
• Marian Sainsbury
• Reading Coordinator
• National Foundation for Educational Research
• Patricia Donahue
• Reading Consultant
• Educational Testing Service

8
Major Activity PIRLS 2006 Data Collection

• Reading Comprehension Assessment
• 10 Passages
• 5 Literary 2 trend, 3 new
• 5 Informational 2 trend, 3 new
• 126 Items
• 62 Constructed Response
• 64 Multiple Choice

9
PIRLS 2006 Assessment

• Total Assessment Time
• 6 hours, 40 minutes
• Assessment Time per Student
• 80 Minutes
• Two 40-minute Sessions with Break
• One Passage per Session

10
PIRLS 2006 Assessment

• Questionnaires
• 4 Questionnaires
• Parents
• Students
• Teachers
• Schools

11
PIRLS 2006 Assessment

• 45 Participants
• 33 Languages
• Anticipating Data From
• 7,000 schools
• 200,000 students
• 175,000 parents
• 12,000 teachers

12
Major Activity Instrument Production

• Country Translation
• Translation Verification
• Layout Verification
• Printing and Distribution

13
Major Activity Preparing for Data Collection

• IEA DPC Conducted Data Management Seminar,
  September 2005, Hamburg
• WinDEM software for data entry distributed
  January 2006
• IEA Secretariat and TIMSS PIRLS International
  Study Center Conducted Training Seminar for
  International Quality Control Monitors, January
  2006, Amsterdam

14
Major Activity Scoring Guide Development and
Training

• PIRLS Task Force Finalized Scoring Guides
• Prepared Scoring Training Materials
• Example and Practice Papers
• Southern Hemisphere Scoring Training
• October 2005, Pilanesburg, South Africa
• Northern Hemisphere Scoring Training
• March 2006, Luxembourg City

15
Major Activity Data Collection

• Southern Hemisphere
• October-December 2005
• Northern Hemisphere
• March-June 2006
• Curriculum Questionnaire
• Administered Online to National Research
  Coordinators (NRCs)
• August-September 2006

16
Major Activity - PIRLS 2006 Encyclopedia

• One Chapter per Country
• Country Context
• Language and Literacy
• Educational System
• Reading in Primary Grades
• Curriculum
• Instruction
• Teacher Education

17
Major Activity - PIRLS 2006 Encyclopedia

• NRCs Complete Encyclopedia Chapters
• February 2007
• PIRLS Encyclopedia Published
• September 2007
• PIRLS Encyclopedia Distributed
• General Assembly 2007

18
Major Activity Scaling and Analysis

• Reading Comprehension
• Purposes for Reading
• Reading for Literary Experience
• Reading to Acquire and Use Information
• Processes of Comprehension
• Retrieval and Straightforward Inferencing
• Interpreting, Integrating Evaluating

19
Major Activity PIRLS 2006 International Report

• Contents of Report
• Achievement Results
• Overall Reading Comprehension
• Purposes for Reading
• Processes of Comprehension
• International Benchmarks
• (Advanced, High, Intermediate, Low)

20
Major Activity PIRLS 2006 International Report

• Contents of Report (cont.)
• Contextual Factors
• Literacy-Related Activities in the Home
• Students Reading Attitudes and Activities
• School Curriculum and Organization for Teaching
  Reading
• Teachers and Reading Instruction
• School Contexts

21
Major Activity PIRLS 2006 International Report

• NRCs Review Analysis Plans and Report Outline at
  7th NRC Meeting
• December 2006, Queenstown, New Zealand
• Achievement Scaling Completed
• March 2007
• Reading Development Group Conducts Scale
  Anchoring
• April 2007, Copenhagen

22
Major Activity PIRLS 2006 International Report
(cont.)

• NRCs Review Draft International Report at 8th NRC
  Meeting
• June 2007, Quebec City
• PIRLS 2006 International Report and PIRLS 2006
  Technical Report Published
• November 2007
• International Press Conference
• December 4, 2007, Boston College

23
Major Activity PIRLS 2006 International Database

• Database Training at 9th NRC Meeting
• February 2008
• TIMSS PIRLS ISC Distributes International
  Database and User Guide
• June 2008

24
PIRLS 2011

• Ina V.S. Mullis and Michael O. Martin
• 47th IEA General Assembly
• Amiens, France
• 9-12 October, 2006

25
PIRLS 2011

• Enrollment Now Open!
• Countries Identify and Submit New Reading
  Passages
• June-December 2007
• 1st NRC Meeting to Update Framework and Review
  Passages
• February 2008

26
PIRLS 2011 - High Quality Assessment of Reading
Comprehension

• Trends Over Time
• Three Cycles 2001, 2006, 2011
• Achievement Data to Inform Educational Policy
• Curriculum
• Instruction
• Equity

27
PIRLS 2011 - High Quality Assessment of Reading
Comprehension (cont.)

• Assessed with TIMSS 2011
• Linking Achievement in Reading, Mathematics and
  Science
• Comprehensive Assessment of Core Curriculum Areas
  at 4th Grade
• Important Research Opportunity

28
PIRLS 2011

• Ina V.S. Mullis and Michael O. Martin
• 47th IEA General Assembly
• Amiens, France
• 9-12 October, 2006