TIMSS Advanced

1
TIMSS Advanced

• REPLICATION OF TIMSS 1995 ADVANCED MATHEMATICS
  AND PHYSICS (Population 3)
• Target Population
• Students Having Taken Advanced Courses
• Advanced Mathematics
• Physics
• Final Year of Schooling 12th Grade in Most
  Countries

2
TIMSS Advanced

• Trends from 1995 (1995 Pop.3 Countries)
• Advanced Mathematics
• Physics
• Baseline Data for New Countries

3
Major Accomplishments

• Developed and Published Assessment Frameworks
• Developed Field-test Instruments
• Advanced Mathematics Items
• Physics Items
• School, Teacher, and Student Questionnaires

4
Countries Participating

• Armenia
• Australia
• Bulgaria
• Chinese Taipei
• Germany
• Italy
• Iran
• Lithuania

• Netherlands
• Norway
• Russian Federation
• Serbia
• Slovenia
• Sweden
• United States

5
TIMSS Advanced Coordinators - Same as in 1995

• Bob Garden Coordinator, Advanced Mathematics
• Svein Lie Coordinator, Physics
• Substantial Development Support from Norway
• Liv Sissel Gronmo, NRC

6
Experts from Participating Countries

• Reviewed Assessment Frameworks
• Developed Field-test Items
• Reviewed Field-test Items
• Iterative Process!
• Reviewed Questionnaires

7
Advanced Mathematics Domains
8
Physics Domains
9
Framework Development

• Draft Posted on Web for NRC Review
• March 2006
• 1st Meeting of NRCs to Review Framework
• Amsterdam, May 2006
• Frameworks Published and Made Available on
  Website
• September 2006

10
Item Development for Field-test

• Experts from Participating Countries Drafted
  Items
• January-March 2006
• Initial Set of Items Posted for Review by NRCs
• April 2006
• 1st Meeting of NRCs to Review Draft Items
• Amsterdam, May 2006

11
Item Development for Field-test (-cont.)

• Pool of 260 Items for Field Test Posted for NRC
  Review
• September 2006
• 2nd Meeting of NRCs to Review and Identify
  Field-test Items
• 90 for Advanced Mathematics 90 for Physics
• Oslo, Norway, September 2006
• Field-test Items to Be Posted
• November 3, 2006

12
Sampling Plans

• 1st Meeting of NRCs to Collect Information on
  Course Programs and Profiles for Students Taking
  Advanced Mathematics and Physics
• Sampling Plan Drafted
• Same Students Take Advanced Math and Physics
• One Group Take Advanced Math and Physics Another
  takes only Advanced Math
• Different Regions Have Different Programs
• 2nd Meeting of NRCs to Customize Sampling Plan
  for Each Country

13
Sampling Plans (cont.)

• Predominant Design
• Separate School Samples for Advanced Math and
  Physics
• Each Subject 120 Schools 2000 Students
• Also Popular
• Same School Sample for Advanced Math and Physics
• Assessment Booklets Rotated in Classes
• 120 Schools 4000 Students

14
Questionnaires

• Student Questionnaire
• Advanced Mathematics
• Physics
• Teacher
• Advanced Mathematics
• Physics
• School
• Curriculum

15
TIMSS Advanced

• Schedule
• 2006 - Framework and Instrument Development
• Completed
• 2007 - Field Test
• 2008 - Data Collection
• 2009 - Reporting

16
TIMSS Advanced

• Its Not Too Late to Sign Up!

17
TIMSS Advanced2008

• Ina V.S. Mullis and Michael O. Martin
• 47th IEA General Assembly
• Amiens, 9-12 October, 2006