Scottish Learning Festival International Studies

1
Scottish Learning FestivalInternational Studies

• Their potential for the practitioner

2
Presenters

• Pete Whitehouse Head of schools analytical
  services unit
• Audrey MacDougall Principal Researcher schools
  
• An analysts view

3
International studies undertaken by the Scottish
Government

• PISA Programme for International Student
  Assessment
• PIRLS Progress in International Reading
  Literacy Study
• TIMSS - Trends in International Mathematics and
  Science Study

4
The Assessment Quadrant
Source circular no. 02 June 2005 Qualifications,
Assessment and Curriculum Division
5
Why do we do these studies?

• Complements SSA and other national activities
• Contributes to right-hand side of assessment
  quadrant - external/summative
• Feedback can also contribute to
  external/formative
• Complements Scotlands AifL agenda

6
International study activity Timetable 2006-08

• 2006
• 2007
• 2008

• PISA 2006 main study testing
• PIRLS 2006 main study testing
• TIMSS 2007 main study testing
• PIRLS 2006 reporting
• PISA 2006 reporting
• PISA 2009 Field trial

7
PIRLS 2006

• 40 countries and 5 Canadian provinces took part
• 150 primary schools with one P5 class per school
• Pupils aged 9 and 10 (P5)
• Testing took place in Spring 2006
• Results due Nov 2007

8
PISA 2006

• 57 countries took part including all OECD
  countries
• Main test domain was science. Reading and maths
  minor domains
• 15 year old pupils, 110 schools with 35 pupils
  per school
• Testing took place in spring 2006
• Report due in Dec 2007

9
TIMSS 2007

• More than 60 educational systems participate
• Data in mathematics and science at fourth and
  eighth grades (P5 and S2)
• 150 schools with one class per school
• Testing took place in Spring 2007
• Results due December 2008

10
What can each study tell us?

• Attainment
• Attitudes, aspirations, ambitions
• Impact of socio-economic and background factors
• Information about the learning environment
• The curriculum

11
Attainment

• A number of countries perform significantly
  better than Scotland
• PISA 2003

TIMSS 2003 (Science) Singapore, Chinese Taipei,
Rep of Korea, Hong Kong, Estonia, Japan, England,
Hungary, Netherlands, Australia, Sweden,
Slovenia, Lithuania PIRLS 2001 (Reading) Sweden,
Netherlands, England, Bulgaria, Latvia,
Lithuania, Hungary, United States, Italy,
Germany, Czech Republic
12
Attitudes, aspirations, ambitions

• PISA
• Interest and enjoyment
• Motivation
• Sense of belonging
• Self-belief and confidence
• Anxieties
• Learning strategies
• Behaviour and effort

• TIMSS
• Aspirations
• Behaviour
• Confidence
• Liking school
• Learning strategies

13
Self-confidence in learning science (S2) - TIMSS
2003
14
Anxiety in PISA 2003
15
Socio-economic and background factors

• PISA
• Socio-economic index of occupational status
• Index of economic, social and cultural status
• TIMSS
• Home study and cultural resources
• Parental background and home environment
• PIRLS 2001
• Parental involvement
• Literacy resources at home

16
Impact of socio-economic factors PISA 2003
Maths score
Economic factors
17
Impact of socio-economic factors PISA 2003
Finland
Korea
Nlands
Japan
Canada
Scotland
OECD average
18
Having a computer at home TIMSS 2003
19
Having a desk at home TIMSS 2003
20
Early Home Literacy Activities PIRLS 2001
21
Parents discuss childs classroom reading work
with him/her PIRLS 2001
22
The learning environment

• PISA 2003
• School climate
• School policies and practices
• Resources invested in education
• TIMSS 2003
• Demographics
• Home/school involvement
• School resources
• School climate
• Classroom characteristics

• PIRLS 2001
• Demographics
• Home/school involvement
• School resources
• Classroom characteristics
• Absenteeism, bullying and safety

23
Student views of teacher support PISA 2003
24
Impact of teacher support PISA 2003
25
Emphasis on homework TIMSS 2003 science
26
Student experiences of incidences in school
PIRLS 2001
27
The curriculum

• TIMSS 2003
• Instructional time on maths and science
• Emphasis on approaches and processes in the
  science curriculum
• Assessment
• PIRLS 2001
• Instructional time on reading
• Emphasis on approaches and processes in the
  reading curriculum
• Assessment

28
Emphasis in the science curriculum TIMSS 2003
29
Methods of assessment PIRLS 2001
30
School level reporting

• Has not been previously undertaken as sample
  sizes too small for reliable attainment data
• Some elements of school level reporting may be
  introduced for further studies for some elements
  of the survey
• How your school might conform to the overall
  findings for Scotland?

31
Detailed results

• PISA
• http//www.pisa.oecd.org/pages/0,3417,en_32252351_
  32236130_1_1_1_1_1,00.html
• PIRLS
• http//pirls.bc.edu/pirls2006/index.html
• TIMSS
• http//www.timss.org/