Delivering the Diploma Managing internal assessment CIEA event

1
Delivering the DiplomaManaging internal
assessment CIEA event
Paddington Hilton London 29 July 2008
2
Todays event Outline

• Provide an outline of the Diploma and an update
  on developments
• Introduce NAA proposals on quality assurance
• Provide details of further information and
  support available to consortia
• Give CEAs the opportunity to consider how they
  can support consortia to put in place effective
  quality assurance arrangements for internal
  assessment

3
National Assessment Agency (NAA)Supporting the
Diploma

• Two major areas of NAAs work
• Supporting exams officers to meet the
  administrative challenges of the Diploma
• In February 2008 the NAA was commissioned to
  develop a programme of work supporting internal
  assessment for the principal learning and project
  components of the Diploma

4
Delivering the DiplomaWhy the NAA programme was
instigated (1)

• The majority of principal learning units and all
  projects are
• internally assessed
• Important that internal assessment is managed
• successfully and effectively
• Recognition that support may be required at
  local level for
• managing internal assessment
• Consortium working introduces particular
  challenges to
• managing internal assessment

5
Delivering the DiplomaWhy the NAA programme was
instigated (2)

• Need for consistency across awarding bodies in
  terms
• of requirements placed upon consortia/centres
  
• Wider backdrop perception (right or not) that
  in General
• Qualifications there is a move away from
  internal
• assessment and a tightening up of the
  regulations
• governing its use

6
Delivering the DiplomaOur approach to supporting
internal assessment

• Support not regulation
• Build on existing good practice across General
  Qualifications (GQ) and Vocational Qualification
  (VQ) systems, awarding bodies, schools, colleges
  and training providers
• Facilitate sharing of good practice within and
  between consortia
• Support effective quality assurance arrangements
  prior to the submission of students work into
  awarding body moderation systems
• Ensure that any arrangements complement awarding
  body requirements

7
Todays eventDeveloped collaboratively with
8
Delivering the Diploma Four strands to initial
NAA support

• Good practice guide
• Delivering the Diploma a guide to managing
  internal assessment
• 10 NAA planning events for senior staff from
  Gateway 1 consortia in June 2008
• Awarding body training events to include NAA
  material relevant to the domain assessor role
  summer and autumn 2008
• Development of training guides as a basis for
  Continuing Professional Development (CPD)
  activities

9
Managing internal AssessmentGuidance and support
for consortium staff
NATIONAL SUPPORT
LOCAL SUPPORT
CONSORTIUM
CENTRE
SSAT QIA
TDA LLUK
Lines of learning leaders
Diploma teachers
GUIDANCE
IMPLEMENTATION
Internal assessment managers
Lead and Domain assessors
National Assessment Agency
GUIDANCE
IMPLEMENTATION
Exams officer groups
Exams office staff
GUIDANCE
IMPLEMENTATION
10
The DiplomaAn overview
11
Diploma overviewWhat is the Diploma?

• A new qualification for 14-19 year olds
• It combines essential skills and knowledge,
  hands-on experience and general and applied
  learning
• It is designed to appeal to students of a range
  of abilities
• It supports progression into further or higher
  education, training, apprenticeships or
  employment

12
Diploma overviewWhat is the Diploma? (2)

• It will be offered in 17 broad employment sectors
  or subjects (lines of learning) by 2011
• Diplomas will be offered by groups of centres in
  a consortium
• Consortia must get through the DCSF Gateway
  process to offer one or more lines of learning
• A consortium might not offer all the lines of
  learning

13
Diploma overviewWhat is the Diploma? (3)

• Each line of learning will be available from a
  small number of Diploma awarding bodies (DABs)
• The DAB is the awarding body that will award the
  Diploma
• Each component qualification will be offered by a
  number of component awarding bodies (CABs)

14
Diploma overviewWhat is the Diploma? (4)

• Consortia or individual centres will decide which
  DAB to use for each line of learning
• Consortia or individual centres will decide which
  CABs to use for each component qualification

15
Diploma overviewWhat is the Diploma? (5)

• The different component qualifications of a
  Diploma are likely to be delivered by the
  different consortium member institutions to take
  advantage of their particular expertise and
  resources
• Learning and assessment could take place in a
  variety of locations for each student

16
About the DiplomaDiploma components
Principal learning
Generic learning
Additional and specialist learning
17
About the DiplomaDiploma components

• Specific to the line of learning
• Made up of units of assessment that have been
  newly developed and accredited for each Diploma

Principal learning
18
About the DiplomaDiploma components

• Generic learning is the same
• across all lines of learning 
• Functional skills
• Personal, learning and thinking skills
• Work experience
• A project

Generic learning
19
About the DiplomaDiploma components

• Made up of existing qualifications
• Complementary to the principal learning,
  providing depth or breadth to the course of study
• Eg. GCSEs, BTECs, OCR Nationals, A Levels, CG
  qualifications etc.
• Or new qualifications specifically developed for
  the Diploma
• Progression Diploma does not include additional
  or specialist learning

Additional and specialist learning
20
About the DiplomaAn example
21
The Diploma in the QCF
3.5 A levels at A - E
Advanced Diploma
Extended Project
Level 3
A levels
Progression Diploma
2.5 A levels at A - E
Level 2 Functional Skills
Higher Diploma
GCSEs A-C
Level 2
7 GCSEs at level 2 (e.g. 7 at grades A - C)
Level 1 Functional skills
Foundation Diploma
GCSEs D-G
Level 1
5 GCSEs at level 1 (e.g. 5 at grades D - G)
22
About the DiplomaWhere to find out more about
the qualifications

• Diploma catalogues on the
• National Database of
• Accredited Qualifications
• (NDAQ)
• www.ndaq.org.uk

23
The DiplomaA QCA update
24
Where are we now?
Develop Line of Learning statement
Develop Line of Learning criteria
Develop and accredit new quals
Prepare to teach
Teach and learn
Assess learning
Award Diploma and constituent quals
Establish structures for developing Line of
Learning
Phase 2
criteria for all five LoL's published on QCA
website
57 PL qualifications from 6 AB's due for
accreditation in early summer 2008
specifications in Centres by end September 2008
Gateway complete First teaching 2009
Gateway complete First teaching 2009
25
Other areas of development

• Scoping out Extended Diploma
• Extensive work to tailor the additional and
  specialist learning offer to illustrate and
  fulfil particular progression routes
• More guidance to support teaching, learning and
  administration
• Roll-out of Diploma aggregation service

26
Diploma aggregation
Exams officer training begins on September Early
adopter support from NAA centre support officers
27
(No Transcript)
28
Controlled assessment and exemplification project

• To create guidelines on controlled assessment
  that will
• define parameters for task setting, task taking
  and task marking
• clarify the relationship between applied and
  experiential learning and controlled assessment
• identify any variations between the controls for
  different lines of learning
• Produced in consultation with key stakeholders
• Planned for early October 2008

29
Controlled assessment and exemplification project

• To exemplify the guidelines with example
  assignments that show
• good practice in task setting
• how the assignments were managed and what
  controls were applied to task taking
• what evidence learners produced
• how the work was marked in line with agreed
  standards
• The exemplification will relate to Phase 1 and 2
  lines
• To be developed in partnership with key
  stakeholders
• Planned for Spring 2009 (subject to funding)

30
BREAK
31
The DiplomaManaging internal assessment
32
Managing internal assessmentThe remit for the
NAA programme
Principal learning
Generic learning
Additional and specialist learning
33
Managing internal AssessmentWho does what in
internal assessment
Learners evidence for assessment
Managing internal assessment
See page 15 of the NAA Guide
34
Managing internal assessmentKey challenges for
consortia

• Consortium background and history
• Size, configuration and geography
• Build on existing good practice
• Utilise staff expertise
• Develop shared understanding within teams
• Communication channels
• Tailor systems to meet local needs

35
Managing Internal AssessmentRoles within the
consortium
36
Managing internal assessmentRoles within the
consortium

• In order to support the management of internal
• assessment, three key roles have been identified
• Consortium management
• Lead assessor
• Domain assessor
• Each role has a set of responsibilities (set out
  in Delivering
• the Diploma A guide to managing internal
  assessment)

37
Roles within consortium Consortium management

• Consortium management
• The management team of school, college and other
  staff who manage Diploma delivery and internal
  assessment across all Diploma programmes offered
  in a consortium

38
Roles within consortiumLead assessor

• Lead assessor
• A person who has responsibility within a
  consortium for overseeing all aspects of the
  quality assurance of the assessment carried out
  for the principal learning and project components
  across all Diploma programmes offered in a
  consortium

39
Roles within consortiumDomain assessor

• Domain assessor
• A person who has responsibility within a
  consortium for overseeing all aspects of the
  quality assurance of the internal assessment
  carried out on the principal learning and project
  components for one particular line of learning,
  at one or more levels

40
Managing internal assessmentRoles within the
consortium
41
Roles within consortiumConsortium management
42
Roles within consortium Consortium management

• Consortium management
• The management team of school, college and other
  staff who manage Diploma delivery and internal
  assessment across all Diploma programmes offered
  in a consortium

43
Roles within consortiumConsortium management (1)

• The consortium management role is to oversee all
• assessment activities, ensuring that
• assessment policies and procedures are in place
• adequate staff resources are available
• the consortium/centres meet the administrative
  requirements of awarding body/bodies
• feedback from awarding bodies on internal
  assessment is acted upon appropriately

44
Roles within consortium Consortium management (2)

• the lead assessor and domain assessor(s) carry
  out their
• roles effectively
• resources are available to support training for
  lead and
• domain assessor(s)
• resources are available to the lead and domain
  assessor(s) to
• enable them to carry out the roles effectively
• See pages 24 25 of the NAA Guide

45
Roles within consortiumLead assessor
46
Roles within consortiumLead assessor

• Lead assessor
• A person who has responsibility within a
  consortium for overseeing all aspects of the
  quality assurance of the assessment carried out
  for the principal learning and project components
  across all Diploma programmes offered in a
  consortium

47
Roles within consortium Lead assessor

• The responsibilities of the lead assessor role
  include
• management and leadership
• assessment policies and procedures
• resource management
• quality assurance
• administration
• review and evaluation
• See pages 26 33 of the NAA Guide

48
Roles within consortiumDomain assessor
49
Roles within consortiumDomain assessor

• Domain assessor
• A person who has responsibility within a
  consortium for overseeing all aspects of the
  quality assurance of the internal assessment
  carried out on the principal learning and project
  components for one particular line of learning,
  at one or more levels

50
Roles within consortium Domain assessor

• The responsibilities of the domain assessor role
  include
• developing staff understanding
• quality assuring assessment activities
• quality assuring standards of assessment
• meeting administrative requirements
• review and evaluation
• See pages 34 43 of the NAA Guide

51
Quality assurance and control
General Qualifications
52
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
Learners
53
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
Learners
54
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
Teacher Assessors
Learners
55
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
56
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
CENTRE
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
57
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
AB Assistant Moderator
CENTRE
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
58
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
AB Team Leader Moderator
AB Assistant Moderator
CENTRE
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
59
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
Assistant Principal Moderators
AB Team Leader Moderator
AB Assistant Moderator
CENTRE
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
60
Managing internal assessmentThe Assessment Tree
GQ Coursework Moderation
ENGLISH
Principal Moderator
Assistant Principal Moderators
AB Team Leader Moderator
AB Assistant Moderator
CENTRE
Internal Teacher Assessor Moderator
Teacher Assessors
Learners
61
NAA proposalsQuality assurance - Diploma
62
Managing internal assessmentPrincipal Learning
Projects
L
63
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
L
64
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
TA
L
65
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
ITAM
TA
L
66
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING



ITAM
TA
L
67
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING



ITAM
TA
L
68
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING



ITAM
TA
L
69
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING



ITAM
TA
L
70
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
LA



ITAM
TA
L
71
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
LA



ITAM
TA
L
72
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING
LA



ITAM
TA
L
73
Managing internal assessmentPrincipal Learning
Projects
ENGINEERING



ITAM
TA
L
74
Managing internal assessmentPrincipal Learning
Projects
ALL LINES OF LEARNING
LA
75
Closing remarksQuestions