Alison Evans

1
National Project Marking Schedule

• Alison Evans
• Richard Sloan

2
Aims

• To inform participants about the NPMS
• For participants to know what support will be
  needed by registrars and trainers in undertaking
  and supervising project work

3
Outline

• Short presentation
• Work on projects
• Discussion / questions

4
Project Work In Training

• Problem Based Learning agenda
• Encourages in-depth learning about one aspect of
  practice
• Self direction
• Spirit of enquiry

5
Competencies Tested

• ability to construct a logical argument and
  communicate it in written English
• ability to plan and sustain activity over a
  period of time

6
How is the NPMS Different?

• wider range of submission allowed
• must refer to relevant literature
• criteria marked on scale rather than all or
  nothing
• encourages higher levels of achievement than
  minimum competence

7
Project a self directed piece of learning
which

• addresses a defined problem
• is related to previous work
• presents qualitative or quantitative findings
• interprets these findings
• draws conclusions from the evidence presented

8
The Project May Be a

• questionnaire study
• notes review
• literature review
• clinical case study
• research study
• plan for a new service in the practice
• audit
• discussion paper

9
Validity

• developed by GP educators with experience of
  assessing projects
• modified following consultation with 186 GP
  educators nation-wide
• majority of respondents agreed with the criteria
  used and description of level of minimum
  competence

10
Reliability

• good agreement between markers
• high sensitivity and specificity shown in initial
  testing (89 and 78, compared to 83 and 80 for
  audit schedule at equivalent stage of testing)

11
Pass Rules

• total score of 18 or more out of possible 30
• not less than 2 on any criterion

12
Marking

• Three first level markers, if one or more refer,
  goes to two second level markers
• second level markers agree pass or refer
• if refer, must agree score on each criterion
• marking sheet returned to GPR with invitation to
  resubmit same re-written project or a new one
• resubmission marked by second level markers

13
Referrals

• projects referred after resubmission are
  submitted to National markers who make final
  decision on pass / fail
• comments from all markers sent to GPRs new
  trainer if additional training is undertaken

14
Implementing the NPMS

• Deaneries may train their own markers - project
  material can be supplied if needed
• GPRs from Deaneries outside Yorkshire may submit
  projects to be marked in Yorkshire with the
  consent of their Director
• Yorkshire markers will claim fees directly from
  the GPRs Deanery

15
Supporting Trainers

• Annual 3-day trainers seminar on supervising
  audit and research projects - includes
  informatics training
• Local trainers workshops
• Advice on an individual basis

16
Key Points for Success

• Look at some past projects www.bradfordvts.co.uk
  
• Choose something you are really interested in
• Look at the marking crib
• Minimum 6 references
• KEEP IT SIMPLE
• Self assess it / Get a trainer

17
Supporting Registrars

• Annual 5-day Summer School All you ever wanted
  to know about projects - includes literature
  searching and appraisal, computer skills,
  methodology
• half-day release
• trainers workshops
• tele-conferencing
• individual advice from NPMS team