Performance Measurement: Indicators

1
Performance Measurement Indicators

• Sara Grainger
• Statistical Support for Public Bodies
• Office of the Chief Statistician

2
Indicators of outcomes

• SG want an outcome based approach
• Not an indicators based approach
• But outcomes are rarely directly measureable
• Indicators give an indication of whether the
  outcome is being achieved

3
Outline of presentation

1. Important criteria for good outcome indicators
2. What data are available and how they can be
   accessed
3. Where to find more information and access support
   and guidance on measuring outcomes

4
Criteria for indicators 1. Relevant and
unambiguous

• The indicator should be clearly and directly
  relevant to at least one of the high level
  outcomes that are being sought.
• It may not be a direct measure of the outcome but
  it should be a clear and unambiguous indicator of
  progress toward that outcome.
• The definition should allow for non-experts to
  understand the indicator and there should be no
  possibility of misinterpretation.

5
Criteria for indicators2. Harmonised with other
frameworks and concepts

• The definition of the indicator should be
  harmonised with any similar measures being used
  in other frameworks, performance management
  systems, legislation or national or international
  conventions.

6
Criteria for indicators3. Timely and accessible

• The data should be published regularly
• The time lag between recording and reporting of
  data should be minimal,
• The data should be easily accessible to all

7
Criteria for indicators4. Statistically Robust

• For data from surveys
• The data should be precise enough to measure
  change (i.e. the confidence intervals should be
  narrow enough that it can be reliably reported
  whether or not the target has been achieved at
  the relevant geography or for the given
  sub-group).
• The data should be based on a sample that is
  representative of the relevant population and
  collected using recognised best practice in
  surveys.

8
Criteria for indicators4. Statistically Robust

• For data from administrative systems
• All bias and error in the data should be
  recognised and the implications assessed against
  the usefulness of the data.
• There should be minimal risk to changes in
  systems and recording practice over time.
• The data should be fully quality assured and
  auditable.

9
Criteria for indicators 5. Affordable

• The cost of collecting the data to a sufficient
  quality standard should be outweighed by the
  usefulness and utility of the data.

10
Contains a HUGE amount of data, mostly at data
zone level Easy to download, map, compare across
time or area The SNS team are happy to provide
demonstrations and assistance
11
(No Transcript)
12
(No Transcript)
13
(No Transcript)
14
http//www.scotland.gov.uk/Topics/Statistics/scots
tat
15
CONTACT US!!
http//www.scotland.gov.uk/Topics/Statistics/statc
ontacts
16
More information

• Performance indicators good, bad, and ugly
• A report by the RSS working party on performance
  monitoring in the public services
• http//www.rss.org.uk/PDF/PerformanceMonitoring.pd
  f
• Scottish Government Statistics Group Methodology
  Glossary
• http//www.scotland.gov.uk/Topics/Statistics/About
  /Methodology/

17
Where to go for support

• The Analysts Network
• http//www.scotland.gov.uk/Topics/Statistics/scots
  tat/analystsnetwork
• Includes details of the SOLACE led Improving
  Local Indicators Project all welcome to get
  involved!
• Statistical Support for Public Bodies Branch
• Sara.Grainger_at_Scotland.gsi.gov.uk
• 0131 2440329