Evaluating Physical Activity

1
Evaluating Physical Activity

• Kellie Horton
• Kinect Australia (VICFIT)

2
Questions

• What are the issues associated with evaluating PA
  that you are interested in?
• What types of programs are you involved in?
• What type of change are you trying to make?
• At what level.. program, PCP?

3
Purpose of this session

• Identify some common issues/problems associated
  with evaluation and evaluating PA
• Discuss the variation in approaches to evaluating
  PA
• Highlight some of the resources available to you
  for evaluating PA
• Examine how the planning tool can assist in
  evaluating PA

4
Evaluationthe considerations

• Why evaluate?
• To gain insight
• To make improvements
• To assess effects
• What level of evaluation?
• Program
• Agency/Organisation
• Catchment

5
More considerations

• What type of evaluation?
• Process
• Impact
• Outcome
• Key issues
• What do I/ we want to know?
• How are we going to find it out?
• How are we going to make others aware of our
  learnings?

6
Examples of outcomes of interest for physical
activity promotion

• Healthy
• (active)
• Lifestyles Mortality,
• Morbidity
• Quality of life
• Supportive
• Environments
• (for PA)
• 
  (Bauman, 2003)

7
PA promotion outcomes

• Capacity Building
• Community Workforce Healthy
  (active)
• Interest Development Lifestyles
• Awareness
• Capacity Building
• Healthy Pships
• Healthy Settings
  Supportive
• Public Environments
• Policy Capacity Building
  (for PA)
• Organisational Dev.
• (Bauman, 2003)

8
What to measure?

• Range of factors that are direct or indirect
  indicators of PA, or determinants of PA
• Indirect measure- use of recreation facilities,
  parks, walking trails etc.
• Direct measure- PA population survey pre and post
  program
• Determinants of PA- perceptions of safety in the
  community
• As well as process and partnership, capacity
  building issues
• (Salmon Timperio, 2003. Physical Activity
  Monitoring and Evaluation Toolkit)

9
(No Transcript)
10
Physical Activity measurement

• Surveys
• CCHS Strength Training Program Survey
• Victorian Population Health Survey
• Diaries/Log books
• Walking Calendars
• Observation
• Pedometers
• Castlemaine Workplace Walking Challenge
• Accelerometers
• (Salmon Timperio, 2003)

11
Measuring Physical Activity Determinants

• Individual measures
• Self efficacy for PA
• Environmental measures
• Neighbourhood walkability
• Social measures
• Social support
• (Salmon Timperio, 2003)

12

• So, with all this knowledge how do we decide
• what change we want to measure?
• how best to measure this change?

13
Evaluation Planning Framework

• 6 steps for agencies/organisations/ partnerships
  to develop evaluation plans in parallel with
  health promotion plans
• Builds on Integrated Health Promotion Resource
  Kit
• Guidelines for asking the right questions

14
6 steps

• Describe the program
• Evaluation preview
• Focus the evaluation design
• Collect data
• Analyse and interpret data
• Disseminate lessons learnt

15
1. Describe the program

• Writing goals and objectives
• Identifying impacts
• Developing interventions
• Identifying reach

16
2. Evaluation Preview

• Engage stakeholders
• Clarify purpose of evaluation
• Identifying key questions
• Identify evaluation resources

17
3. Focus the evaluation design

• Specify the evaluation design
• Specify the data collection methods
• Locate or develop data collection instruments

18
4. Collect data

• Coordinate data collection
• What tasks need to be completed?
• Who should undertake these tasks?
• When should they be undertaken?
• What resources are required to do this?

19
5. Analyse and interpret data

• Analysing the data
• Type of analysis driven by type of data
• Interpreting the findings

20
6. Disseminate lessons learnt

• What reports will be prepared?
• What formats will be used?
• How will findings be disseminated?

21
Task

• An evaluation working group from the PCP PAC has
  been established, you are part of this working
  group. Using the HP Plan provided
• What is the purpose of the evaluation? (there may
  be a number)
• What are the key questions?
• What type of evaluation design will you need to
  use?
• What data collection methods will be most
  appropriate?

22
Resources

• CPAN Physical Activity Monitoring and Evaluation
  Toolkit
• http//www.deakin.edu.au/hbs/cpan/PA_assessment__t
  oolkit.pdf
• CDC Physical Activity Evaluation Handbook
• http//www.cdc.gov/nccdphp/dnpa/physical/handbook/
  index.htm
• Victorian Population Health Survey
• www.health.vic.gov.au/healthstatus/vphs_current.ht
  mdownload
• Active Inform Bulletin (Kinect Australia)
• To subscribe email physicalactivity.info_at_kinectaus
  tralia.org.au
• Strength training evaluation tools
• For more information, Kirstan Corben
  k.corben_at_cgmc.org.au
• Pedometer challenge tools
• For more information, John Sawtell
  jsawtell_at_cchc.com.au

23

• Kellie Horton
• Kinect Australia
• e khorton_at_kinectaustralia.org.au
• p [phone]