Title: The%20Guide%20to%20Community%20Preventive%20Services
1 Laurie Anderson, PhD, MPH Centers for Disease
Control Prevention February 10, 2004
2Outline I. Difference between a literature review
and a systematic review II. Purpose of the Guide
to Community Preventive Services systematic
reviews evidence-based recommendations III.
Steps in carrying out a systematic reviews IV. An
example
3The difference between a literature review and
a systematic review
4When making decisions about the choice of an
intervention
The body of intervention literature can be quite
large, inconsistent, and uneven in quality.
5Literature Reviews
A literature review has typically been used to
provide background information for intervention
selection. These reviews present a group of
studies, with strengths and weaknesses discussed
selectively and informally.
6- Traditional literature reviews have several
shortcomings - The process is subjective. There are few formal
rules, two reviewers might reach different
conclusions. - Lack explicit criteria for excluding
inappropriate or poorly done studies.
7Typically a literature review counts the number
of studies supporting, or not supporting, an
intervention i.e. positive, negative, or no
effect but ignores sample size, effect size and
research design. This can lead to erroneous
conclusions about intervention effectiveness.
8In literature reviews conflicting findings may
lead to a conclusion that an intervention is
ineffective or the research is uninterpretable.
Systematic reviews exploit divergent findings by
examining potential explanations --- treatment
differences, setting differences, etc. ---
because conflicting outcomes may tell us where
an intervention is likely to succeed or fail.
9- Systematic reviews use numeric and narrative
information fully - a small effect across several studies may be
significant - program characteristics can be used to explain
the effect.
10- Literature reviews are an inefficient way to
extract program outcome information,
particularly if the number of studies is large,
e.g.gt30. - It is impossible to mentally juggle relationships
among so many variables.
11Systematic Reviews
- Another approach to the literature is systematic
reviews. - A systematic review takes in account
- the precise purpose of the review
- i.e. stating a research hypothesis
- how studies are selected included
12- Systematic reviews can answer
- is there publication bias?
- are intervention programs similar enough to
combine? - what is the distribution of study outcomes?
13- Systematic review can answer
- are outcomes related to research design?
- are outcomes related to characteristics of
programs, participants, and setting? - what are the needs for future research?
14Purpose of the Guide to Community Preventive
Services systematic reviews evidence-based
recommendations
15Are we building on a foundation of existing
knowledge?
- Explosive growth of scientific information
- too much to keep up with
- contradictory results
- Increasing public doubt about scientific findings
16Systematic reviews for research synthesis
- combine many studies with different methods and
results - look for consistencies in set of findings
- more robust than single study
- may pinpoint why studies differ
- shows what is effective and why
17What counts as evidence?
Type 1 Type 2
Determinants or associations between risk and an outcome Relative effectiveness of different interventions
Something should be done This should be done
18The Guide to Community Preventive Services
- What strategies, targeted to which groups will
- promote healthy choices?
- prevent disease and injury?
- improve environmental conditions to promote
health?
19Community Guide Topics
Environmental Influences Environmental Influences
Sociocultural Environment Physical Environment Sociocultural Environment Physical Environment
Risk Behaviors Specific Conditions
Tobacco Use Alcohol Abuse/Misuse Other Substance Abuse Poor Nutrition Inadequate Physical Activity Unhealthy Sexual Behaviors Vaccine Preventable Disease Pregnancy Outcomes Violence Motor Vehicle Injuries Depression Cancer Diabetes Oral Health
20Central Questions
- program effectiveness
- feasibility of implementation
- acceptability to the population
- unanticipated harms (or benefits)
- cost-effectiveness
21Steps to Conducting a Review
- Assemble a review team
- Develop conceptual framework
- Prioritize review topics
- Define specific intervention for review
- Search for and retrieve evidence
- Rate quality of evidence
- Summarize evidence
- Translate into a recommendation
22Assemble a Review Team
- Multiple perspectives and backgrounds
- Improve completeness and accuracy of information
- Reduce impact of individual/institutional
perspectives - Enhance usefulness of products
23Develop Conceptual Approachto the Topic
24LOGIC FRAMEWORK ILLUSTRATING CONCEPTUAL APPROACH
TO NUTRITION COMMUNITY HEALTH
Interventions
Modifiable Determinants
Intermediate Outcomes
Community Health Outcomes
POPULATION FOOD INTAKE Food
Consumption Patterns (e.g.
fruits, vegetables) Intake of Nutrients and Food
Components Vitamins Minerals Fiber Fats Other
food constituents Dietary supplements Alcohol Ener
gy balance
Food Supply Factors -Agriculture
policy -Nutrition policy -Science and technology
-Food production, processing, storage and
distribution -Food fortification -Food safety
Physiologic Indicators Growth Adipose
tissue Musculoskeletal Gastrointestinal Metabolic
Cardiovascular Reproductive Immunological Neurolog
ical
Morbidity Mortality Measures of Health
Fitness
Environmental Factors
Availability Price -Neighborhoods -Schools -Work
sites -Homes -State and National -Food and
nutrition assistance programs
Life Stage Requirements Pregnancy Lactation
Childhood Adolescence Adulthood
Older Adulthood
Genetics, Co-morbidities
Consumer Demand -Household
resources -Nutrition knowledge -Cultural
practices -Psychosocial characteristics -Taste
and preferences -Advertising and marketing
Physical Activity Patterns
25Prioritize Intervention Topics
- Preventable disease burden
- Common practices that are questionable
- New approaches that are promising
- Topic of keen public health interest
26- Priority Ranked List of TopicsÂ
- Food beverage availability and price in
schools. - Comprehensive community approaches to increase
fruity vegetable intake. - Food and beverage advertising to children.
- Food beverage availability, price, portion
size, and labeling in restaurants. - Tax on sodas and snack foods.
- Farm subsidies and production of fruits,
vegetables, whole grains.
277. Food choice and nutrition education in food
assistance programs. 8. Nutrition and weight
management counseling in healthcare
settings. 9. Breast-feeding. 10 Product labeling
in grocery stores, restaurants and vending
machines. 11. Food beverage availability and
price in worksites. 12. Use of dietary
supplements across the lifespan.
28Specify the Review Question
- What population?
- What interventions or risk factors?
- What comparisons?
- What outcomes?
29Example Question
- Do multi-component, school-based nutrition
interventions which may include - curricula (nutrition physical activity)
- food availability, accessibility, price
- policy and environmental changes
- improve nutritional behavior and nutritional
status of children and adolescents in developed
countries?
30Analytic Framework
Behaviors dietary intake physical activity
School Policy
Environmental support for healthy choices
Knowledge nutritional needs food
content Attitudes self-care body
image Abilities self-assessment behavioral
change skills media literacy
Physiologic Indicators body size
composition growth fitness Health status blood
pressure cholesterol School Achievement attendance
participation performance
Multi-component School-based Nutrition Interventio
ns
Nutrition health messages
Promotion of self-awareness, self-efficacy
31Inclusion Criteria
- Characteristics derived from the focused question
- Additional characteristics
- Methodological
- Publication dates
- Languages
- Relevant outcomes
32Find Information
- Select strategies for finding studies
- Database searches
- Reviews of reference lists
- Gray literature
- Consultation with experts
33Assess Quality
- Suitability of study design
- see handout
- Quality of study execution
- see handout
34Suitability of Study Design
- Greatest
- Prospective and
- Concurrent comparison
- Moderate
- Retrospective or
- Multiple measurements over time no concurrent
comparison - Least
- Single before and after measurement no
concurrent comparison
35Strength of Study Execution
- Description
- Population
- Intervention
- Sampling
- Measurement
- Exposure
- Outcome
- Analysis
- Interpretation of results
- Other
36Exclude Studies Below Some Quality Threshold
- Exclude studies with limited execution (i.e.,
with many important threats to validity) - Sometimes exclude studies with least or moderate
suitability of design
37Research Synthesis for Public Health Policy
Practice DecisionsSystematic review of United
States studies of .08 blood alcohol concentration
laws
38Lowering legal blood alcoholconcentration (BAC)
limits
- Alcohol-related crashes cause 16,000 deaths and
300,000 injuries each year in the US - Laws that lower BAC from 0.10 to 0.08 existed in
less that half of US states
39Analytic FrameworkLower Blood Alcohol
Concentration Laws
Perceived Risk of Arrest
Lower B.A.C. Laws
OUTCOME
Alcohol- related crashes
Drinking driving behaviors
Fatal non-fatal injuries
Social norms regarding drinking and driving
40Evidence base for .06 BAC Laws
Searched journal articles, technical reports and
conference proceedings. Nine studies were
identified evaluated state BAC laws all of
sufficient design and quality. All studies
reported data from police incident reports of
crashes on public roadways.
41Evidence base for .06 BAC Laws
Eight of the nine studies reported percent change
in alcohol-related fatalities (post-law period
vs. pre-law period. Other outcome data included
public knowledge and perception of impaired
driving laws, self-report of impaired driving,
impaired driving arrests.
42Percent Change in Measures of Alcohol
-
Related Motor
Vehicle Fatalities, by State
States
15 States (1)
Median percent change
-
7
Interquartile range
-
15,
-
4
VA (2)
VT (3,4,5)
UT (5,3,4)
OR (4,5,3)
NC (6,2)
NM(2)
NH (2)
ME(4,5,3)
KS (2)
FL (2)
CA (5,7,8,3,4)
50
-40
-30
-20
-10 0 10
20 30
Percent Change
Median percent change -7
43States with .08 BAC Laws, 2002
Passed .08 BAC law before the new national
standard
Passed .08 BAC law in 2001
Passed .08 BAC law in 2002
44Who Is the Audience?
- Public health departments
- Health care systems
- Purchasers of health care
- Government and foundations
- Community organizations
45Lack of Persuasive Evidence
- Lack of evidence does not mean that interventions
dont work -
- Insufficient evidence may point to a research
agenda
46Issues of Evidence
- We dont have evidence about everything
- Enormous amount of evidence yet to review
- New evidence may change recommendations
- Urgent needs and limited resources
47(No Transcript)
48www.TheCommunityGuide.org