CECs Evidence Based Practice Effort

1
CECs Evidence Based Practice Effort

• Rachelle Bruno
• Northern Kentucky University

2
Professional Standards and Practice Committee

• Standing Committee
• Knowledge and Skill Subcommittee
• Evidence Based Practice Workteam

3
CEC Member Involvement

• CEC Staff
• Richard Mainzer, Associate Executive Director,
  Professional Services
• Discussions with RA - 2005, 2006
• Discussions with IDC - 2006
• Discussions with Division Boards - 2004, 2005,
  2006
• Presentations at TED
• Open Forum - CEC Convention 2006

4
Member Involvement (cont).

• Selected Conference Call Participants-
• David Bateman, Ellen Brantlinger, Bryan Cook,
  Diane Browder, Lynn Ahlgrim-Delzell, Marilyn
  Friend, Russell Gersten Diane Haager, Janie
  Hodge, Janette Klingner, Tim Landrum,Robin
  McWilliam, Sam Odom, Diane Paul, Hugh Reid,
  Kathlene Shank, Gary Siperstein, Melody
  Tankersley
• Pilot Team Members
• Bryan Cook Diane Browder/Lynn Algrim-Delzell
  David Test Tim Landrum Robin McWilliam Sam
  Odom Janette Klingner

5
CEC Special EducationEvidence-Base Practice
Professional Wisdom
Family Values
Evidence-Based Practices
6
Current Timeline Activities

• Jan 2006 Board asks PSPC to engage in further
  discussion of EBP
• Spring 2006 PSPC engages CEC in discussion -
  convention, conference calls
• Oct 2006 PSPC requests Pilot
• January 2007 Board approves Pilot
• January 2008 Report to Board

7
Tasks of the Pilot Project

• Determine decision criteria and coding rubrics
• Determine review guidelines
• Develop guidelines for practice reports
• Review extant studies
• Evaluate process

8
What is a practice?

• Specific strategy or intervention designed for
  use by special educators intended to support the
  education of individuals with exceptional
  learning needs
• Could include programs that are a combination of
  interventions

9
Pilot Criteria/Classification

• Based largely on the work by the CEC Division for
  Research task forces articles in the winter 2005
  issue of EC
• Examines
• Number, type, and quality of studies
• Direction and significance of the effects

10
How does this fit with the What Works
Clearinghouse?

• Coordinating efforts in this area as much as
  possible.

11
Describing the Evidence Base
12
Potential Study Rubric Dimensions

• Design
• Dependent and Independent Variables
• Design Quality
• Implementation Quality
• Effects

13
Proposed Process
14
Proposed Evidence-Based Practice Study Reports

• A clear and complete description of the practice
  with its essential components,
• A description of each research study that the
  team included in the synthesis study,
• A scored rubric for each included study along
  with a completed rubric across the studies to
  determine the category of the practice.
• A brief description of the results of each
  included study, including the direction,
  magnitude, and statistical significance of the
  empirical effect estimate. This could be
  characterized as a statistically significant
  positive, substantively important positive,
  indeterminate, or negative effect.
• The study teams recommendation along with the
  basis of the recommendation.

15
Technical Review Panels

• Supporting the PSPC, a new CEC Scientific
  Advisory Sub-committee (SASC) in collaboration
  with CEC affiliates will establish a pool of
  expert reviewers from which the SASC can select
  TR panels to conduct the reviews of the EBP
  Studies. Each TR panel will analyze an EBP Study
  to ensure the criteria were appropriately applied
  to the body of literature and the
  recommendation(s) are appropriate.
• TR panels selected from the pool based on their
  backgrounds
• Division input

16
Who will do the Studies?

• Workteams sponsored by CEC Divisions and research
  teams
• Small number of expert colleagues (3 to 5)
• Who can harvest relevant studies
• And efficiently synthesize the results

17
What Studies will come first?

• CEC together with its affiliate Divisions will
  identify practice areas for study and schedules
  as time and resources permit.

18
Dissemination

• The Bridge
• Between Knowledge and Effective Practice
• Utilize existing methods that CEC with its
  affiliates have for dissemination in ways that
  ensure professionals have the information to
  select and implement practices with fidelity.
• CEC must also ensure that practices are
  disseminated to those who influence the context
  in which professional practice occurs.

19
CEC Special EducationEvidence-Base Practice
Professional Wisdom
Family Values
Evidence-Based Practices
20
Information
Rachelle Bruno Pilot Workteam Chair
bruno_at_nku.edu 859-572-5167

• Richard Mainzer
• Associate Executive Director
• Professional Services
• Richardm_at_cec.sped.org
• 703-264-9408