Why Not You Building a Cycle of Success

1
Why Not You?Building a Cycle of Success

• Jessica Pumo
• Product Marketing Manager

Deborah Stirling Research Science Director
2
Objectives
Illuminate the basic expectations of a Best
Practices Winner
Discover how to conduct your own research study
Learn tips and tricks for building your project
plan
Set your goals and lay the foundation to put your
school or district in the running for next years
Best Practices Winners
3
Anatomy of a Winner

• What defines a successful implementation?

4
Success is in the A.I.R.
Accountability
Clearly defined roles and responsibilities
Adequate planning
Follow-up
Involvement
Creative use of programs and materials
Extension beyond the classroom
Results
Evaluation Inform evolution of implementation
5
Why Be a Best Practices Site?
Benefits
A standard to aim for
Set the example
6
How to Become a Best Practices Winner
Basic Requirements
Your school or district must have used at least
one Waterford program for a minimum of 2 years.
Your program usage must be in line with those
prescribed for your grade level.
Your implementation must make creative and
effective use of Waterford materials.
The effectiveness of your implementation must be
supported with research results.
7
How to Become a Best Practices Winner
Accountability
Usage
Courseware
Student Books
Take-home Materials
Daily dose
Students 5 years and younger
Students older than 5 years
Target student populations
Widespread Use
Tailor Implementation
8
How to Become a Best Practices Winner
Involvement
Teacher commitment
Resource use
Reports
Teacher Guides
Home Connection
Parent Involvement
9
How to Become a Best Practices Winner
Results
Five essential steps for setting up a research
study
Planning

• Define purpose
• Identify requirements
• Understand context
• Consider the use of an outside consultant

10
How to Become a Best Practices Winner
Designing

• Link evaluation to program
• Identify evaluation questions
• Choose data sources, variables and measures
• Move from planning to action

Conducting

• Obtain or create data collection instruments
• Collect the data
• Prepare the data
• Analyze the data

11
How to Become a Best Practices Winner
Reporting

• Organize findings
• Select appropriate reporting media and formats
• Deliver/disseminate findings

Implementing the findings

• Create opportunities to discuss findings
• Revise evaluation plan as needed
• Follow up with decision makers or stakeholders
  on how findings are used

12
How to Become a Best Practices Winner
Evaluation Methods
Experimental

• Random assignment
• Highest level of certainty
• Ethics and digital equity tension
• The effects of xx on student achievement

Quasi Experimental

• Matched comparison group
• High level of certainty conditional to quality
  of match
  
• Pre-test treatment and conditional groups
• The effects of xx on student achievement
• Under what conditions and practices did the
  effect occur

13
How to Become a Best Practices Winner
Case Studies

• No control group
• Low level of certainty
• Harder to generalize and prove beyond a
  reasonable doubt
  
• How were the needs of the learners met?
• How has xx usage affected the learners
  confidence?
  
• Directly ask participants about value

14
How to Become a Best Practices Winner
What to Expect
Small sample size
Selection bias
No control group
Problems with equating different tests
Variability of implementation
15
How to Become a Best Practices Winner
Tips and Tricks
Consider instructional time
Include student data
Make random assignment visible
Provide teacher incentives
Principal support is key
Create an accountability plan
Create a school-wide motivation strategy
Over sample
Provide professional development
Present findings
16
How to Become a Best Practices Winner
Tips and Tricks
Consult product evaluation guidelines
Obtain leadership support
Have a kick-off event
Build evaluation capacity
Establish building level point of contact
17
How to Become a Best Practices Winner
Action Plan
Where are you now?
Set goals and benchmarks
3 Months
6 Months
9 Months
Next Year
18
How to Become a Best Practices Winner
Application Tips Tricks
Offer a complete picture
Introduce the team to you, your school and your
kids
Complete all requested information
Next year
2008 Application
Timeline
19
Q A

• Questions?