SQUARING THE CIRCLE

1
SQUARING THE CIRCLE

• 360 Degree Evaluation of an ADR System

Cathy Costantino Martha McClellan
2
INTRODUCTION

• Who Are We?
• Why Us?
• What Is This Session About?
• How Will We Proceed?

3
Why Evaluate At All?

• Measure
• Accountability
• Best Practice
• Justification

4
Terminology

• Capture
• Count
• Compare
• Measure
• Analyze
• 360 Degree Evaluation

5
Multi-Stage Evaluation Grid
Program Development Stages
Types of Measures
Capture Count Compare Measure
Analyze 360

Evaluation
Imposed Triage Dispute Resolution Conflict
Management
6
Evaluation Design Issues

• Goals and Objectives
• Macro
• Micro

7
Evaluation Design Issues

• Purpose of Program Evaluation
• Organization
• Program
• Effectiveness/Impact
• Administration/Operation

8
Evaluation Design Issues

• Program Measures
• Quantitative
• Qualitative
• Customer Satisfaction

9
Evaluation Design Issues

• Design Type
• Control Group
• Before/After Model

10
Evaluation Design Issues

• Analysis Plan
• Descriptive Statistics
• Multi-variable Methods
• Anecdotal/Interpretative

11
Evaluation Design Issues

• Data Collection Plan
• Surveys
• Descriptive Data Forms
• Post-Activity Evaluation Forms
• Participant Interviews
• Focus Groups

12
Evaluation Design Issues

• Reporting
• Effectiveness/Impact
• Administration/Operation

13
What We Learned

• Timeline
• Spectrum of Success

14
ADR SUCCESS SPECTRUM
ADR Design Proposal
ADR Design Test
ADR Assessment
ADR Design Implementation
ADR Consultation
ADR Awareness
ADR Mind Set
15
Thank You

• Please complete and submit the follow-up session
  form by indicating your group discussion
  preference.
• Also, please complete and submit your Evaluation
  forms.