Quality Matters: Peer Review of Online Courses

1
Quality Matters _at_ Bucks Inter-Collegiate
Quality Assurance in Online Learning
2
Todays Session

• What is QM?
• Why QM _at_ Bucks?
• Introduction and use of QM Rubric
• QM Process and Principles
• Participation in Quality Matters

3
Overview

• Quality Matters is . . . a continuous
  improvement model for assuring the quality of
  online courses through a faculty review process.

Fact Sheet
4
QM Foundations

• Based in national standards of best practice, the
  research literature, and instructional design
  principles
• Designed to promote student learning
• Integral to continuous quality improvement
• Part of an inter-institutional, faculty-driven,
  collegial peer review process

5
For Our Purposes, Quality Is

• More than average more than good enough
• An attempt to capture whats expected in an
  effective online course at about an 85 level
• Based on research and widely accepted standards

85
6
Why QM _at_ Bucks?

• Accreditation
• Internal Assessments
• Faculty/Student Feedback
• WebCT 6

7
Whats in it for Faculty

• Fresh eyes leads to course improvement
• Quality assurance
• Validates best practices in online learning
• Reduces redundant procedural questions
• More time on teaching
• Expands professional community
• Recognition by BCCC community

8
Whats in it for Students

• Cleaner navigation accessibility
• Faster start reduced frustration
• Stronger engagement
• Course baseline standards
• Learning objectives outcomes aligned
• Quality online learning experience
• Success!!

9
Whats in it for Institutions

• Gain access to a sustainable, replicable,
  scalable QA process
• Strengthens institutions accreditation package
• Positively impact articulation agreements
• Provide professional development activities
• Improve student retention

10
The Tools QM Rubric
11
The Rubric

• Eight standards
• Course Overview and Introduction
• Learning Objectives
• Assessment and Measurement
• Resources and Materials
• Learner Interaction
• Course Technology
• Learner Support
• Accessibility

Key components must align.
12
QM Rubric Features

• Online Demo Rubric
• Annotations
• Our Examples
• Exemplary Course (?)

www.esac.org/fdi/rubric/finalsurvey/demorubric.asp

13
Peer Review Process

• Sometimes teaching an online course can feel
  isolating.
• How do we know if our course is effective?
• How do we make changes to our course to make it
  even better for our students?
• Sometimes we just need a fresh pair of eyes.

14
Quality Matters Course Peer Review Process
Faculty Course Developers
Institutions
National Standards Research Literature
Course
Rubric
Faculty Reviewers
Training
Peer Course Review
Feedback
Instructional Designers
15
Rubric Scoring
Standards Points Relative Value
14 3 Essential
12 2 Very Important
14 1 Important
TOTALS
40 80

• Team of three (3) reviewers
• One score per standard based on majority
• Assigned point value not sliding scale

16
To Meet Expectations

• A course must
• Rate Yes on all 14 of the 3-point essential
  standards.
• Earn minimum 68 out of 80 points

68/80 85
17
The QM process is

• Not about an individual instructor
• Its about the course
• Not about faculty evaluation
• Its about course quality
• Not about winners and losers
• Its about continuous improvement in a supportive
  environment

18
Remember...

• Continuous quality improvement is our goal.
• This is a learning process for us all.
• Were constructing and helping to determine
  what quality matters.

19
For more information Visit the
website www.QualityMatters.org Or contact Mary
Ellen Bornak (bornakm_at_bucks.edu) Georglyn
Davidson (davidson_at_bucks.edu) Michael Hennessey
(hennesse_at_bucks.edu) Sachi Horback
(horbacks_at_bucks.edu)
20
Thanks to YOUQuality Matters
pass it on!