Program Assessment Technical Assistance Meetings

1
Program AssessmentTechnical Assistance Meetings

• Spring 2009

2
Agenda

• Agency Overview
• Review Accreditation Cycle
• Program Assessment Document
• Guidelines for Submission
• Review, Feedback and Dialogue
• Relationship to the Site Visit

3
Committee on Accreditation

• COA Tasks in accordance with the Accreditation
  Framework . . .
• (1) Make decisions about the accreditation of
  educators preparation
• (2) Make decisions about the initial
  accreditation of new programs of educator
  preparation
• (3) Determine the comparability of standards
  submitted by applicants with those adopted by the
  Commission

4
COA Tasks (continued)

• (4) Adopt guidelines for accreditation reviews,
  and monitor the performance of accreditation
  teams and other aspects of the accreditation
  system
• (5) Report annually to the Commission

5
Accreditation Cycle
Site Visit (Yr 6)
6
Program Assessment

• Year 4 of accreditation cycle
• Purposes
• To determine if and how programs meet program
  standards
• To aid in focusing the Site Visit that will
  follow in Year 6.

7
Program Assessment Documentation in 3 Parts

• Part I
• institutional response to Program Standards
• Part II
• course syllabi that provide the evidence in
  support of Part I
• Part III
• background information on the assessments
  reported in Biennial Report

8
Program Assessment Part I

• Initial Program Approval document
• the dream
• Program Assessment document
• the reality

9
Program Assessment Part I - In Depth

• The Program Assessment document describes HOW the
  program meets each of the adopted program
  standards.

10
Program Assessment Part I - In Depth
Begin by understanding the entire standard
Take the standard apart sentence by sentence
Respond to each part of the standard
Provide appropriate evidence
11
Program Assessment Part I - In Depth

• Respond to key verbs or phrases from each
  sentence of the standard
• The program provides
• The program prepares candidates to
• Candidates have multiple, systematic
  opportunities to
• Candidates are required to demonstrate

12
Program Assessment Part I - In Depth

• Practice by reviewing some current program
  standards

13
Program Assessment Part I - In Depth

• The program provides . . .
• Candidates have opportunities to . . .
• Candidates demonstrate . . .

14
Program Assessment Part I - In Depth

• The program response to each portion of the
  standard is the
• HOW
• the program meets the standard
• One idea for consideration
• Additional ideas from participants

15
Program Assessment Part I - Review

• Any questions about Part I?
• Any ideas to share with others?

16
Program Assessment Part II - Evidence

• Provides the supporting evidence for responses
  to standards
• Ideas
• Copy and paste examples
• Indicate in the narrative of Part I
• specifically where to find the evidence
• in Part II tab, page number
• Provide a hyperlink

17
Program Assessment Part II - Evidence

• If your institution uses a particular form as a
  template or course outline that is required as
  the core of each course,
• you may submit that one course outline in your
  Program Assessment document.
• If each instructor designs their section of the
  course on their own,
• include each course syllabi for all courses
  taught in the two years prior to Program
  Assessment.

18
Program Assessment Part II - Review

• Any questions about Part II?
• Any ideas to share with others?

19
Program Assessment Part III - Assessment
Information

• Provide the actual assessments reported in
  Biennial Report
• Rubrics
• Observation forms
• Portfolio guidelines
• Provide detailed information on the assessments
• Readers will have copies of the Biennial Report

20
Program Assessment Part III - Assessment
Information

• How good is good enough? What does it look like?
• Describe how you ensure that assessment measures
  are used in the same manner regardless of
  location, number of faculty, etc.

21
Program Assessment Part III - Assessment
Information

• MS/SS Programs do not need to include background
  information on the TPA.
• MS/SS Programs do need to include information on
  . . .
• assessor training,
• rescoring procedures, and
• information that connect with Standards 19, 20
  and 21.

22
Program Assessment Part III - Review

• Any questions about Part III?
• Any ideas to share with others?

23
NEW Program Standards

• During Transition . . .
• Institutions have options for responding to
  Program Assessment. These options will be noted
  as new standards are approved.

24
Program Assessment

• Ongoing 7 year Accreditation Cycle
• Consider a process to continually update program
  documents.
• Continuous review and update of the document will
  save programs from having to write it all during
  Year 4 of the cycle.

25
Program AssessmentGuidelines for Submission

• Options
• a) 2 bound and 1 unbound
• paper copies
• b) 3 CDs with all parts
• c) 3 CDs with narrative and 3 paper copies of
  Parts I and II
• d) exploring on-line review
• Due dates - the 15th of . . .
• October, November, December or January

26
Program AssessmentGuidelines for Submission

• Each program selects the 15th of October,
  November, December or January
• Deans/Directors will get a letter by the end of
  March asking for the date of submission each
  program has selected.

27
Program AssessmentGuidelines for Submission

• Mail to
• Commission on Teacher Credentialing
• 1900 Capitol Avenue
• Sacramento, CA 95811
• ATTN PSD/Program Assessment
• Arrange to e-mail document
• Contact Jo Birdsell - jbirdsell_at_ctc.ca.gov

28
Program AssessmentReview Process

• Two trained readers per document
• Calibration of readers prior to reading first
  document
• Each document is read by two readers during
  meeting
• Readers review
• Is the HOW described?
• Does the HOW meet the standard?
• Is there adequate supporting evidence?

29
Program Assessment Feedback and Dialogue

• Feedback will be either
• Standard Preliminarily Met
• OR
• More Information is Needed
• First reading opens dialogue with program that
  could last for 12-15 months

30
Program Assessment Examples of Feedback

• Possible Comments
• Specifics of HOW the standard is addressed are
  needed.
• The narrative response needs to reflect the
  standard.
• The evidence does not support the narrative.

31
Program Assessment Preliminary Report of Findings

• Within 12-15 months, each Program Standard is
  determined to be either
• Met
• Met with Concerns
• Not Met
• A minimum of 6 months prior to the scheduled
  site visit

32
Program Assessment Preliminary Report of Findings

• Report provided to
• Program Contact and Dean
• COA
• Commission Consultant assigned to Site Visit
• Site Visit Team
• Report issued six months to a year before the
  site visit.

33
Accreditation Cycle
34
Program Assessment Use for Site Visits

• Prior to Site Visit
• Results of Program Assessment guide selection of
  site visit team members
• Preliminary Findings, questions and concerns are
  reviewed by the team

35
Program Assessment Use for Site Visits

• During Site Visit
• Results are confirmed, particularly through
  interviews
• Inconsistencies with Preliminary Report of
  Findings may need additional review

36
Resources

• http//www.ctc.ca.gov/educator-prep/accred-impleme
  ntation.html
• Sign up for PSD News
• Jo Birdsell at jbirdsell_at_ctc.ca.gov

37
Program AssessmentQuestions?