Standard 1

1
(No Transcript)
2
Standard 1

• The institutions mission and goals define the
  institution
• evaluation proceeds from the institutions own
  definition of its mission and goals.
• The institution engages in ongoing planning to
  achieve its mission and goals.

3
Standard 1

• The institutions mission and goals
• widely understood by, the campus
• are periodically reexamined
• appears in appropriate institutional publications
  
• give direction to all its
• educational activities,
• to its admission policies,
• selection of faculty,
• allocation of resources,
• and to planning.

4
Standard 1

• The institution reviews with the Commission
• changes that would alter its mission
• intention to offer a degree at a higher level
  than is included in its present accreditation
• Policy A-2 Substantive Change

5
Standard 1

• Through its planning process, the institution
  asks questions, seeks answers, analyzes itself,
  and revises its goals, policies, procedures, and
  resource allocation.
• clearly defines its evaluation and planning
  processes
• engages in systematic planning
• process is participatory

6
Faculty Data

• Qualifications degrees, sources of degrees,
  experience
• Faculty Rank
• Salaries and Benefits. Comparison data, e.g.
  from the College and University Personnel
  Association (CUPA)
• Number, sufficient for the mission

7
Faculty Data

• Workload
• Retention data
• Exit interview data
• Student survey data on faculty advising, etc.
• Standard faculty surveys with comparisons

8
Policies and Implementation

• Academic planning, curriculum development and
  review
• Academic advising
• Faculty role in governance
• Give examples and data about how policies are
  applied.

9
Policies and Implementation

• Salaries and Benefits
• Workload amount and the procedure for assignment
• Systematic faculty evaluation (See 4.1)
• Personnel policies and procedures
• Recruitment and appointment

10
Standard 4.B

• Scholarship
• Research
• Artistic Creation

11
Time to Catch Up

• If data is not available, make a plan to collect
  pertinent information.
• If policies are not in place or outdated, inform
  decision makers and get moving!

12
Faculty Evaluation, 4.1

• Clear procedures
• Ongoing, regular
• Based on the institutions
• Size
• Complexity
• Mission

13
Faculty Evaluation, 4.1

• Multiple indices that may include
• Annual merit salary evaluations
• Promotions
• Tenure reviews
• Post-tenure reviews
• Student/peer/administrator evaluations of
  teaching and service
• Peer review of scholarship

14
Faculty Evaluation, 4.1

• A comprehensive evaluation of each faculty member
  at least once every five years.
• A policy that addresses concerns that may arise
  between regular evaluations

15
Standard 9

• adheres to the highest ethical standards in its
  representation
• advocates high ethical standards in the
  management and operations
• policy defines and prohibits conflict of interest
  
• commitment to the free pursuit and dissemination
  of knowledge consistent with the institutions
  mission

16
Data CollectionImplement Trustworthy Methods

• Reliability
• Carry out systematic, well-defined processes
• Use well-designed instruments
• Validity
• Measure the right thing
• Minimize sources of contamination and bias
• Sufficiency
• Use multiple methods
• Think of how findings are supported
• Sampling
• Use proper sampling (mostly random)
• Think of sample size

17
PROCESS INPUT DESCRIPTIONS
18
Data CollectionSelect Methods

• Embedded test questions
• Capstone projects
• Portfolio evaluation
• Nationally normed tests
• Focus groups , interviews
• Pre- and post-testing
• Videotapes
• Outside experts
• Licensure and qualifying examinations.
• Research/creative projects
• Review boards

• Telephone surveys
• Internships, practica
• Exit interviews
• Data from past reports and studies
• Narrative descriptions
• Surveys
• Formal studies
• Interviews, focus groups
• Multiple sources
• Expert judgment
• And many others . . .

19
Data Collection Get the data you need.

• Mountains of data that never get digested or
  used to improve programs represent a monumental
  waste of faculty/staff energy and good will.
• Task Force on Assessment, Willamette U.

20
Data you need (part 1)

• For each Commission standard
• Do we comply?
• What evidence do we have to show compliance?
• If we dont have evidence, how will we get it?
• If we dont comply, what is our plan to comply?

21
Data you need (part 1)
Standards Analysis Worksheet
Requirement Compliance Evidence Course of Action






22
Accreditation Standards Worksheet Standard One
Institutional Mission and Goals, Planning and
Effectiveness Standard 1.A Mission and Goals
Requirement Compliance Evidence Course of Action
1.A.1 Widely understood Adopted by Board Periodically reexamined ??? YES None. Memo from board or other public statement Meeting minutes, agendas. Conduct survey. Interview students and faculty. Acquire memo or statement. Acquire minutes, agendas Generate narrative of outcomes assessment activity provide results.
1.A.2 Mission published YES Catalog, Student handbook, display plaques Collect books, sample plaque. Identify location of plaques
1.A.3 Documented progress YES Indicators of institutional effectiveness Summarize indicators and institutional effectiveness studies.

23
Data you need (part 1)
Accreditation Standards Worksheet Standard One
Institutional Mission and Goals, Planning and
Effectiveness Standard 1.A Mission and Goals
Requirement Compliance Evidence Course of Action
1.A.4 Mission/goals consistent with resources YES Human faculty needs study workload assessments. Financial analyses. Physical ???? Acquire studies and analyses. Gather/generate financial statistics Summarize information about physical resources from unit self-studies.

24
Data you need (part 2)

• Institutional level performance
• College/department level performance
• Program level outcomes
• Course level outcomes

25
Analysis of Mission Worksheet
MISSION INDICATORS SOURCE METHOD
Maintain a wholesome academic, cultural, social, and spiritual environment. Low crime rate Campus police Obtain annual report
Maintain a wholesome academic, cultural, social, and spiritual environment. Low rate of Honor Code infractions Dean of Students, ecclesiastical leaders Obtain annual report from Dean of Students Office
Maintain a wholesome academic, cultural, social, and spiritual environment. High adherence to "higher principles" Students (former, current) Survey Focus group
Maintain a wholesome academic, cultural, social, and spiritual environment. Positive attitude and perception of Honor Code and environment Students (former, current) Survey Focus group
26

• Data Analysis and Synthesis
• The KEYAdhering to the templates and
  guidelines set at the beginning of the process.

27
Data analysis/synthesisBolster your analysis
with

• Statistical simplicity
• Visual material
• Well labeled and neatly organized tables
• Charts, graphs, and other visual images
• Electronic versions
• Web documents
• Drill-down

28
Data analysis/synthesisShow judgment and action
ANALYSIS
JUDGMENT
29
Data analysis/synthesisEstablish benchmarks

• Expert judgment
• Comparison with past performance
• Comparison with other groups (controls, peers)
• Cut points generated from the data

30
Data Analyses Syntheses

• If data are organized, collected, and analyzed by
  Standard, how are data analyses synthesized
  across the institution?

31
THANK YOU!!!