1
Help! My Assessment Results Are Not What I
Expected -- How An Assessment Reporting
Database Can Help
2
(No Transcript)
3
Why is library assessment necessary?

• Accreditation purposes.
• Fits into the other parts of an organization
  strategic plan, mission/vision/values, annual
  reports.
• Result of financial constraints and increased
  accountability.

4
Problem Areas in Developing Assessment Studies

• Identification of what actually needs to be
  assessed.
• Determination of population and sample size.
• Time-consuming nature of assessment studies.

5
Problem Areas in Developing Assessment Studies

• Selection, creation and implementation of
  appropriate tools/methodologies.
• Which assessment models are the most appropriate?
• Are there models that already exist?
• Do you need to create an in house one?
• Interpretation and application of results.

6
Need for Assessment Reporting Database

• Archives assessment studies all in one accessible
  location.
• Provides search-ability for assessment studies.
• Saves time through the use of existing assessment
  models.

7
Need for Assessment Reporting Database

• Helps in identifying problem areas during the
  initial developmental stage of the assessment
  study.
• Assists in the interpretation of results, when a
  tested model has been used and results can be
  compared.

8
TIMELINE Creation and History of theFlorida
Atlantic University Assessment Database
9
Timeline 1998-2000

• 1998 -- Southern Association for Colleges and
  Schools (SACS) recommends strong, integrated
  planning process.
• 1999 -- FAU Mission Statement, Goals and
  Objectives revised.
• 1999 -- Planning objectives developed and placed
  on FAU web site.
• Fall 1999 -- FAU Office of Institutional
  Effectiveness Analysis (IEA) Team begins
  outcomes assessment planning as a result of the
  Universitys anticipated next visit by SACS
  accreditation team.

10
Timeline 1998-2000

• Spring 2000 -- Dr. James O. Nichols, well-known
  consultant concerning institutional
  effectiveness, was invited to FAU to assist with
  preparations for the visit by SACS.
• Spring 2001 -- Development of model for the
  quality improvement.
• Spring 2001 -- Dr. Nichols model was used to
  create a template. A template and information was
  collected as WORD documents.
• Summer 2001 -- Started a repository to collect
  assessment information of all techniques and
  studies.

11
Timeline 2001-2005

• October 2001 -- Phase I planning of an electronic
  database functional . The templates within the
  database assure a uniformity of reporting.
  Simplifies collection, review, management and
  utilization of data.
• January 2002 -- Database was created using
  Microsoft SQL Server and Active Server Pages
  (ASP).
• Took paper template and added login and
  Reviewer comments section (that require some
  action be made to an outcome).

12
Timeline 2001-2005

• Assessment plans can be efficiently managed.
  Organized by college and department (serves a
  minimum compliance function).
• July 2002 -- Training and implementation. Easy
  to learn and use.
• December 2002 -- Presented to SACS.
• Accomplishments completed. Data can be stored
  and retrieved easily.
• Public Web site functional.
• Summer 2003 -- New director for IEA team

13
Timeline 2001-2005

• Completion of the programmatic self-study during
  2003-2004 proved to be easier with this
  documentation in place.
• A web-based application, users can access the
  application from anywhere the Internet is
  available.
• Faculty/staff have continuous access to data and
  the documentation of the entire assessment
  process.
• Outcome service survey of faculty/staff

14
Timeline 2005-

• November 2005 -- Phase II planning of database
• March 2006 -- Major revision to ASP.net from ASP
• Mandated Academic learning compacts.
• May 2006 -- New assessment director of IEA team
• Future revision projects are forthcoming.

15
Accessing the FAU Assessment Database
16
Figure 1. Login screen for FAU Assessment
Database
17
Figure 2. Guest view of all the reporting units
18
Figure 3. View of assessment plans related to a
specific unit
19
Figure 4a. Data related to a specific outcome in
a unit
20
Figure 4b. Data related to a specific outcome in
a unit
21
Future of the FAU Assessment Database

• The next revision will be in about 6-8 months
  (fall 2007).
• A search function will be added.
• Revision will be used to integrate the strategic
  plan into the assessment process, manage
  planning and assessment.

22
Future of the FAU Assessment Database

• There will be one set of assessment reports for
  all years.
• As goals age, they will be dropped out and new
  ones added.
• Public view is only of current assessments.

23
Future of the FAU Assessment Database

• There will be an emphasis on long range planning.
• Each change is archived, like a wiki.
• Easy way to access this?
• How to connect the repository to the public view
  on librarys website?

24
How can an assessment database improve overall
quality of library assessments?

• An assessment database with word search-ability
  functions can be an important tool.
• Helps to identify what actually needs to be
  assessed and how it previously was assessed.
• Provides access to previous research designs and
  methodologies.
• Can help to eliminate the need to create a new
  assessment study, which is time-consuming.

25
How can an assessment database improve overall
quality of library assessments?

• This tool can be used to integrate assessment
  studies with strategic plans.
• Saves time, no double duty reporting.
• Assessment plans all in one place.
• History of assessment plans listed like a wiki.

26
How can an assessment database improve overall
quality of library assessments?

• A home grown" assessment reporting database is
  fairly easy to create and user-friendly.
• Commercial products can increase search-ability,
  but are expensive and not user-friendly,
  requiring extensive training.
• Examples TracDat and Weave Online

27
For More Information
28
http//home.fau.edu/parrish/web/