Open Archives

1
Open Archives
Just a brief, high-level overview, for the
December 2000 ZIG Meeting
Ray Denenberg
2

• Basic Concepts
• Architecture
• Topology
• Protocols

3
Basic Concepts

• Open e-Print Archive
• Open Archive -- generalization of e-print
• Data Provider and Service Provider
• Partition
• Record
• Document Metadata
• Identifiers

4
E-Print Archive

• Author self-archiving
• Submission mechanism
• Long-term storage system to
• facilitate the broad dissemination of archive
  data
• Managed Preservation/retention policies
• Mechanism to enables third parties to collect
  data from the archive. Supports
• discovery,
• presentation,
• and analysis, of data in the archive.
• end-user services

5
Open Archive

• generalization of e-Print
• scholarly archives
• harvesting in a digital library context

6
Data Provider and Service Provider

• Data Provider
• The manager of an archive, acting on behalf of
  the authors submitting documents. Provides a
  submission mechanism, long-term storage, and
  enables third parties to collect data.
• Service provider
• Creates end-user services based on data stored in
  e-print archives. For example a service provider
  could implement a search engine for mathematical
  e-prints stored in archives worldwide.

7
e-Print Archive

Harvestor
Data Provider
Service Provider
Dienst Protocol
8
Archive

Harvestor
Data Provider
Service Provider
OAI Protocol
9
Partitions and Records

• Partition -- Z39.50 database
• Record
• Dienst a record is either
• Document metadata, or
• metadata together with the document
• OAI
• Document Metadata

10
Metadata Set

• Title
• Date of accession
• Display ID
• Full Id
• Author
• Abstract
• Subject
• Comment
• Date for Discovery

11
Basic Concepts

• Open e-Print Archive
• Open Archive -- generalization of e-print
• Data Provider and Service Provider
• Partition
• Record
• Document Metadata
• Identifiers

12
Identifiers

• Unique identifier assigned to each archive
• Unique persistent identifiers for records in the
  archive
• So archive identifier record identifier
  full identifier

13
Protocols

• Dienst
• OAI
• Z39.50?

14
Dienst Verbs (OAI)

• List Partitions
• List Contents (partition, after-date, metadata
  format)
• Disseminate Metadata for a Record (id, metadata
  format, content type)
• Get Metadata Formats
• List Metadata Formats available for a Record

15
Dienst Verbs (additional)

• Disseminate (Z39.50 retrieve)
• Content type (Z39.50 record syntax)
• view (Z39.50 Element specification)
• div
• page image
• binder
• encoding
• List Encodings
• List Verbs
• List Document Versions
• Submit a New Version of a Document

16
Dienst Verbs (additional)

• Get Document Structure
• Submit a Document
• Get Submit Formats
• Get Terms and Conditions
• Withdraw a Document
• List Indexes
• Regions/Collections/Publishers

17
Dienst Mapping

• Request messages encoded in URLs, embedded in
  HTTP requests.
• Responses are structured streams with MIME type
  text/xml.
• Status codes and error returns correspond HTTP.
  Normal response signaled with the 200 reply code.
  Error returns are signaled with the appropriate
  4xx code (400, 404).

18
OA Protocol

• List Records
• List Identifiers
• List Sets
• List Metadata Formats
• Get Record
• Identify (Explain)

19
request
List Identifiers
Partial list of identifiers resumptionToken
request
List Identifiers resumptionToken