MetaLib Version 3 MetaIndex

1
MetaLib Version 3MetaIndex
2
Agenda

• Introduction
• Creating a MetaIndex
• Harvesting records for the MetaIndex
• Loading records into the MetaIndex
• MetaIndex Maintenance
• Searching the MetaIndex

3
MetaIndex Introduction
Glossary of terms Preprints Pre-publication
research reports OAI Open Archives Initiative
OAI repositories sites that make their
archives available, using OAI protocol
http//www.openarchives.org/OAI/openarchivesprotoc
ol.html MetaIndex sources Harvesting
periodic downloading of records from
an archive
4
MetaIndex Introduction
Record within a MetaIndex
5
MetaIndex Introduction
What is a MetaLib MetaIndex? A database
whose contents are loaded onto the server -
not accessed remotely A searchable resource
within MetaLib Where does a MetaIndex come
from? A repository, typically of preprints
An existing database at the customer site What
does it require? A license Additional
disk space oracle table space
6
MetaIndex Introduction

• Working with MetaIndexes on the /M Interface

7
MetaIndex Introduction

• MetaIndex Management Menu Definition of terms
• 1. Create a MetaIndex
• Create a framework (IRD, configuration,
  instance).
• 2. Harvest (download) the records from a
  source.
• Identify a repository and a set within
  the repository
• 3. Load the records into the MetaIndex
  framework.
• Indexes are created, making the MetaIndex
• searchable.

8
Creating a new MetaIndex
9
Creating a new MetaIndex
NB !
10
Creating a new MetaIndex
Update the MetaIndex IRD Record Now
Add fields such as GUEST, Free, Type Add Link to
Native Interface Save Exit
11
Creating a new MetaIndex

The MetaIndex configuration is copied from a
template belonging to the MetaLib institution. A
new configuration code is composed of L_ and the
database code, and created automatically.
12
Harvesting records for a MetaIndex

• Go back to MetaIndex Management on /M
• Click on Harvest Records

13
Harvesting records for a MetaIndex

• Click on list of repositories

There are currently 150 OAI conforming
repositories.
14
Harvesting records for a MetaIndex

• Locate the archive from which to load records.
• Copy the base url.

15
Choosing a MetaIndex

• To see Sets within a repository
• http//ltrepository URLgt?verbListSets
• To see records within a set
• http//ltrepository URLgt?verbListRecords
• fromltYYYY-MM-DD untilltYYYY-MM-DDgt
  metadataPrefixltformatgtsetltsetcodegt

16
Harvesting records for a MetaIndex

• Select a MetaIndex from the pulldown menu

• Click on Add new harvesting target

17
Harvesting records for a MetaIndex

• Menu opens fill in details of target
• Paste URL into URL field

18
Harvesting records for a MetaIndex

• Click on Look up repository Sets and find the
  set use the setSpec of the set, not the name.

19
Harvesting records for a MetaIndex

• Copy the set number. Paste it into the SET field.
• Add the date (i.e. take records from this date
  forward)
• Click on H to start harvesting records
• Harvesting ended successfully
• Click on V to view the harvested file details

20
Harvesting records for a MetaIndex

• Checking the file on the server
• gtdlib met01
• gtdr
• gtcd import
• rachel-m3_4-MET01gtgtls
• met01_040509_160336.xml.040509
  met01_040509_160336.xml.orig
• .orig file data sent from repository
• Copied to .xml file used for updating

21
Harvesting records for a MetaIndex

• Harvesting Log in datascratch directory
• gtdlib met01
• gtds
• gtvi harvesting_log

The harvesting ended successfully
22
Loading records into the MetaIndex

• Click on L to load the harvested files
• Window opens Select a metaindex
• Confirm loading

23
Loading records into the MetaIndex

• File names
• Loaded files assigned an ID number used for
  updating
• File name also gets load date
• Bad load filename becomes xml.loadfailed
• Load_error_log in datascratch
• The load failed. XML format is invalid

24
MetaIndex Maintenance
25
Cron job

• Web Interface for initial setup testing
• Cron job for harvesting loading
• Incremental to avoid large sets

26
Cron job
Schedule Harvesting Loading Files
27
Find a (MetaIndex) Resource
28
Searching the MetaIndex

• On the User Interface, locate the MetaIndex and
  search it.

29
Searching the MetaIndex

• Search

Hint Dont give up many indexes have very few
records!
30
Searching the MetaIndex

• Check the info button direct link

31
MetaLib Version 3MetaIndex