Data Structure Standards for Management and Delivery

1
Data Structure Standards for Management and
Delivery

• Robin Dale
• RLG
• Robin.Dale_at_notes.rlg.org

2
The Topics at Hand

• Joint Photographic Experts Group (JPEG) 2000
• NISO Z39.87 Technical Metadata for Digital
  Still Images
• Metadata Encoding and Transmission Standard (METS)

3
JPEG 2000

• Emerging digital standard
• ISO/IEC 15444 (and ITU-T T.800) series of
  standards
• Image coding standard, 6 parts
• To replace JPEG (JFIF) format
• JPEG 2000 Part 1 Core standard
• .jp2 (standard JPEG 2000 file)
• JPEG 2000 Part 2 Extensions
• .jpx (extended JPEG 2000 file)

4
JP Family Architecture

• A file is a sequence of boxes
• A box consists of
• 4-byte length
• 4-byte type identifier
• content

5
JPEG 2000 Part II Extensions

• Codestream level includes
• new decomposition
• more flexible Regions of Interest
• JPX extended file format includes
• more extensibility support
• layers (like Photoshop)
• animation
• full ICC color support

• DIG35 metadata, including IPR metadata

6
DIG 35 Metadata Specification

• I3A (International Imaging Industry Association)
• Defines a set of public metadata for digital
  still images.
• XML DTD and schema (version 1.1)

7
Data Structure

• Image Creation metadata
• Content Description metadata
• Metadata History metadata
• Intellectual Property Rights metadata
• Fundamental metadata types and elements

8
DIG35/JPEG 2K Data Structure Elements

• Image Creation metadata
• Camera capture, scanner capture, image source,
  creator, ltcapture settingsgt, ltscanner capturegt,
  ltcaptured itemgt
• Content Description metadata
• Caption, capture time, location, person, thing,
  organization, event, audio, dictionary reference
• Metadata History metadata
• Processing summary, processing hints (cropped,
  transformed, retouched)
• Intellectual Property Rights metadata
• Names, description, dates, exploitation,
  identification, contact point, ipr history

9
NISO Technical Metadata for Digital Still Images

• A Data Dictionary (NISO Z39.87) and an XML Schema
  (MIX)
• Data Dictionary commissioned by NISO
• MIX schema created by Library of Congress
• Comprehensive list of technical data elements
  required to manage and preserve digital image
  collections
• Based on DIG35 and TIFF specifications
• Most data can be automatically extracted from
  image files

10
Z39.87 Data Structure Elements

• Basic Image Parameters
• Format, File Size, Compression, Color Space etc.
• Image Creation
• Source Type, Producer, Scanning System for
  Capture, Digital Camera Set-up for Capture
• Imaging Performance Assessment
• Spatial metrics (sampling frequency, image
  dimensions, source dimensions), Energetics (bits
  per sample, color map, white point, etc), target
  data (type, image data, performance data)
• Change History
• Image processing (date, source data, software),
  previous image metadata

11
Using the Data Dictionary

• Capturing Data
• Capture data from tiff file header
• Capture data from policies
• Managing Data
• Build a Digital Repository
• Evaluate a Digital Repository
• Educate the vendor community
• An identified set of data needed from
  hardware/software
• Streamline automated capture of technical metadata

12
An XML Implementation
www.loc.gov/standards/mix/
13
MIX Sample
14
Metadata Encoding and Transmission Standard

• XML Schema for encoding digital objects
• Enables presentation and navigation of image
  files
• Developed by the Digital Library Federation
  (DLF) maintained by Library of Congress
• Current version (1.2) released 17 March 2003

15
METS Scope

• Data transfer syntax
• between applications
• between institutions
• Driver for applications
• page turner
• audio player
• multimedia presentation
• Archiving syntax

16
METS Scope

• Supports
• Structural metadata
• complex reformatted or born digital objects
• Metadata wrapper framework
• descriptive, administrative, structural, etc.
• structural required
• others use namespaces to reference extension
  schemas

17
METS Scope

• METS does not itself provide a vocabulary and
  syntax for encoding descriptive metadata (no
  descriptive metadata elements defined in METS)
• METS does provide a means for pointing to
  external descriptive metadata and/or for
  including descriptive metadata internally. It
  provides a means for linking this metadata to the
  digital content of the entity

18
METS Components

• Core Components Navigation Browsing
• Header, content files, structural map
• Extension Components Discovery Management
• Descriptive metadata
• Metadata on the physical artifact
• Administrative metadata
• Technical
• Metadata on the digital file
• Rights
• Metadata specifying legal access
• Source
• Metadata on the source of digitization
• Digital Provenance Information
• Metadata on the life-cycle of the file
• Behavioral metadata

19
(No Transcript)
20
METS summary

• Tools under development for
• metadata capture
• transformation
• transfer
• dissemination/display
• Profiles necessary for interoperation
• Which extension schemas used?
• How structure maps are organized

21
METS summary

• METS is not all things to all people
• Designed for local institutional application
  support
• Solving an immediate local problem
• Common to many institutions
• Flexible framework supports many institutional
  situations
• Profiling necessary to interoperate
• For OAIS packages
• For shared tools
• For other kinds of interoperation (e.g. cross
  repository search)

22
How they can play together
METS
METS
Descriptive MD
Structural MD
Administrative MD
Behavioral MD
Digital Provenance
Technical
Source
IP Rights
NISO Tech MD METS Extension Schema
JPEG 2000 (.jpx)
23
Thank you!

• Robin.Dale_at_notes.rlg.org