Robert Buckley Imaging

1
Robert BuckleyImaging Services Technology
Center

• JPEG 2000 and
• Color Image Archiving

2
Key Messages

• JPEG2000 for video archivists
• As a compression architecture
• As a format architecture
• Who is using JPEG2000
• DP, NDNP
• DCI
• Activities to watch (and join)
• ISO JPSearch
• ICC Digital Motion Picture WG
• CIE Archival Colour TC

3
Embedding JPEG2000 in Applications
Activities
Application
Format
Imagestream
Color Spec
Metadata
4
What is JPEG 2000?

• JPEG 2000 is a wavelet-based image-compression
  standard, developed by the same ISO committee
  that previously developed JPEG, although with a
  different group of participants and contributors.
  
• JPEG 2000 was conceived as a next generation
  image compression standard that would improve on
  the performance of JPEG while, more
  significantly, adding features and capabilities
  not available with Baseline JPEG compression.

5
Why use JPEG 2000?

• Open Standard
• Royalty free
• One master supports multiple derivatives
• One file for both lossless and lossy data
• Progressive display and scalable rendering
• One algorithm for both lossless and lossy
  compression
• Region-of-Interest (ROI) on coding and access
• Easily handles large images
• Multiple components and high bit-depth images
• Generous metadata support

6
JPEG 2000 Standard - Parts 1-6
ISO/IEC 15444 / ITU-T Rec. T.800
Part 1 Core Coding System
Part 3 Motion JPEG2000
Part 4 Conformance Testing
Part 6 Compound Image File Format
Part 2 Extensions
Part 5 Reference Software
7
JPEG 2000 Standard - Parts 8-13
Part 8 JPSEC Secure JPEG2000
Part 9 JPIP Interactivity Tools
Part 10 JP3D 3D Floating Pt
Part 11 JPWL Wireless
Part 12 ISO Media File Format
Part 13 Entry-Level JPEG2000 Encoder
Key
Under Development
Encode
Published
8
One Master ? Multiple Derivatives

• A single JPEG2000 master can serve multiple uses
• Scale by resolution
• Thumbnail image
• Screen resolution image
• Print quality image
• Scale by quality
• Lossless ? Lossy
• Preset file size
• Key enabling technologies
• Wavelet transform
• Embedded block coding

9
One Master ? Multiple Derivatives
Master Image
Derived Image
Thumbnail
Low res image
Medium res image
10
JPEG 2000 Codestream

• The number of bits allocated to parameters in the
  JPEG 2000 codestream allow images up to 4 Gpixels
  square, with 16,384 components and 38 bits per
  component.
• Part 1 defines 5 profiles that restrict the size
  and use of various codestream structures
• Examples image size, codeblock size, tile size
• Part 4 defines 3 compliance classes that limit
  what a decoder has to support
• Compliance Class 2 guarantees support for images
  up to 16 Kpixels square, with 256 components and
  16 bits per component

11
Embedding JPEG2000 in Applications
Imagestream
12
Basic JPEG 2000 File

• JPEG 2000 Signature Box
• Identifies file as member of the JPEG 2000 file
  format family, same for all files
• File Type Box
• Specifies brand, version, compatibility, profile
• Header Box
• Contains image parameters and color spec
• Codestream Box
• Contains image stream
• Metadata boxes
• XML-formatted or user-specific metadata

Box Stack
JPEG 2000 Signature
File Type
Header
Codestream
XML
UUID
13
JPEG 2000 File Format Family

• JP2 (JPEG 2000 Core, Part 1)
• Single image, continuous codestream
• JPX (JPEG 2000 Extensions, Part 2)
• Multiple codestreams, possibly fragmented
• MJ2 (Motion JPEG 2000, Part 3)
• Timed sequence of JPEG 2000 images
• Intra-frame coding only
• JPM (JPEG 2000 Multi-Layer, Part 6)
• MRC model for compound document images
• Multiple images (binary and contone) and pages

14
Metadata

• The JPEG 2000 File Format family provides a
  frame- work for embedding domain-specific
  metadata in a file
• XML boxes for XML-formatted metadata
• e.g. DIG 35, Dublin Core, GML, MIX
• Searchable text coming
• UUID boxes for non-XML metadata
• e.g. IPTC, GeoTIFF
• MPEG-7 Binary Box for metadata in BiM format
• Examples
• Associate metadata with the entire image or with
  specific regions of the image
• JPEG2000-specific preservation metadata in Z39.87

15
Color Specification

• Direct
• Identify the color space or encoding by name
• Index into a list of enumerated color spaces
• Examples
• sRGB, ProPhoto RGB (ROMM RGB), CIELAB
• Indirect
• Give the transform to a standard color encoding
• Use pre-defined transform elements for which you
  supply the parameters
• Example
• ICC profiles define the transform to a PCS or
  Profile Connection Space, i.e. XYZ or CIELAB
• ICC has started a Digital Motion Picture WG

16
Color Spaces
17
Color Spaces
Adobe RGB 98
sRGB (Rec. 709)
y
x
18
Embedding JPEG2000 in Applications
Activities
Application
Format
ImageStream
Color Spec
Metadata
19
JPEG2000 Digital Photography

• ANSI defined a JPEG2000 profile for Digital Still
  Cameras
• Based on JP2 (JPEG2000 Part 1) file format
• Readers conform at least to Compliance Class 1

Activity ANSI
Application Digital Photography
FormatJP2
Profile-1
JPEG 2000
8-bit sRGB, sYCC, sGray
Color Spec
Restricted ICC profile
Metadata
DIG-35 with extensions,
uses XML box
20
National Digital Newspaper Program

• NDNP is an NEH/LoC Program to enhance access to
  all American newspapers
• Two-year pilot began May 2005
• Each page to be delivered as TIFF and JPEG2000
  images

Activity NDNP
Application Production
FormatJP2
Resolution progressive, visually lossless
JPEG 2000
8-bit sGray, Restricted ICC
8-bit Gray
RDF/Dublin Core, uses XML box
RDF/DC
21
Digital Cinema

• Digital Cinema uses JPEG 2000 for image
  compression in the DC Distribution Master
• Compressed image size limited to ?1.25 MBytes at
  24 fps

Activity DC Initiative
Application Distribution
FormatMXF
Profile-3 2K - up to 2048 x 1080
JPEG 2000
Profile-4 4K - up to 4096 x 2160
12-bit non-linear XYZ
12-bit XYZ
Metadata
Frame and image parameters
22
JPSearch

• Linked to JPEG2000 but not part of the standard
• Destined to become ISO 24800
• Start with Technical Report and Whitepaper
• Technical report
• to provide the JPEG user community with a clear
  understanding of the entire image retrieval
  process
• to identify the components involved in search
  process, the linkages between them, and the
  components and links that should be standardized
• Whitepaper
• To articulate the benefits of a standardized
  image search framework and components
• Drafts produced at July 2005 JPEG2000 meeting
• Technical report proposes 4-layer framework for
  digital image search
• userqueryresultcontent
• Whitepaper proposes ISO MPEG-7 content
  description technology

23
Motion Picture and Archival Color

• ICC Digital Motion Picture WG
• Status Started in early 2004
• Rationale Current ICC technology is
  print-centric
• Charter
• Codify an open, vendor-neutral, cross-platform
  color management system architecture for DMP
  production that will enable utilization of ICC
  color management
• CIE - Archival Colour TC
• Status In planning stage
• Rationale No activity specifically aimed at
  color preservation
• What it would do
• Develop a Technical Report that documents the
  needs of archival color and that can be
  communicated to other standards and development
  organizations.

24
Conclusions

• JPEG2000 is a privileged format for access and
  distribution
• Offers a compression and format architecture
• Your profile waiting to be developed
• Leverage DCI work
• There are related activities worth following
• JPSearch and CIE Archival Color