Experimental Evaluation of Museum Case Study Digital Camera Systems

1
Experimental Evaluation of Museum Case Study
Digital Camera Systems Erin P. M.
Smoyer Lawrence A. Taplin Roy S. Berns Munsell
Color Science Laboratory Rochester Institute of
Technology IST 2nd Annual Archiving
Conference April 28, 2005
2
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

3
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

4
Introduction
1. Survey
Interviews
2. Case Studies
Experiments
5
Introduction

• A testing procedure for characterizing
  trichromatic (RGB) digital cameras used to
  digitally archive cultural heritage collections
  (paintings)
• Target-based

6
Aims of testing procedure

• Provide objective measures of quality
• Use software to automate evaluation of test
  targets and report numbers or graphs describing
  key image quality parameters
• Follow current digital photography standards to
  the greatest extent possible

7
Testing procedure parameters

• 10 image quality parameters

• System spatial uniformity
• Tone reproduction
• Spectral sensitivity
• Color reproduction accuracy
• Noise

• Dynamic range
• Spatial cross-talk
• Resolution
• Color channel registration
• Depth of field

8
Standards

• Consensus standards bodies
• ISO - International Organization for
  Standardization
• IEC - International Electrotechnical Commission
• ANSI - American National Standards Institute
• CIE - International Commission on Illumination
• NISO - National Information Standards Organization

A standards review is available at our project
Website.
9
Testing procedure development
Nikon D1
Sinar 54H
10
Goal of research

• Benchmark camera systems and procedures currently
  used for digital archiving by the cultural
  heritage community
• Learn about digital imaging workflows
• Characterize camera systems

11
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

12
Case study camera systems
CS1
CS2
Phase One PowerPhase FX
Lowel Scandles
Leica S1 Pro
TTI Reflective Lighting

• Fluorescent
• 4834K

• Quartz Halogen
• 2980K

CS3
CS4
Broncolor HMI F1200
Speedotron 202VF
Better Light 6000-2
Sinar Sinarback 54H

• HMI
• 5086K

• Xenon Strobe
• 6628K

13
Case study digital imaging set-up
14
CS1 digital imaging set-up
Effective resolution 184ppi File size 101MB
15
CS2 digital imaging set-up
Effective resolution 229ppi File size 189MB
16
CS3 digital imaging set-up
Camera
Painting
Lights
Viewing Lights
Effective resolution 173ppi File size 129MB
17
CS4 digital imaging set-up
6000x8000
Effective resolution 235ppi File size 87MB
4774x6330
18
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

19
Workflow overview
Assign Camera Profile
Convert to Working Space Profile
Visual Editing
Visually Corrected
Digital Master
Raw
20
CS1 workflowLeica S1 ProLowel Scandles
(Fluorescent 4834K)
Digital Master
Camera
ProPhoto
16-bit RGB
21
CS2 workflowPhase One PowerPhase FXTTI (Quartz
Halogen 2980K)
Digital Master
Camera
Camera
Custom
16-bit RGB
16-bit RGB
Visually Corrected
16-bit RGB
22
CS3 workflowSinar Sinarback 54HSpeedtron 202VF
(Xenon Strobe 6628K)
Digital Master
Shading Reference
Camera
ProPhoto
16-bit RGB
Visually Corrected
8-bit RGB
23
CS4 workflowBetter Light 6000-2Broncolor HMI F
1200 (HMI 5086K)
Digital Master
Visually Corrected
D_A_2.2
8-bit RGB
8-bit RGB
24
Visual editing environments
CS3
CS4
CS2
25
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

26
Paintings description
Gamblin Artists Oil Colors
27
Comparison of paintings
Digital Master Images
Corrected Images
CS4
CS4
CS1
CS2
CS3
CS2
CS3
28
Outline

• Reason for research
• Four case study set-ups
• Four case study workflows
• Case study paintings image description and
  results
• Conclusions

29
Conclusions

• Testing procedure provides objective measures of
  camera system / workflow performance
• Differences found in the case study imaging
  systems point out the need for standardization
• Cultural heritage institutions can store future
  characterization data as metadata with their
  images
• Manufacturers can see where imaging systems need
  improvements for cultural heritage applications

30
Acknowledgements

• Advisor Roy Berns
• Team members Lawrence Taplin, Franziska Frey,
  Mitchell Rosen
• Museums Barbara Bridgers, Chris Gallagher,
  Andrew Gunther, Bob Hashimoto, Katya Kallsen,
  Erik Landsberg, Allen MacIntyre, Juan Trujillo,
  John Wronn
• Industry Peter Burns
• Sponsor The Andrew W. Mellon Foundation
• Equipment Munsell Color Science Laboratory

31
Thank you. epmurphy_at_hotmail.com
www.cis.rit.edu/museumSurvey