ISET Suggested Class Projects

1
ISETSuggested Class Projects

• For more information or ideas
• contact
• joyce_farrell_at_stanford.edu
• pcatryss_at_stanford.edu

2
Scene

• High-dynamic range, multi-spectral, 3D image
  database
• Use exposure-bracketing, narrow-band filters and
  manual focus to capture high-dynamic range,
  multi-spectral images with different focal
  settings
• Reference
• High Dynamic Range Spectral (HDRS) Image Database
  (http//www.imageval.com/Papers/HDRS.pdf)
• Multi-focused imaging
• Create a single multi-focused image from many
  different focused images from the image database
• Reference
• H. Eltoukhy and S. Kavusi, A Computationally
  Efficient Algorithm for Multi-Focus Image
  Reconstruction, Proceedings of SPIE, Vol. 5017,
  pp. 332 (2003)

3
Optics

• Modulation Transfer Function (MTF)
• Implement and compare different methods for
  calculating/measuring the MTF of an imaging lens
• Reference
• Backmann et al., Random target method for fast
  MTF inspection, Optics Express, vol. 12, no. 12,
  pp. 2610 (2004)
• MTF with defocus
• Implement and evaluate the MTF for a defocusing
  error
• Reference
• C. S. Williams, O.A. Becklund, Introduction to
  the Optical Transfer Function, (1989)

4
Optics

• Removal of optical distortions using software
• Create optical distortions using ISET
  (vignetting, barrel distortion)
• Design processor algorithms to remove distortions
• Compare results to http//www.dxo.com/en/corporate
  /home/default.php

5
Sensor

• Exposure control for digital still cameras
• Implement and evaluate different auto-exposure
  algorithms
• References
• Kuno, T., A new automatic exposure system for
  digital still cameras, IEEE Transactions on
  Consumer Electronics, Vol. 44, No. 1, pp. 192-199
  (1998)
• Shimizu, S., A new algorithm for exposure
  control based on fuzzy logic for video cameras,
  IEEE Transactions on Consumer Electronics, Vol.
  38, No. 3, pp. 617-623 (1992).
• US Patents (http//ise.stanford.edu/class/psych221
  /ee362/ProjectWebsite2005/Digital_Cameras.htmExpo
  sureControl)

6
Sensor

• Sensor noise removal
• Investigate different methods for noise removal
  (e.g., correlated double sampling)
• Show the effect on noise visibility when using
  CDS
• Reference
• A. Fowler et al., "Noise Reduction Strategy for
  Hybrid IR Focal Plane Arrays," Proceedings of
  SPIE, vol. 1541, pp. 127-133, 1991.

7
Sensor

• Pixel optics
• Explore the relationship between imaging and
  pixel optics
• Analyze the efficiency of the pixel optics to
  relay photons as pixel size keeps shrinking
• References
• P. B. Catrysse and B. A. Wandell, Optical
  efficiency of image sensor pixels, Journal of
  the Optical Society of America A, Vol. 19, pp.
  1610-1620 (2002)
• P. B. Catrysse and B. A. Wandell, Roadmap for
  CMOS image sensors Moore meets Planck and
  Sommerfeld, Proceedings of the SPIE, Vol. 5678,
  pp.1 (2005)

8
Processor

• Demosaicing (color interpolation)
• Implement different algorithms
• Evaluate using different test images and
  different color filter arrays
• References
• http//ise.stanford.edu/class/psych221/ee362/Proje
  ctWebsite2005/Digital_Cameras.htmDemosaicing
• Search patent literature and recent conference
  papers (e.g., Electronic Imaging)

9
Processor

• Color balancing
• Implement and evaluate different algorithms for
  color conversion and color balancing
• References
• http//ise.stanford.edu/class/psych221/ee362/Proje
  ctWebsite2005/Digital_Cameras.htmColorBalancing
• Search patent literature, recent conferences

10
Metrics

• Each suggestion below is a different project
• Implement and evaluate optics-based metrics
• MTF
• ISO standards
• www.imatest.com
• Implement and evaluate sensor-based metrics
• MTF
• ISO Standards
• Review, Implement and evaluate different
  image-based quality metrics
• SCIELAB
• Visually-weighted difference (Mannos and
  Sakrison)
• Visible difference predictor (Daly)
• Cortex transform (Watson)
• Perceptual image fidelity (Teo and Heeger)
• Sarnoff model (Lubin)
• Structural similarity index (download Matlab
  code http//www.cns.nyu.edu/zwang/files/research
  /ssim/