Stereo one-shot six-band camera system for accurate color reproduction

Abstract. For accurate color reproduction of motion pictures or still pictures of moving objects, we developed a different one-shot six-band image-capturing and visualization system that combines multiband and stereo imaging techniques. The proposed system consists of two consumer-model digital cameras and an interference filter whose spectral transmittance is comb-shaped. Subpixel correspondence search between the stereo image pairs is conducted and image transformation whose parameters are estimated from the correspondence is used to correct the geometric relationship between the images. The Wiener estimation method is used for color reproduction. For experiments, we have constructed two six-band camera systems to evaluate the quality of resultant images. One is for capturing high-resolution images using digital single-lens reflex cameras. The other is for capturing motion pictures using digital video cameras, for which all image processing steps after image capture are implemented on graphics processing units and the frame rate of the system is 30 fps when image size is XGA. For both systems, the average color difference between the measurement data and estimation results for 24 color patches of the Macbeth ColorChecker™ is dEa*b*=1.21 at maximum.

[1]  Stephan Helling,et al.  Algorithms for spectral color stimulus reconstruction with a seven-channel multispectral camera , 2004, CGIV.

[2]  Masatoshi Okutomi,et al.  Sub-Pixel Estimation Error Cancellation on Area-Based Matching , 2005, International Journal of Computer Vision.

[3]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .

[5]  Jon Y. Hardeberg,et al.  One-shot multispectral color imaging with a stereo camera , 2011, Electronic Imaging.

[6]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Peter D. Burns,et al.  Analysis Multispectral Image Capture , 1996, CIC.

[8]  Masahiro Yamaguchi,et al.  Natural color reproduction in the television system for telemedicime , 1997, Medical Imaging.

[9]  Jon Y. Hardeberg,et al.  Simultaneous Multispectral Imaging and Illuminant Estimation Using a Stereo Camera , 2012, ICISP.

[10]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Koichi Ito,et al.  GPU implementation of phase-based stereo correspondence and its application , 2012, 2012 19th IEEE International Conference on Image Processing.

[12]  Junko Kishimoto,et al.  Two-Shot type 6-band still image capturing system using Commercial Digital Camera and Custom Color Filter , 2008, CGIV/MCS.

[13]  Shoji Tominaga,et al.  Object recognition by multi-spectral imaging with a liquid crystal filter , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  W K Pratt,et al.  Spectral estimation techniques for the spectral calibration of a color image scanner. , 1976, Applied optics.

[15]  Hiroshi Nakajima,et al.  A Sub-Pixel Stereo Correspondence Technique Based on 1D Phase-only Correlation , 2007, 2007 IEEE International Conference on Image Processing.

[16]  Shoji Tominaga,et al.  MULTICHANNEL VISION SYSTEM FOR ESTIMATING SURFACE AND ILLUMINATION FUNCTIONS , 1996 .

[17]  Hideaki Haneishi,et al.  Six Band HDTV Camera System for Spectrum-Based Color Reproduction , 2004, Journal of Imaging Science and Technology.

[18]  Jon Y. Hardeberg,et al.  Multispectral imaging using a stereo camera: concept, design and assessment , 2011, EURASIP J. Adv. Signal Process..