Multispectral Demosaicing Using Pseudo-Panchromatic Image

Single-sensor color cameras, which classically use a color filter array to sample RGB channels, have recently been extended to the multispectral domain. To sample more than three wavelength bands, such systems use a multispectral filter array that provides a raw image in which a single channel value is available at each pixel. A demosaicing procedure is then needed to estimate a fully defined multispectral image. In this paper, we review multispectral demosaicing methods and propose a new one based on the pseudo-panchromatic image (PPI). Pixel values in the PPI are computed as the average spectral values. Experimental results show that our method provides estimated images of better quality than classical ones.

[1]  Roy S. Berns,et al.  Multi-spectral Imaging of a van Gogh's Self-portrait at the National Gallery of Art Washington DC , 2001, PICS.

[2]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Toshio Uchiyama,et al.  Development of a 16-band multispectral image archiving system , 2005, IS&T/SPIE Electronic Imaging.

[4]  Yap-Peng Tan,et al.  Hybrid color filter array demosaicking for effective artifact suppression , 2006, J. Electronic Imaging.

[5]  T. Aach,et al.  A Color Filter Array Based Multispectral Camera , 2006 .

[6]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[7]  Manu Parmar,et al.  Selection of Optimal Spectral Sensitivity Functions for Color Filter Arrays , 2006, IEEE Transactions on Image Processing.

[8]  Lei Zhang,et al.  Image demosaicing: a systematic survey , 2008, Electronic Imaging.

[9]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[10]  Elli Angelopoulou,et al.  Gerbil - A Novel Software Framework for Visualization and Analysis in the Multispectral Domain , 2010, VMV.

[11]  Masatoshi Okutomi,et al.  Multispectral demosaicking using adaptive kernel upsampling , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Masatoshi Okutomi,et al.  Multispectral demosaicking using guided filter , 2012, Electronic Imaging.

[13]  Masatoshi Okutomi,et al.  Optimal spectral sensitivity functions for a single-camera one-shot multispectral imaging system , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Torbjørn Skauli,et al.  A collection of hyperspectral images for imaging systems research , 2013, Electronic Imaging.

[15]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[16]  Jon Y. Hardeberg,et al.  Discrete wavelet transform based multispectral filter array demosaicking , 2013, 2013 Colour and Visual Computing Symposium (CVCS).

[17]  Jon Y. Hardeberg,et al.  Median filtering in multispectral filter array demosaicking , 2013, Electronic Imaging.

[18]  Renfu Lu,et al.  Hyperspectral and multispectral imaging for evaluating food safety and quality , 2013 .

[19]  Andy Lambrechts,et al.  A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[20]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[21]  Masatoshi Okutomi,et al.  Multispectral demosaicking with novel guide image generation and residual interpolation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[22]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[23]  Shigeo Kato,et al.  Multispectral demosaicking algorithm based on inter-channel correlation , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[24]  Salvatore Stramondo,et al.  Scale Object Selection (SOS) through a hierarchical segmentation by a multi-spectral per-pixel classification , 2014, Pattern Recognit. Lett..

[25]  Masahiro Ishikawa,et al.  Multispectral filter array and demosaicking for pathological images , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[26]  Ludovic Macaire,et al.  Multispectral demosaicing using intensity-based spectral correlation , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[27]  Jie Jia,et al.  Fourier Spectral Filter Array for Optimal Multispectral Imaging , 2016, IEEE Transactions on Image Processing.

[28]  Dang Khoa Nguyen,et al.  Intraoperative video-rate hemodynamic response assessment in human cortex using snapshot hyperspectral optical imaging , 2016, Neurophotonics.

[29]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[30]  Masatoshi Okutomi,et al.  Beyond Color Difference: Residual Interpolation for Color Image Demosaicking , 2016, IEEE Transactions on Image Processing.

[31]  Lu Fang,et al.  Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation , 2017, IEEE Transactions on Image Processing.