N-LMMSE Demosaicing for Spectral Filter Arrays

Spectral filter array (SFA) technology requires development on demosaicing. The authors extend the linear minimum mean square error with neighborhood method to the spectral dimension. They demonstrate that the method is fast and general on Raw SFA images that span the visible and near infra-red part of the electromagnetic range. The method is quantitatively evaluated in simulation first, then the authors evaluate it on real data by the use of non-reference image quality metrics applied on each band. Resulting images show a much better reconstruction of text and high frequencies at the expense of a zipping effect, compared to the benchmark binary-tree method.

[1]  Jon Yngve Hardeberg,et al.  Multispectral imaging: narrow or wide band filters? , 2014 .

[2]  Torbjørn Skauli,et al.  A collection of hyperspectral images for imaging systems research , 2013, Electronic Imaging.

[3]  Michael J. DePrenger,et al.  Demosaicking for full motion video 9-band SWIR sensor , 2014, Sensing Technologies + Applications.

[4]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[5]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[6]  Manu Parmar,et al.  Selection of Optimal Spectral Sensitivity Functions for Color Filter Arrays , 2006, IEEE Transactions on Image Processing.

[7]  H. Joel Trussell,et al.  Mathematics for demosaicking , 2002, IEEE Trans. Image Process..

[8]  Wesley E. Snyder,et al.  Demosaicking methods for Bayer color arrays , 2002, J. Electronic Imaging.

[9]  Giancarlo Calvagno,et al.  Color image demosaicking: An overview , 2011, Signal Process. Image Commun..

[10]  Lu Fang,et al.  Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation , 2017, IEEE Transactions on Image Processing.

[11]  David Alleysson,et al.  Random Color Filter Arrays are Better than Regular Ones , 2016 .

[12]  Hairong Qi,et al.  The design and evaluation of a generic method for generating mosaicked multispectral filter arrays , 2006, IEEE Transactions on Image Processing.

[13]  Moon Gi Kang,et al.  Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors , 2016, J. Electronic Imaging.

[14]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[15]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[16]  Masatoshi Okutomi,et al.  Simultaneous capturing of RGB and additional band images using hybrid color filter array , 2014, Electronic Imaging.

[17]  L. Macaire,et al.  Comparison of color demosaicing methods , 2010 .

[18]  Raimondo Schettini,et al.  A no-reference metric for demosaicing artifacts that fits psycho-visual experiments , 2012, EURASIP Journal on Advances in Signal Processing.

[19]  Masatoshi Okutomi,et al.  A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor , 2015, IEEE Transactions on Image Processing.

[20]  Martin Vetterli,et al.  Optimal color filter array design: quantitative conditions and an efficient search procedure , 2009, Electronic Imaging.

[21]  Wesley E. Snyder,et al.  Mosaic multispectral focal plane array cameras , 2004, SPIE Defense + Commercial Sensing.

[22]  Shigeo Kato,et al.  Demosaicking for multispectral images based on vectorial total variation , 2016 .

[23]  David S. Taubman Generalized Wiener reconstruction of images from colour sensor data using a scale invariant prior , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  Yuri Hercilia Mejía-Melgarejo,et al.  Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors , 2015 .

[26]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[27]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[28]  Yassine Ruichek,et al.  Energy balance in Spectral Filter Array camera design , 2017, Journal of the European Optical Society-Rapid Publications.

[29]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[30]  Masahiro Yamaguchi,et al.  Hybrid-resolution multispectral imaging using color filter array. , 2012, Optics express.

[31]  Hairong Qi,et al.  Generic MSFA mosaicking and demosaicking for multispectral cameras , 2006, Electronic Imaging.

[32]  Jon Y. Hardeberg,et al.  Median filtering in multispectral filter array demosaicking , 2013, Electronic Imaging.

[33]  Sabine Süsstrunk,et al.  Demultiplexing Visible and Near-Infrared Information in Single- Sensor Multispectral Imaging , 2016 .