Design of four-band multispectral imaging system with one single-sensor

Abstract In order to acquire multispectral images precisely and quickly, a four-band multispectral capturing system with one imaging sensor is designed and evaluated in this paper. Firstly, four imaging bands are arranged in a 2 × 2 multispectral filter array (MSFA), and their filter spectral transmittances within the visual wavelength are designed uniformly. Then, the mosaicked four-band image is generated on the single-sensor according to the designed MSFA. In order to recover the mosaicked images, a demosaicking algorithm based on constant hue assumption is employed to highly maintain the image edges. At last, the four-band spectral capturing system is characterized by using the calibration target Macbeth ColorChecker, and a linear relationship between the band values and spectrum are calculated based on polynomial regression method, afterwards the demosaicked four-band pixels can be converted into the multispectral reflectance with that obtained relationship. In the experiment, the four-band multispectral imaging system with the proposed demosaicking algorithm is evaluated, and the experiment result demonstrates the proposed algorithm outperform the other methods in PSNR and RRMS.

[1]  Xiao-fen Jia,et al.  An edge-adaptive demosaicking method based on image correlation , 2015 .

[2]  Jr. James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras , 1997, Electronic Imaging.

[3]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[4]  R. Paramesran,et al.  Correlation between subjective and objective assessment of magnetic resonance (MR) images. , 2016, Magnetic resonance imaging.

[5]  Angshul Majumdar,et al.  Single-sensor multi-spectral image demosaicing algorithm using learned interpolation weights , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[6]  Ling Shao,et al.  Image demosaicing using content and colour-correlation analysis , 2014, Signal Process..

[7]  Bangyong Sun,et al.  Modified Spectral Neugebauer Model for Printer Characterization , 2015 .

[8]  Li Chen,et al.  Subband Synthesis for Color Filter Array Demosaicking , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  Antoni Buades,et al.  Self-Similarity and Spectral Correlation Adaptive Algorithm for Color Demosaicking , 2014, IEEE Transactions on Image Processing.

[10]  Jon Yngve Hardeberg,et al.  Multispectral imaging: narrow or wide band filters? , 2014 .

[11]  Gwanggil Jeon,et al.  Colour interpolation using adaptive window for Bayer colour filter array , 2014 .

[12]  Yonghoon Kim,et al.  Four-Direction Residual Interpolation for Demosaicking , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Bangyong Sun,et al.  Evaluating the Performance of Polynomial Regression Method with Different Parameters during Color Characterization , 2014 .

[14]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[15]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[16]  Hairong Qi,et al.  The design and evaluation of a generic method for generating mosaicked multispectral filter arrays , 2006, IEEE Transactions on Image Processing.

[17]  Hen-Wai Tsao,et al.  Color Filter Array Demosaicking by Using Subband Synthesis Scheme , 2015, IEEE Sensors Journal.

[18]  Paul Scheunders,et al.  Wavelet-based color filter array demosaicking , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[19]  Javier Hernández-Andrés,et al.  Combining transverse field detectors and color filter arrays to improve multispectral imaging systems. , 2014, Applied optics.

[20]  Il Kyu Eom,et al.  Wavelet-domain demosaicking using linear estimation of interchannel correlation , 2008 .

[21]  Giancarlo Calvagno,et al.  Color image demosaicking: An overview , 2011, Signal Process. Image Commun..

[23]  Jon Y. Hardeberg,et al.  Median filtering in multispectral filter array demosaicking , 2013, Electronic Imaging.

[24]  Masatoshi Okutomi,et al.  A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor , 2015, IEEE Transactions on Image Processing.

[25]  Sabine Süsstrunk,et al.  Color Demosaicing by Estimating Luminance and Opponent Chromatic Signals in the Fourier Domain , 2002, CIC.

[26]  Giancarlo Calvagno,et al.  Demosaicing With Directional Filtering and a posteriori Decision , 2007, IEEE Transactions on Image Processing.

[27]  Il Kyu Eom,et al.  Edge adaptive demosaicking in wavelet domain , 2008, 2008 9th International Conference on Signal Processing.

[28]  Yap-Peng Tan,et al.  Improved color filter array demosaicking by accurate luminance estimation , 2005, IEEE International Conference on Image Processing 2005.

[29]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[30]  Gwanggil Jeon,et al.  Local adaptive directional color filter array interpolation based on inter-channel correlation , 2014 .

[31]  Moon Gi Kang,et al.  Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors , 2016, J. Electronic Imaging.

[32]  T. Sree Sharmila,et al.  Novel Color filter array demosaicing in frequency Domain with Spatial Refinement , 2014, J. Comput. Sci..

[33]  K.A. Parulski.  Color filters and processing alternatives for one-chip cameras , 1985, IEEE Transactions on Electron Devices.