Multispectral Filter Arrays: Recent Advances and Practical Implementation

Thanks to some technical progress in interferencefilter design based on different technologies, we can finally successfully implement the concept of multispectral filter array-based sensors. This article provides the relevant state-of-the-art for multispectral imaging systems and presents the characteristics of the elements of our multispectral sensor as a case study. The spectral characteristics are based on two different spatial arrangements that distribute eight different bandpass filters in the visible and near-infrared area of the spectrum. We demonstrate that the system is viable and evaluate its performance through sensor spectral simulation.

[1]  W. Lu,et al.  128 channels of integrated filter array rapidly fabricated by using the combinatorial deposition technique , 2007 .

[2]  Angshul Majumdar,et al.  Single-sensor multi-spectral image demosaicing algorithm using learned interpolation weights , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[3]  Daniel L. Farkas,et al.  Real-time megapixel multispectral bioimaging , 2010, BiOS.

[4]  Jean-Baptiste Thomas,et al.  Background subtraction with multispectral video sequences , 2014 .

[5]  Andy Lambrechts,et al.  A snapshot multispectral imager with integrated tiled filters and optical duplication , 2013, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[6]  Patrick J. Treado,et al.  Imaging Spectrometers for Fluorescence and Raman Microscopy: Acousto-Optic and Liquid Crystal Tunable Filters , 1994 .

[7]  Dingrong Yi,et al.  Novel miniaturized multispectral imaging system for real-time bruise detection , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[8]  T. Aach,et al.  A Color Filter Array Based Multispectral Camera , 2006 .

[9]  Congcong Wang,et al.  A Linear Interpolation Algorithm for Spectral Filter Array Demosaicking , 2014, ICISP.

[10]  E. Hillman,et al.  Ultra-fast multispectral optical imaging of cortical oxygenation, blood flow, and intracellular calcium dynamics. , 2009, Optics express.

[11]  Chieu D. Tran,et al.  Time-Resolved Multispectral Imaging Spectrometer , 2000 .

[13]  Daniel Keren,et al.  Restoring subsampled color images , 1999, Machine Vision and Applications.

[14]  Fengxin Chen,et al.  An evaluation method of a micro-arrayed multispectral filter mosaic , 2013, Other Conferences.

[15]  Jon Yngve Hardeberg,et al.  Spatial arrangement of color filter array for multispectral image acquisition , 2011, Electronic Imaging.

[16]  Wei Lu,et al.  Concept of a high-resolution miniature spectrometer using an integrated filter array. , 2007, Optics letters.

[17]  S Collins,et al.  Narrowband multispectral filter set for visible band. , 2012, Optics express.

[18]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Rabab K. Ward,et al.  A Reconstruction Algorithm for Multi-Spectral Image Demosaicing , 2013 .

[20]  Daniel Tamburrino,et al.  2PFCTM (two pixels, full color): Image sensor demosaicing and characterization , 2010, J. Electronic Imaging.

[21]  Masatoshi Okutomi,et al.  Multispectral demosaicking using adaptive kernel upsampling , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[23]  K Martinez,et al.  High-resolution colorimetric imaging of paintings , 1993, Electronic Imaging.

[24]  Sabine Süsstrunk,et al.  Designing color filter arrays for the joint capture of visible and near-infrared images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[25]  Michael W Kudenov,et al.  White-light Sagnac interferometer for snapshot multispectral imaging. , 2010, Applied optics.

[26]  Lionel R. Baker,et al.  Infrared technology and applications , 1986 .

[27]  Sabine Süsstrunk,et al.  Correlation-based joint acquisition and demosaicing of visible and near-infrared images , 2011, 2011 18th IEEE International Conference on Image Processing.

[28]  Angshul Majumdar,et al.  Multi-spectral demosaicing technique for single-sensor imaging , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[29]  Joseph David Matchett,et al.  Volume holographic beam splitter for hyperspectral imaging applications , 2007, SPIE Optical Engineering + Applications.

[30]  리차드 비. 메릴르 Vertical color filter detector group and array , 2001 .

[31]  K. Shadan,et al.  Available online: , 2012 .

[32]  Wesley E. Snyder,et al.  A generic method for generating multispectral filter arrays , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[33]  Hairong Qi,et al.  Generic MSFA mosaicking and demosaicking for multispectral cameras , 2006, Electronic Imaging.

[34]  Thomas J. Suleski,et al.  Advanced Fabrication Technologies for Micro/Nano Optics and Photonics IV , 2009 .

[35]  Jon Y. Hardeberg,et al.  Median filtering in multispectral filter array demosaicking , 2013, Electronic Imaging.

[36]  Sabine Süsstrunk,et al.  Influence of Spectral Sensitivity Functions on Color Demosaicing , 2003, Color Imaging Conference.

[37]  Jiwu Wang,et al.  Handheld erythema and bruise detector , 2008, SPIE Medical Imaging.

[38]  Masatoshi Okutomi,et al.  Simultaneous capturing of RGB and additional band images using hybrid color filter array , 2014, Electronic Imaging.

[39]  Masatoshi Okutomi,et al.  Optimal spectral sensitivity functions for a single-camera one-shot multispectral imaging system , 2012, 2012 19th IEEE International Conference on Image Processing.

[40]  Young J. Yu,et al.  Vertical silicon nanowire photodetectors: Spectral sensitivity via nanowire radius , 2013, CLEO: 2013.

[41]  Robert Sundberg,et al.  Utility assessment of a multispectral snapshot LWIR imager , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[42]  Angshul Majumdar,et al.  Compressive sensing multi-spectral demosaicing from single sensor architecture , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[43]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[44]  Franck Marzani,et al.  Reconstruction of hyperspectral cutaneous data from an artificial neural network-based multispectral imaging system , 2011, Comput. Medical Imaging Graph..

[45]  Dingrong Yi,et al.  Developing handheld real time multispectral imager to clinically detect erythema in darkly pigmented skin , 2010, BiOS.

[46]  Jun Tanida,et al.  Multispectral imaging using compact compound optics. , 2004, Optics express.

[47]  Jason M. Eichenholz,et al.  Dichroic Filter Array Multispectral Imaging Systems , 2010 .

[48]  Hairong Qi,et al.  The design and evaluation of a generic method for generating mosaicked multispectral filter arrays , 2006, IEEE Transactions on Image Processing.

[49]  Chao Wang,et al.  Real-Time Multispectral Imager for Home-Based Health Care , 2011, IEEE Transactions on Biomedical Engineering.

[50]  Jon Y. Hardeberg,et al.  Filter Selection for Multispectral Color Image Acquisition , 2004, PICS.

[51]  Francisco H. Imai,et al.  Efficient Spectral Imaging based on Imaging Systems with Scene Adaptation Using Tunable Color Pixels , 2011, Color Imaging Conference.

[52]  ウイリアム、オーティン,et al.  Imaging and analysis parameters of a small moving objects such as cells , 2000 .

[53]  Dominique Ginhac,et al.  HDR-ARtiSt: an adaptive real-time smart camera for high dynamic range imaging , 2014, Journal of Real-Time Image Processing.

[54]  Il Kyu Eom,et al.  Wavelet-domain demosaicking using linear estimation of interchannel correlation , 2008 .

[55]  Michael J. DePrenger,et al.  Demosaicking for full motion video 9-band SWIR sensor , 2014, Sensing Technologies + Applications.

[56]  Francisco H. Imai,et al.  Imaging at the National Gallery of Art, Washington D.C. , 2002 .

[57]  Hairong Qi,et al.  A Generic Binary Tree-Based Progressive Demosaicking Method for Multispectral Filter Array , 2006, 2006 International Conference on Image Processing.

[58]  Yusuke Ogura,et al.  Three-Dimensional Information Acquisition Using a Compound Imaging System , 2007 .

[59]  Masahiro Yamaguchi,et al.  Hybrid-resolution multispectral imaging using color filter array. , 2012, Optics express.

[60]  Jon Yngve Hardeberg,et al.  A Study on the Impact of Spectral Characteristics of Filters on Multispectral Image Acquisition , 2013 .

[61]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[62]  Jan P. Allebach,et al.  A subspace matching color filter design methodology for a multispectral imaging system , 2006, IEEE Transactions on Image Processing.

[63]  Hyunsung Park,et al.  Multispectral imaging with vertical silicon nanowires , 2013, Scientific Reports.

[64]  Jason M. Eichenholz,et al.  Ultracompact fully integrated megapixel multispectral imager , 2009, OPTO.

[65]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[66]  Masatoshi Okutomi,et al.  Multispectral demosaicking using guided filter , 2012, Electronic Imaging.

[67]  Neelam Gupta,et al.  A miniature snapshot multispectral imager , 2010, Defense + Commercial Sensing.

[68]  Wesley E. Snyder,et al.  Mosaic multispectral focal plane array cameras , 2004, SPIE Defense + Commercial Sensing.

[69]  Dingrong Yi,et al.  Fabrication of multispectral imaging technology driven MEMS-based micro-arrayed multichannel optical filter mosaic , 2011, MOEMS-MEMS.

[70]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[71]  Steffen B. Petersen,et al.  Imaging, Manipulation, and Analysis of Biomolecules, Cells, and Tissues , 2013 .

[72]  Javier Hernández-Andrés,et al.  Combining transverse field detectors and color filter arrays to improve multispectral imaging systems. , 2014, Applied optics.

[73]  H Haneishi,et al.  System design for accurately estimating the spectral reflectance of art paintings. , 2000, Applied optics.

[74]  Keiichiro Kagawa,et al.  An Active Intraoral Shape Measurement Scheme Using a Compact Compound-Eye Camera with Integrated Pattern Projectors , 2009 .

[75]  Yassine Ruichek,et al.  Energy balance in single exposure multispectral sensors , 2013, 2013 Colour and Visual Computing Symposium (CVCS).

[76]  Chao Wang,et al.  A Hand-held Mosaicked Multispectral Imaging Device for Early Stage Pressure Ulcer Detection , 2011, Journal of Medical Systems.

[77]  Stephane Nicolas,et al.  Compact camera for multispectral and conventional imaging based on patterned filters. , 2014, Applied optics.

[78]  Michael W Kudenov,et al.  White light Sagnac interferometer for snapshot linear polarimetric imaging. , 2009, Optics express.

[79]  Judy Pearsall,et al.  Oxford Dictionary of English , 2010 .

[80]  高培良 An acousto-optic tunable filter , 2009 .

[81]  Andy Lambrechts,et al.  A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[82]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[83]  Alistair Gorman,et al.  Generalization of the Lyot filter and its application to snapshot spectral imaging. , 2010, Optics express.

[84]  Kang L. Wang,et al.  Infrared multispectral detection using Si/SixGe1−x quantum well infrared photodetectors , 2001 .

[85]  Antonio Ortega,et al.  Quality metric for filter arrangement in a multispectral filter array , 2013, 2013 Picture Coding Symposium (PCS).

[86]  Shuxue Quan,et al.  Digital camera filter design for colorimetric and spectral accuracy , 2001 .