Demosaicing of Real Low Lighting Images using CFA 3.0

In CFA 2.0, there are white pixels in a color filter array (CFA) that has proven to help the demosaicing performance for images collected in low light conditions. Here, we evaluate the performance of demosaicing for images collected in low light conditions using an RGBW pattern with 75% white pixels. We term this CFA the CFA 3.0. Using a data set containing 10 images collected in low light conditions, we performed extensive experiments. Both objective and subjective evaluations were used in our experiments.

[1]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[2]  William T. Freeman,et al.  Rethinking color cameras , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[3]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Chiman Kwan,et al.  Enhancing Mastcam Images for Mars Rover Mission , 2017, ISNN.

[6]  Chiman Kwan,et al.  Fusion of themis and TES for accurate Mars surface characterization , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[7]  Chiman Kwan,et al.  Hyperspectral image super-resolution: a hybrid color mapping approach , 2016 .

[8]  Chiman Kwan,et al.  Pansharpening of Mastcam images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[9]  Chiman Kwan,et al.  Resolution enhancement for hyperspectral images: A super-resolution and fusion approach , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[12]  Yuzhong Shen,et al.  Assessment of Spatiotemporal Fusion Algorithms for Planet and Worldview Images , 2018, Sensors.

[13]  정창영,et al.  Fabricating method of cmos image sensor with improved light sensitivity , 2003 .

[14]  Chiman Kwan,et al.  Demosaicing enhancement using pixel-level fusion , 2018, Signal Image Video Process..

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[17]  Chiman Kwan,et al.  Debayering RGBW color filter arrays: A pansharpening approach , 2017, 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON).

[18]  Chiman Kwan,et al.  A Novel Utilization of Image Registration Techniques to Process Mastcam Images in Mars Rover With Applications to Image Fusion, Pixel Clustering, and Anomaly Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Chiman Kwan,et al.  Demosaicing images in low lighting environments , 2020, Defense + Commercial Sensing.

[21]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[22]  J. Astola,et al.  ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS , 2007 .

[23]  Chiman Kwan.  Demosaicing Mastcam Images using A New Color Filter Array , 2020 .

[24]  Lei Zhang,et al.  Color demosaicking by local directional interpolation and nonlocal adaptive thresholding , 2011, J. Electronic Imaging.

[25]  Frédo Durand,et al.  Deep joint demosaicking and denoising , 2016, ACM Trans. Graph..

[26]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  J. Bednar,et al.  Alpha-trimmed means and their relationship to median filters , 1984 .

[28]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Suk Ho Lee,et al.  Colorization-Based RGB-White Color Interpolation using Color Filter Array with Randomly Sampled Pattern , 2017, Sensors.

[30]  Chiman Kwan,et al.  Demosaicing of CFA 3.0 with Applications to Low Lighting Images , 2020, Sensors.

[31]  Chiman Kwan,et al.  Perceptually Lossless Image Compression with Error Recovery , 2018, ICVISP.

[32]  W. Marsden.  I and J , 2012 .

[33]  Chiman Kwan,et al.  Further Improvement of Debayering Performance of RGBW Color Filter Arrays Using Deep Learning and Pansharpening Techniques , 2019, J. Imaging.

[34]  Chiman Kwan,et al.  Demosaicing of Bayer and CFA 2.0 Patterns for Low Lighting Images , 2019, Electronics.

[35]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Feng Gao,et al.  A Hybrid Color Mapping Approach to Fusing MODIS and Landsat Images for Forward Prediction , 2018, Remote. Sens..