Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

A division-of-focal-plane or microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array (MPFA or CPFA), the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. In this paper, we propose a novel MPFA demosaicking method based on edge-aware residual interpolation (EARI) and also extend it to CPFA demosaicking. The key of EARI is a new edge detector for generating an effective guide image used to interpolate the missing pixel values. We also present a newly constructed full color-polarization image dataset captured using a 3-CCD camera and a rotating polarizer. Using the dataset, we experimentally demonstrate that our EARI-based method outperforms existing methods in MPFA and CPFA demosaicking.

[1]  Wolfgang Heidrich,et al.  Polarization Demosaicking for Monochrome and Color Polarization Focal Plane Arrays , 2019, VMV.

[2]  Pierre-Jean Lapray,et al.  Database of polarimetric and multispectral images in the visible and NIR regions , 2018, Photonics Europe.

[3]  Jan Kautz,et al.  Polarimetric Multi-view Stereo , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Masatoshi Okutomi,et al.  Residual interpolation for color image demosaicking , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Pierre-Jean Lapray,et al.  Survey of Demosaicking Methods for Polarization Filter Array Images , 2018, Sensors.

[6]  Masatoshi Okutomi,et al.  Adaptive residual interpolation for color image demosaicking , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[7]  J Scott Tyo,et al.  Review of passive imaging polarimetry for remote sensing applications. , 2006, Applied optics.

[8]  Junchao Zhang,et al.  Learning a convolutional demosaicing network for microgrid polarimeter imagery. , 2018, Optics letters.

[9]  Yinqiang Zheng,et al.  Convolutional demosaicing network for joint chromatic and polarimetric imagery. , 2019, Optics letters.

[10]  E. Collett.  Field Guide to Polarization , 2005 .

[11]  Bin Hui,et al.  Image interpolation for division of focal plane polarimeters with intensity correlation. , 2016, Optics express.

[12]  Ludovic Macaire,et al.  Multispectral Demosaicing Using Pseudo-Panchromatic Image , 2017, IEEE Transactions on Computational Imaging.

[13]  Yonghoon Kim,et al.  Four-Direction Residual Interpolation for Demosaicking , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Viktor Gruev,et al.  Bilinear and bicubic interpolation methods for division of focal plane polarimeters. , 2011, Optics express.

[15]  Wei Ye,et al.  Color Image Demosaicing Using Iterative Residual Interpolation , 2015, IEEE Transactions on Image Processing.

[16]  Amine Bermak,et al.  Residual interpolation for division of focal plane polarization image sensors. , 2017, Optics express.

[17]  Viktor Gruev,et al.  Gradient-based interpolation method for division-of-focal-plane polarimeters. , 2013, Optics express.

[18]  Masatoshi Okutomi,et al.  Adaptive Residual Interpolation for Color and Multispectral Image Demosaicking † , 2017, Sensors.

[19]  Jan Kautz,et al.  Separating Reflection and Transmission Images in the Wild , 2017, ECCV.

[20]  Ning Li,et al.  Demosaicking DoFP images using Newton's polynomial interpolation and polarization difference model. , 2019, Optics express.

[21]  Adam Scholefield,et al.  Embedded polarizing filters to separate diffuse and specular reflection , 2018, ACCV.

[22]  Zheng Chang,et al.  Sparse representation-based demosaicing method for microgrid polarimeter imagery. , 2018, Optics letters.

[23]  Masatoshi Okutomi,et al.  Beyond Color Difference: Residual Interpolation for Color Image Demosaicking , 2016, IEEE Transactions on Image Processing.

[24]  J Scott Tyo,et al.  Interpolation strategies for reducing IFOV artifacts in microgrid polarimeter imagery. , 2009, Optics express.

[25]  Desheng Wen,et al.  Minimized Laplacian residual interpolation for DoFP polarization image demosaicking. , 2019, Applied optics.

[26]  Yusuke Oike,et al.  3.2-MP Back-Illuminated Polarization Image Sensor With Four-Directional Air-Gap Wire Grid and 2.5- $\mu$ m Pixels , 2018, IEEE Transactions on Electron Devices.

[27]  Amine Bermak,et al.  Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters With Different Micro-Polarizer Patterns , 2018, IEEE Sensors Journal.

[28]  Xinhao Liu,et al.  Practical Signal-Dependent Noise Parameter Estimation From a Single Noisy Image , 2014, IEEE Transactions on Image Processing.