Enhancement of low light level images using color-plus-mono dual camera.

In digital photography, the improvement of imaging quality in low light shooting is one of the users' needs. Unfortunately, conventional smartphone cameras that use a single, small image sensor cannot provide satisfactory quality in low light level images. A color-plus-mono dual camera that consists of two horizontally separate image sensors, which simultaneously captures both a color and mono image pair of the same scene, could be useful for improving the quality of low light level images. However, an incorrect image fusion between the color and mono image pair could also have negative effects, such as the introduction of severe visual artifacts in the fused images. This paper proposes a selective image fusion technique that applies an adaptive guided filter-based denoising and selective detail transfer to only those pixels deemed reliable with respect to binocular image fusion. We employ a dissimilarity measure and binocular just-noticeable-difference (BJND) analysis to identify unreliable pixels that are likely to cause visual artifacts during image fusion via joint color image denoising and detail transfer from the mono image. By constructing an experimental system of color-plus-mono camera, we demonstrate that the BJND-aware denoising and selective detail transfer is helpful in improving the image quality during low light shooting.

[1]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[2]  Ming Dai,et al.  Multifocus color image fusion based on quaternion curvelet transform. , 2012, Optics express.

[3]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[4]  Yong Man Ro,et al.  Visual Importance- and Discomfort Region-Selective Low-Pass Filtering for Reducing Visual Discomfort in Stereoscopic Displays , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Yong Man Ro,et al.  Crosstalk reduction in stereoscopic 3D displays: disparity adjustment using crosstalk visibility index for crosstalk cancellation. , 2014, Optics express.

[7]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[9]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[10]  Jinbo Li,et al.  Regional multifocus image fusion using sparse representation. , 2013, Optics express.

[11]  Cewu Lu,et al.  Contrast Preserving Decolorization with Perception-Based Quality Metrics , 2014, International Journal of Computer Vision.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Xin Liu,et al.  A novel similarity based quality metric for image fusion , 2008, Inf. Fusion.

[14]  Aljoscha Smolic,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[15]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[16]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[17]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[18]  Alexander Toet,et al.  Natural colour mapping for multiband nightvision imagery , 2003, Inf. Fusion.

[19]  Yong Man Ro,et al.  Critical Binocular Asymmetry Measure for the Perceptual Quality Assessment of Synthesized Stereo 3D Images in View Synthesis , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[21]  Yong Man Ro,et al.  Visual discomfort visualizer using stereo vision and time-of-flight depth cameras , 2012, IEEE Transactions on Consumer Electronics.

[22]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[23]  Xiangzhi Bai,et al.  Fusion of infrared and visual images through region extraction by using multi scale center-surround top-hat transform. , 2011, Optics express.

[24]  Yong Man Ro,et al.  Visual Comfort Amelioration Technique for Stereoscopic Images: Disparity Remapping to Mitigate Global and Local Discomfort Causes , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Sung-Jea Ko,et al.  Sharpness Enhancement of Stereo Images Using Binocular Just-Noticeable Difference , 2012, IEEE Transactions on Image Processing.