Synthetic Aperture Imaging Beyond Foreground Using Image Matting

Synthetic aperture imaging is widely applied to reconstruct the occluded objects. Unfortunately, due to the superimposition of foreground rays, blurriness occurs in reconstructed images, which leads to an undesirable quality of reconstruction result. Screening effective rays before synthetic aperture imaging become the key to improve the quality of reconstructed image. In this paper, we propose a method to remove interference from occlusion in synthetic aperture imaging by using image matting. By focusing on the occlusion plane, the focusing degree of synthetic aperture imaging result can roughly label occlusions and non-occlusions. These labels can serve as the scribbles of input image of image matting, which can distinguish occlusions and backgrounds more precisely. After that, the focusing at the desired depth is by averaging pixels without occlusions. The experimental results show that our method can effectively remove the blur in the reconstruction results. We demonstrate the superiority of our method by presenting experimental results as well as comparing our method with other’s methods.

[1]  Yanning Zhang,et al.  Unstructured Synthetic Aperture Photograph Based Occluded Object Imaging , 2013, 2013 Seventh International Conference on Image and Graphics.

[2]  Yee-Hong Yang,et al.  All-In-Focus Synthetic Aperture Imaging Using Image Matting , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Rui Yu,et al.  Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion , 2015, Sensors.

[4]  Yanning Zhang,et al.  Synthetic aperture imaging using pixel labeling via energy minimization , 2013, Pattern Recognit..

[5]  Rui Yu,et al.  Continuously tracking and see-through occlusion based on a new hybrid synthetic aperture imaging model , 2011, CVPR 2011.

[6]  Rui Yu,et al.  A New Hybrid Synthetic Aperture Imaging Model for Tracking and Seeing People Through Occlusion , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  潘晋孝 Pan Jinxiao,et al.  Synthetic Aperture Imaging Algorithm Via Foreground Removing , 2018 .

[8]  Qian Wang,et al.  Enhanced reconstruction of partially occluded objects with occlusion removal in synthetic aperture integral imaging , 2011 .

[9]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  David J. Kriegman,et al.  Synthetic Aperture Tracking: Tracking through Occlusions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Marc Levoy,et al.  Using plane + parallax for calibrating dense camera arrays , 2004, CVPR 2004.

[12]  Xiuwei Zhang,et al.  A novel multi-object detection method in complex scene using synthetic aperture imaging , 2012, Pattern Recognit..

[13]  Marc Levoy,et al.  Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Philippe Robert,et al.  Hand-held 3D light field photography and applications , 2014, The Visual Computer.

[15]  Marc Levoy,et al.  High-speed videography using a dense camera array , 2004, CVPR 2004.

[16]  Yanning Zhang,et al.  Kinect based real-time synthetic aperture imaging through occlusion , 2015, Multimedia Tools and Applications.

[17]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[18]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[19]  Yanning Zhang,et al.  Synthetic aperture photography using a moving camera-IMU system , 2017, Pattern Recognit..