Morphology-based disparity estimation and rendering algorithm for light field images

A light field camera can retrieve the depth information and reconstruct a stereoscopic image. The quality of light field image processing is highly dependent on whether the disparity of two adjacent micro images can be determined accurately. In this paper, we apply an algorithm based on dilating image segments to determine disparity precisely. With the dilation operation, the edge and corner information, which are important features for template matching, can be well preserved for each segment. Moreover, we also apply the techniques of superpixel-based object extraction and intensity compensation to further improve the performance. Simulations show that, with the proposed algorithm, a more accurate depth map and a rendering image with higher quality can be achieved.

[1]  Jian-Jiun Ding,et al.  Multilayer image disparity estimation and blending for light field cameras , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[2]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jian-Jiun Ding,et al.  Adaptive preprocessing and combination techniques for light field image rendering , 2015, 2015 IEEE International Conference on Consumer Electronics - Taiwan.

[4]  Sven Wanner,et al.  Variational Light Field Analysis for Disparity Estimation and Super-Resolution , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  A. Lumsdaine,et al.  Focused Plenoptic Camera and Rendering Focused Plenoptic Camera and Rendering , 2010 .