Multiple candidates and multiple constraints based accurate depth estimation for multi-view stereo

In this paper, we propose a depth estimation method for multi-view image sequence. To enhance the accuracy of dense matching and reduce the inaccurate matching which is produced by inaccurate feature description, we select multiple matching points to build candidate matching sets. Then we compute an optimal depth from a candidate matching set which satisfies multiple constraints (epipolar constraint, similarity constraint and depth consistency constraint). To further increase the accuracy of depth estimation, depth consistency constraint of neighbor pixels is used to filter the inaccurate matching. On this basis, in order to get more complete depth map, depth diffusion is performed by neighbor pixels’ depth consistency constraint. Through experiments on the benchmark datasets for multiple view stereo, we demonstrate the superiority of proposed method over the state-of-the-art method in terms of accuracy.

[1]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Chengke Wu,et al.  Dense Stereo Matching Based On Propagation with Voronoi Diagram , 2002, ICVGIP.

[3]  Yuping Wang,et al.  Selected Papers from the Ninth International Conference on Computational Intelligence and Security , 2013, The Scientific World Journal.

[4]  Sheng Liu,et al.  Selective Segmentation for Global Optimization of Depth Estimation in Complex Scenes , 2013, TheScientificWorldJournal.

[5]  Shuhan Shen,et al.  Depth-map merging for Multi-View Stereo with high resolution images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  Pascal Fua,et al.  Efficient large-scale multi-view stereo for ultra high-resolution image sets , 2011, Machine Vision and Applications.

[7]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[8]  Jean-Philippe Pons,et al.  High Accuracy and Visibility-Consistent Dense Multiview Stereo , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Xiaowei Zhou,et al.  Multi-image Matching via Fast Alternating Minimization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Joachim Weickert,et al.  Dense versus Sparse Approaches for Estimating the Fundamental Matrix , 2011, International Journal of Computer Vision.

[12]  Bin Liu,et al.  Benchmark data sets , 2017 .