A Measure for Accuracy Disparity Maps Evaluation

The quantitative evaluation of disparity maps is based on error measures. Among the existing measures, the percentage of Bad Matched Pixels (BMP) is widely adopted. Nevertheless, the BMP does not consider the magnitude of the errors and the inherent error of stereo systems, in regard to the inverse relation between depth and disparity. Consequently, different disparity maps, with quite similar percentages of BMP, may produce 3D reconstructions of largely different qualities. In this paper, a ground-truth based measure of errors in estimated disparity maps is presented. It offers advantages over the BMP, since it takes into account the magnitude of the errors and the inverse relation between depth and disparity. Experimental validations of the proposed measure are conducted by using two state-of-the-art quantitative evaluation methodologies. Obtained results show that the proposed measure is more suited than BMP to evaluate the depth accuracy of the estimated disparity map.

[1]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[3]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Aljoscha Smolic,et al.  A Flexible 3D TV System for Different Multi-Baseline Geometries , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[5]  Dariu Gavrila,et al.  Real-time dense stereo for intelligent vehicles , 2006, IEEE Transactions on Intelligent Transportation Systems.

[6]  A new measure of forecast accuracy , 2010, 2010 2nd IEEE International Conference on Information and Financial Engineering.

[7]  Richard Szeliski,et al.  Prediction error as a quality metric for motion and stereo , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Richard Szeliski,et al.  An Experimental Comparison of Stereo Algorithms , 1999, Workshop on Vision Algorithms.

[9]  Chunping Hou,et al.  An Objective Evaluation for Disparity Map Based on the Disparity Gradient and Disparity Acceleration , 2009, 2009 International Conference on Information Technology and Computer Science.

[10]  Alan C. Bovik,et al.  Range image quality assessment by Structural Similarity , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Jan-Michael Frahm,et al.  Variable baseline/resolution stereo , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Emanuele Trucco,et al.  Towards teleconferencing by view synthesis and large-baseline stereo , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[14]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[15]  María P. Trujillo,et al.  A Non-linear Quantitative Evaluation Approach for Disparity Estimation - Pareto Dominance Applied in Stereo Vision , 2011, VISAPP.

[16]  Pin Xu,et al.  Objective Quality Assessment of Noised Stereoscopic Images , 2011, 2011 Third International Conference on Measuring Technology and Mechatronics Automation.

[17]  Khaled Ghédira,et al.  The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making , 2010, IEEE Transactions on Evolutionary Computation.

[18]  Radim Sára,et al.  Feasibility Boundary in Dense and Semi-Dense Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[20]  Wenrui Ding,et al.  A joint image quality assessment method based on global phase coherence and structural similarity , 2010, 2010 3rd International Congress on Image and Signal Processing.