A Non-linear Quantitative Evaluation Approach for Disparity Estimation - Pareto Dominance Applied in Stereo Vision

Performance evaluation of vision algorithms is a necessary step during a research process. It may supports inter and intra technique comparisons. A fair evaluation process requires of a methodology. Disparity estimation evaluation involves multiple aspects. However, conventional approaches rely on the use of a single value as an indicator of comparative performance. In this paper a non-linear quantitative evaluation approach for disparity estimation is introduced. It is supported by Pareto dominance and Pareto optimal set concepts. The proposed approach allows different evaluation scenarios, and offers advantages over traditional evaluation approaches. The experimental validation is conducted using ground truth data. Innovative results obtained by applying the proposed approach are presented and discussed.

[1]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Richard Szeliski,et al.  Prediction error as a quality metric for motion and stereo , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Radim Sára,et al.  Feasibility Boundary in Dense and Semi-Dense Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[5]  Yee-Hong Yang,et al.  Evaluation of constructable match cost measures for stereo correspondence using cluster ranking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Richard Szeliski,et al.  An Experimental Comparison of Stereo Algorithms , 1999, Workshop on Vision Algorithms.

[7]  Title Depth Map Estimation Software version 3 Sub group Video , 2008 .

[8]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithm test suites , 1999, SAC '99.

[9]  Zheng-Xiang Xie,et al.  Color Image Quality Assessment Based on Image Quality Parameters Perceived by Human Vision System , 2010, 2010 International Conference on Multimedia Technology.

[10]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Pascal Fua,et al.  Measuring the Self-Consistency of Stereo Algorithms , 2000, ECCV.