Ordinal measures for visual correspondence

We present ordinal measures for establishing image correspondence. Linear correspondence measures like correlation and the sum of squared differences are known to be fragile. Ordinal measures, which are based on relative ordering of intensity values in windows, have demonstrable robustness to depth discontinuities, occlusion and noise. The relative ordering of intensity values in each window is represented by a rank permutation which is obtained by sorting the corresponding intensity data. By using a novel distance metric between the rank permutations, we arrive at ordinal correlation coefficients. These coefficients are independent of absolute intensity scale, i.e. they are normalized measures. Further, since rank permutations are invariant to monotone transformations of the intensity values, the coefficients are unaffected by nonlinear effects like gamma variation between images. We have developed a simple algorithm for their efficient implementation. Experiments suggest the superiority of ordinal measures over existing techniques under non-ideal conditions. Though we present ordinal measures in the context of stereo, they serve as a general tool for image matching that is applicable to other vision problems such as motion estimation and image registration.

[1]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[2]  Martin Svedlow,et al.  Image Registration: Similarity Measure and Preprocessing Method Comparisons , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[3]  R. Forthofer,et al.  Rank Correlation Methods , 1981 .

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  D. Critchlow.  Metric Methods for Analyzing Partially Ranked Data , 1986 .

[6]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[7]  R. A. Hollister,et al.  A Rank Correlation Coefficient Resistant to Outliers , 1987 .

[8]  L. Quam.  Hierarchical warp stereo , 1987 .

[9]  Michael J. Black.  Robust incremental optical flow , 1992 .

[10]  F. R. Norvelle.  Stereo correlation : window shaping and DEM corrections , 1992 .

[11]  M. Alvo,et al.  Rank Correlations and the Analysis of Rank-Based Experimental Designs , 1993 .

[12]  Daniel Scharstein,et al.  Matching images by comparing their gradient fields , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[13]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[14]  Shree K. Nayar,et al.  Stereo in the presence of specular reflection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Mark W. Maimone.  A Taxonomy for Stereo Computer Vision Experiments , 1996 .

[16]  Shree K. Nayar,et al.  Motion estimation using ordinal measures , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.