Bias in robust estimation caused by discontinuities and multiple structures

When fitting models to data containing multiple structures, such as when fitting surface patches to data taken from a neighborhood that includes a range discontinuity, robust estimators must tolerate both gross outliers and pseudo outliers. Pseudo outliers are outliers to the structure of interest, but inliers to a different structure. They differ from gross outliers because of their coherence. Such data occurs frequently in computer vision problems, including motion estimation, model fitting, and range data analysis. The focus in this paper is the problem of fitting surfaces near discontinuities in range data. To characterize the performance of least median of the squares, least trimmed squares, M-estimators, Hough transforms, RANSAC, and MINPRAN on this type of data, the "pseudo outlier bias" metric is developed using techniques from the robust statistics literature, and it is used to study the error in robust fits caused by distributions modeling various types of discontinuities. The results show each robust estimator to be biased at small, but substantial, discontinuities. They also show the circumstances under which different estimators are most effective. Most importantly, the results imply present estimators should be used with care, and new estimators should be developed.

[1]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[2]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[3]  Charles V. Stewart,et al.  MINPRAN: A New Robust Estimator for Computer Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Charles V. Stewart Expected performance of robust estimators near discontinuities , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  M. Levine,et al.  Extracting geometric primitives , 1993 .

[6]  Edward H. Adelson,et al.  Layered representation for motion analysis , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  A. Papoulis Linear systems, Fourier transforms, and optics , 1981, Proceedings of the IEEE.

[8]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[9]  Charles V. Stewart A new robust operator for computer vision: application to range data , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  James V. Miller,et al.  MUSE: robust surface fitting using unbiased scale estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Kim L. Boyer,et al.  Performance evaluation of a class of M-estimators for surface parameter estimation in noisy range data , 1993, IEEE Trans. Robotics Autom..

[12]  P. Rousseeuw,et al.  The Change-of-Variance Curve and Optimal Redescending M-Estimators , 1981 .

[13]  Charles V. Stewart,et al.  A new robust operator for computer vision: theoretical analysis , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Harpreet S. Sawhney,et al.  Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  D. Ruppert Robust Statistics: The Approach Based on Influence Functions , 1987 .

[16]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[17]  Rae-Hong Park,et al.  Robust Adaptive Segmentation of Range Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Alex Pentland,et al.  Cooperative Robust Estimation Using Layers of Support , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[20]  Kim L. Boyer,et al.  The Robust Sequential Estimator: A General Approach and its Application to Surface Organization in Range Data , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[22]  一岡 芳樹,et al.  J. D. Gaskill: Linear Systems, Fourier Transforms, and Optics, John Wiley & Sons, New York, 1978, xiv+554ページ, 23.5×15.5cm, $24.96 (Wiley Sons in Pure and Applied Optics). , 1979 .

[23]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[24]  P. Rousseeuw,et al.  Alternatives to the Median Absolute Deviation , 1993 .

[25]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  P. Rousseeuw Least Median of Squares Regression , 1984 .

[27]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.