Analytic line fitting in the presence of uniform random noise

Abstract One of the most fundamental tasks in pattern recognition involves fitting a curve such as a line segment to a given set of data points. Using the conventional ordinary least-squares (OLS) method of fitting a line to a set of data points is notoriously unreliable when the data contain points coming from two different populations: (i) randomly distributed points (“random noise”), (ii) points correlated with the line itself (e.g., obtained by perturbing the line with zero-mean Gaussian noise). Points which lie far away from the line (i.e., “outliers”) usually belong to the random noise population; since they contribute the most to the squared distances, they skew the line estimate from its correct position. In this paper we present an analytic method of separating the components of the mixture. Unlike previous methods, we derive a closed-form solution. Applying a variant of the method of moments (MoM) to the assumed mixture model yields an analytic estimate of the desired line. Finally, we provide experimental results obtained by our method.

[1]  Azriel Rosenfeld,et al.  Robust detection of straight and circular road segments in noisy aerial images' , 1997, Pattern Recognit..

[2]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[3]  C. R. Rao,et al.  The Utilization of Multiple Measurements in Problems of Biological Classification , 1948 .

[4]  A. Cohen,et al.  Estimation in Mixtures of Two Normal Distributions , 1967 .

[5]  K. Pearson Contributions to the Mathematical Theory of Evolution , 1894 .

[6]  Nahum Kiryati,et al.  Guaranteed Convergence of the Hough Transform , 1998, Comput. Vis. Image Underst..

[7]  Alfred M. Bruckstein,et al.  What's in a Set of Points? (Straight Line Fitting) , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kenichi Kanatani Statistical analysis of geometric computation , 1994 .

[9]  Isaac Weiss,et al.  Line Fitting in a Noisy Image , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[11]  Werner A. Stahel,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[12]  R. Butler Predictive Likelihood Inference with Applications , 1986 .

[13]  John F. Hemdal,et al.  One-dimensional digital processing of images for straight-line detection , 1998, Pattern Recognit..

[14]  M Holgersson,et al.  Decomposition of a mixture into normal components: a review. , 1978, International journal of bio-medical computing.

[15]  Nathan S. Netanyahu,et al.  Analytic outlier removal in line fitting , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[16]  Haluk Derin,et al.  Estimating Components of Univariate Gaussian Mixtures Using Prony's Method , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[18]  Azriel ROSENFELD,et al.  Direction-weighted line fitting to edge data , 1987, Pattern Recognit. Lett..

[19]  Paul L. Rosin Ellipse fitting by accumulating five-point fits , 1993, Pattern Recognit. Lett..

[20]  Behrooz Kamgar-Parsi,et al.  A Nonparametric Method for Fitting a Straight Line to a Noisy Image , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Andrew Stein,et al.  Robust statistics in shape fitting , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Yonina C. Eldar,et al.  A probabilistic Hough transform , 1991, Pattern Recognit..

[23]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[24]  Joyce Snell,et al.  6. Alternative Methods of Regression , 1996 .

[25]  Keinosuke Fukunaga,et al.  Estimation of the Parameters of a Gaussian Mixture Using the Method of Moments , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  P. Rousseeuw Least Median of Squares Regression , 1984 .