Fitting algebraic curves to noisy data

(MATH) Motivated by applications in vision and pattern detection, we introduce the following problem. We are given pairs of datapoints $(x_1, y_1)$, $(x_2, y_2)$, $\ldots,(x_m, y_m)$, a noise parameter $\delta > 0$, a degree bound $d$, and a threshold $\rho>0$. We desire "every" degree $d$ polynomial $h$ satisfying h(x_i) \in [y_i -\delta, y_i +\delta] & \qquad \nonumber for at least &rgr;&rgr; fraction of i's.(MATH) We assume by rescaling the data that each $x_i, y_i \in [-1, 1]$.(MATH) If $\delta =0$, this is just the list decoding problem that has been popular in complexity theory and for which Sudan gave a $\poly(d,1/\rho)$ time algorithm.We show a few basic results about the problem. We show that there is no polynomial time algorithm for this problem as defined; the number of solutions can be as large as exp(d0.5 -ε) even if the data is generated using a 50-50 mixture of two polynomials. We give a rigorous analysis of a brute force algorithm for the version of this problem where the data is generated from a mixture of polynomials. Finally, in surprising contrast to our "lower bound", we describe a polynomial-time algorithm for reconstructing mixtures of O(1) polynomials when the mixing weights are "nondegenerate.The tools used include classical theory of approximations.

[1]  T. J. Rivlin An Introduction to the Approximation of Functions , 2003 .

[2]  Sanjoy Dasgupta,et al.  An Efficient PAC Algorithm for Reconstructing a Mixture of Lines , 2002, ALT.

[3]  BY P. ERDGS,et al.  ON EXTREMAL PROPERTIES OF THE DERIVATIVES OF POLYNOMIALS , 2002 .

[4]  Madhu Sudan,et al.  Decoding of Reed Solomon Codes beyond the Error-Correction Bound , 1997, J. Complex..

[5]  V. F. Leavers,et al.  Which Hough transform , 1993 .

[6]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[7]  Ronitt Rubinfeld,et al.  Reconstructing algebraic functions from mixed data , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[8]  J. G. Pierce,et al.  Geometric Algorithms and Combinatorial Optimization , 2016 .

[9]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  L. G. Valiant Deductive Learning , 2017, Encyclopedia of Machine Learning and Data Mining.

[12]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[14]  Manfred H. Hueckel An Operator Which Locates Edges in Digitized Pictures , 1971, J. ACM.

[15]  L. Goddard Approximation of Functions , 1965, Nature.

[16]  J. Cooper,et al.  Theory of Approximation , 1960, The Mathematical Gazette.

[17]  J. Mill,et al.  An examination of Sir William Hamilton's philosophy , 1979 .