l1-Regression based subdivision schemes for noisy data

Fitting curve and surface by least-regression is quite common in many scientific fields. It, however cannot properly handle noisy data with impulsive noises and outliers. In this article, we study -regression and its associated reweighted least squares for data restoration. Unlike most existing work, we propose the -regression based subdivision schemes to handle this problem. In addition, we propose fast numerical optimization method: dynamic iterative reweighted least squares to solve this problem, which has closed form solution for each iteration. The most advantage of the proposed method is that it removes noises and outliers without any prior information about the input data. It also extends the least square regression based subdivision schemes from the fitting of a curve to the set of observations in 2-dimensional space to a p-dimensional hyperplane to a set of point observations in -dimensional space. Wide-ranging experiments have been carried out to check the usability and practicality of this new framework. An -regression based subdivision scheme is proposed to handle noisy curve/surface data with outliers.A fast numerical optimization method named dynamic iterative reweighted least squares is proposed to solve this problem.The most advantage of the proposed method is that it removes noises and outliers without any prior information about the input data.

[1]  M. Fazel,et al.  Iterative reweighted least squares for matrix rank minimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[3]  M. Lai,et al.  Improved Iteratively Reweighted Least Squares for Unconstrained Smoothed 퓁q Minimization , 2013, SIAM J. Numer. Anal..

[4]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[5]  George Merrill Chaikin,et al.  An algorithm for high-speed curve generation , 1974, Comput. Graph. Image Process..

[6]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[7]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[8]  Richard William Farebrother,et al.  L1-Norm and L-Norm Estimation: An Introduction to the Least Absolute Residuals, the Minimax Absolute Residual and Related Fitting Procedures , 2013 .

[9]  Nira Dyn,et al.  Univariate subdivision schemes for noisy data , 2013 .

[10]  Emanuele Trucco,et al.  Fitting Subdivision Surface Models to Noisy and Incomplete 3-D Data , 2007, MIRAGE.

[11]  Bang Yong Sohn,et al.  Detection of outliers in weighted least squares regression , 1997 .

[12]  Curtis R. Vogel,et al.  Iterative Methods for Total Variation Denoising , 1996, SIAM J. Sci. Comput..

[13]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[14]  Malcolm Sabin.  Analysis and design of univariate subdivision schemes / Malcolm Sabin , 2010 .

[15]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Huang Biao,et al.  A practical algorithm to outlier detection and data cleaning for the time-dependent signal , 2013, Proceedings of the 32nd Chinese Control Conference.

[17]  Neil A. Dodgson,et al.  Advances in Multiresolution for Geometric Modelling , 2005 .

[18]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[19]  Hong Zhu,et al.  Primal and dual alternating direction algorithms for ℓ1-ℓ1-norm minimization problems in compressive sensing , 2012, Computational Optimization and Applications.

[20]  Nicolai Bissantz,et al.  Convergence Analysis of Generalized Iteratively Reweighted Least Squares Algorithms on Convex Function Spaces , 2008, SIAM J. Optim..

[21]  D. Levin,et al.  Subdivision schemes in geometric modelling , 2002, Acta Numerica.

[22]  Daniel Cohen-Or,et al.  ℓ1-Sparse reconstruction of sharp point set surfaces , 2010, TOGS.

[23]  Lihong Huang,et al.  A new nonlocal total variation regularization algorithm for image denoising , 2014, Math. Comput. Simul..

[24]  W. Rey.  Introduction to Robust and Quasi-Robust Statistical Methods , 1983 .

[25]  Mozammel H. A. Khan,et al.  Multiple-case outlier detection in least-squares regression model using quantum-inspired evolutionary algorithm , 2009 .