Regression Diagnostics for Multiple Model Step Data

In many vision and image problems there are multiple structures in a single data set and we need to identify the multiple models. To preserve most structures in presence of noise makes the estimation difficult. In such case for each structure, data which belong to other structures are also outliers in addition to the outliers for all the structures. Robust regression techniques are commonly used to serve the model building process for noisy data to the vision community, that fits the majority data and then to discover outliers, they tend to fail to cope with the situation. In this paper we show a newly proposed regression diagnostic measure is capable for identifying large fraction of outliers, and regression diagnostics may be a better choice to the robust regression. We demonstrate the whole thing through several artificial multiple model step data.

[1]  F. Hampel A General Qualitative Definition of Robustness , 1971 .

[2]  David A. Belsley,et al.  Regression Analysis and its Application: A Data-Oriented Approach.@@@Applied Linear Regression.@@@Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1981 .

[3]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[4]  David Suter,et al.  LTSD: a highly efficient symmetry-based robust estimator , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[5]  Azriel Rosenfeld,et al.  Robust regression methods for computer vision: A review , 1991, International Journal of Computer Vision.

[6]  J. Simonoff,et al.  Procedures for the Identification of Multiple Outliers in Linear Models , 1993 .

[7]  David Suter,et al.  Robust Fitting Using Mean Shift: Applications in Computer Vision , 2004 .

[8]  S. Chatterjee Sensitivity analysis in linear regression , 1988 .

[9]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[10]  A.A.M. Nurunnabi,et al.  Regression diagnostics in large and high dimensional data , 2008, 2008 11th International Conference on Computer and Information Technology.

[11]  S. Chatterjee,et al.  Regression Analysis by Example , 1979 .

[12]  S. Chatterjee,et al.  Regression Analysis by Example , 1979 .

[13]  Peter Meer,et al.  Robust regression for data with multiple structures , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[15]  Anthony C. Atkinson,et al.  Robust Diagnostic Regression Analysis , 2000 .

[16]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[17]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[18]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[19]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[20]  Denis Hamad,et al.  Robust Regression and Outlier Detection with SVR: Application to Optic Flow Estimation , 2006, BMVC.

[21]  Peter J. Huber,et al.  Between Robustness and Diagnostics , 1991 .

[22]  Ali S. Hadi,et al.  Regression Analysis by Example: Chatterjee/Regression , 2006 .

[23]  M. Hillebrand,et al.  Outlier robust corner-preserving methods for reconstructing noisy images , 2007, 0708.0481.

[24]  A. Fielding Sensitivity Analysis in Linear Regression , 1990 .

[25]  Madhuri S. Mulekar Data Mining: Multimedia, Soft Computing, and Bioinformatics , 2004, Technometrics.

[26]  David Suter,et al.  A novel robust method for large numbers of gross errors , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..