Jump regression, image processing, and quality control

ABSTRACT Images have been widely used in manufacturing applications for monitoring production processes, partly because they are often convenient and economic to acquire by different types of imaging devices. Medical imaging techniques, such as CT, PET, X-ray, ultrasound, magnetic resonance imaging (MRI), and functional MRI, have become a basic medical diagnosis tool nowadays. Satellite images are also commonly used for monitoring the changes of the earth’s surface. In all these applications, image comparison and monitoring are the common and fundamentally important statistical problems that should be addressed properly. In computer science, applied mathematics, statistics and some other disciplines, there have been many image processing methods proposed. In this article, I will discuss (i) a powerful statistical tool, called jump regression analysis (JRA), for modeling and analyzing images and other types of data with jumps and other singularities involved, (ii) some image processing problems and methods that are potentially useful for image comparison and monitoring, and (iii) some of my personal perspectives about image comparison and monitoring.

[1]  P. Qiu.  A Nonparametric Procedure to Detect Jumps in Regression Surfaces , 2002 .

[2]  Chao Lan,et al.  Anomaly Detection , 2018, Encyclopedia of GIS.

[3]  Joachim Weickert,et al.  Correspondences between Wavelet Shrinkage and Nonlinear Diffusion , 2003, Scale-Space.

[4]  Brian S. Yandell,et al.  A local polynomial jump-detection algorithm in nonparametric regression , 1998 .

[5]  Peihua Qiu,et al.  Feature based image registration using non-degenerate pixels , 2013, Signal Process..

[6]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[7]  Danny Barash,et al.  A Fundamental Relationship between Bilateral Filtering, Adaptive Smoothing, and the Nonlinear Diffusion Equation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  H. Müller,et al.  Maximin estimation of multidimensional boundaries , 1994 .

[9]  Subhasis Chaudhuri,et al.  Joint blind restoration and surface recovery in photometric stereo. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  Dinggang Shen,et al.  Learning-based deformable registration of MR brain images , 2006, IEEE Transactions on Medical Imaging.

[11]  Peihua Qiu,et al.  Jump-preserving surface reconstruction from noisy data , 2009 .

[12]  Kevin J. Parker,et al.  Corrigendum: Imaging the elastic properties of tissue: the 20 year perspective , 2012 .

[13]  Peihua Qiu,et al.  Jump-Preserving Regression and Smoothing using Local Linear Fitting: A Compromise , 2007 .

[14]  Peihua Qiu,et al.  A nonparametric procedure for blind image deblurring , 2008, Comput. Stat. Data Anal..

[15]  Peihua Qiu,et al.  Nonparametric estimation of a point-spread function in multivariate problems , 2007 .

[16]  Partha Sarathi Mukherjee,et al.  Efficient bias correction for magnetic resonance image denoising , 2013, Statistics in medicine.

[17]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  P. Qiu.  NONPARAMETRIC ESTIMATION OF JUMP SURFACE , 2016 .

[19]  Fugee Tsung,et al.  Statistical Surface Monitoring by Spatial-Structure Modeling , 2014 .

[20]  Peihua Qiu,et al.  Statistical monitoring of the hand, foot and mouth disease in China , 2015, Biometrics.

[21]  Subhasis Chaudhuri,et al.  MRF model-based identification of shift-variant point spread function for a class of imaging systems , 1999, Signal Process..

[22]  A. Tsybakov,et al.  Minimax theory of image reconstruction , 1993 .

[23]  Giovanna Capizzi,et al.  A Least Angle Regression Control Chart for Multidimensional Data , 2011, Technometrics.

[24]  Peihua Qiu,et al.  Local Smoothing Image Segmentation for Spotted Microarray Images , 2007 .

[25]  Partha Sarathi Mukherjee,et al.  Edge structure preserving image denoising , 2010, Signal Process..

[26]  J. Polzehl,et al.  Adaptive weights smoothing with applications to image restoration , 1998 .

[27]  W. H. Deitenbeck.  Introduction to statistical process control. , 1995, Healthcare facilities management series.

[28]  Peihua Qiu,et al.  On Nonparametric Image Registration , 2013, Technometrics.

[29]  Christian Rau,et al.  Tracking a smooth fault line in a response surface , 2000 .

[30]  Peihua Qiu,et al.  Blind image deblurring using jump regression analysis , 2015 .

[31]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[32]  Peihua Qiu,et al.  Jump Detection in Regression Surfaces Using Both First-Order and Second-Order Derivatives , 2007 .

[33]  Peihua Qiu,et al.  Statistical monitoring-based alarming systems in modeling the AIDS epidemic in the United States, 1985-2011. , 2016, Current HIV research.

[34]  Jaime A. Camelio,et al.  A Spatiotemporal Method for the Monitoring of Image Data , 2012, Qual. Reliab. Eng. Int..

[35]  H. Müller.  CHANGE-POINTS IN NONPARAMETRIC REGRESSION ANALYSIS' , 1992 .

[36]  C. Loader.  CHANGE POINT ESTIMATION USING NONPARAMETRIC REGRESSION , 1996 .

[37]  Yuhong Yang,et al.  Nonparametric Regression with Correlated Errors , 2001 .

[38]  Robert A. Lordo.  Image Processing and Jump Regression Analysis , 2006, Technometrics.

[39]  Changliang Zou,et al.  CONTROL CHART FOR MONITORING NONPARAMETRIC PROFILES WITH ARBITRARY DESIGN , 2009 .

[40]  Ronald D. Fricker.  Introduction to Statistical Methods for Biosurveillance: With an Emphasis on Syndromic Surveillance , 2013 .

[41]  Peihua Qiu,et al.  A Change-Point Approach for Phase-I Analysis in Multivariate Profile Monitoring and Diagnosis , 2016, Technometrics.

[42]  Qiu Brian YandellBiostatistics.  A LOCAL POLYNOMIAL JUMP DETECTION ALGORITHM IN NONPARAMETRICREGRESSIONPeihua , 1998 .

[43]  Peihua Qiu,et al.  A parametric intensity-based 3D image registration method for magnetic resonance imaging , 2017, Signal Image Video Process..

[44]  Finbarr O'Sullivan,et al.  A Regularized Contrast Statistic for Object Boundary Estimation-Implementation and Statistical Evaluation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Peihua Qiu,et al.  Jump Detection In Blurred Regression Surfaces , 2014, Technometrics.

[46]  Kuo-Chin Fan,et al.  Image Registration Using a New Edge-Based Approach , 1997, Comput. Vis. Image Underst..

[47]  Peihua Qiu.  Image Processing and Jump Regression Analysis: Qiu/Image , 2005 .

[48]  Hoon Sohn,et al.  Wavelet-based active sensing for delamination detection in composite structures , 2004 .

[49]  G. Wahba.  Spline models for observational data , 1990 .

[50]  C. Chu,et al.  Kernel-Type Estimators of Jump Points and Values of a Regression Function , 1993 .

[51]  Peihua Qiu,et al.  Phase I Monitoring of Spatial Surface Data from 3D Printing , 2018, Technometrics.

[52]  D. Rubens,et al.  Imaging the elastic properties of tissue: the 20 year perspective , 2011, Physics in medicine and biology.

[53]  Aggelos K. Katsaggelos,et al.  Image identification and restoration based on the expectation-maximization algorithm , 1990 .

[54]  Peihua Qiu,et al.  Statistical Process Control Charts as a Tool for Analyzing Big Data , 2017 .

[55]  P. Qiu.  Jump Surface Estimation, Edge Detection, and Image Restoration , 2007 .

[56]  Massimo Pacella,et al.  From Profile to Surface Monitoring: SPC for Cylindrical Surfaces Via Gaussian Processes , 2014 .

[57]  Liang Peng,et al.  Local likelihood tracking of fault lines and boundaries , 2001 .

[58]  Shiyu Zhou,et al.  IDENTIFICATION OF IMPACTING FACTORS OF SURFACE DEFECTS IN HOT ROLLING PROCESSES USING MULTI-LEVEL REGRESSION ANALYSIS , 2004 .

[59]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[60]  Eann A. Patterson,et al.  Towards full field automated photoelastic analysis of complex components , 1991 .

[61]  Peihua Qiu,et al.  Multivariate Statistical Process Control Using LASSO , 2009 .

[62]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[63]  William H. Woodall,et al.  Nonparametric Profile Monitoring by Mixed Effects Modeling. Comment. , 2010 .

[64]  A. Khotanzad,et al.  A physics-based coordinate transformation for 3-D image matching , 1997, IEEE Transactions on Medical Imaging.

[65]  Fugee Tsung,et al.  Monitoring Profiles Based on Nonparametric Regression Methods , 2008, Technometrics.

[66]  Jeffrey A. Fessler,et al.  Exact distribution of edge-preserving MAP estimators for linear signal models with Gaussian measurement noise , 2000, IEEE Trans. Image Process..

[67]  邱培华.  ESTIMATION OF A KIND OF JUMP REGRESSION FUNCTION , 1991 .

[68]  J. Hogg.  Magnetic resonance imaging. , 1994, Journal of the Royal Naval Medical Service.

[69]  H.-C. Liu,et al.  Liquid crystal display surface uniformity defect inspection using analysis of variance and exponentially weighted moving average techniques , 2005 .

[70]  Dongdong Xiang,et al.  Surveillance of cardiovascular diseases using a multivariate dynamic screening system , 2015, Statistics in medicine.

[71]  Hua Lee,et al.  Maximum Entropy and Bayesian Methods. , 1996 .

[72]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  P. Qiu.  Estimation of the number of jumps of the jump regression functions , 1994 .

[74]  P. Qiu,et al.  ESTIMATION OF JUMP REGRESSION FUNCTION , 1991 .

[75]  R. Stollberger,et al.  Nonlinear anisotropic diffusion filtering for multiscale edge enhancement , 2002 .

[76]  Dongdong Xiang,et al.  Univariate Dynamic Screening System: An Approach For Identifying Individuals With Irregular Longitudinal Behavior , 2014, Technometrics.

[77]  Enrique del Castillo,et al.  Geodesic Gaussian Processes for the Reconstruction of a Free-Form Surface , 2013 .

[78]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[79]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[80]  Alfred S. Carasso,et al.  Direct Blind Deconvolution , 2001, SIAM J. Appl. Math..

[81]  D. Hawkins,et al.  NONPARAMETRIC CONTROL CHART FOR MONITORING PROFILES USING CHANGE POINT FORMULATION AND ADAPTIVE SMOOTHING , 2009 .

[82]  Wei Jiang,et al.  High-Dimensional Process Monitoring and Fault Isolation via Variable Selection , 2009 .

[83]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[84]  Peihua Qiu,et al.  Nonparametric Profile Monitoring by Mixed Effects Modeling , 2010, Technometrics.

[85]  Peihua Qiu,et al.  Edge-preserving image denoising and estimation of discontinuous surfaces , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Lan Kang,et al.  On-Line Monitoring When the Process Yields a Linear Profile , 2000 .

[87]  Hao Yan,et al.  Image-Based Process Monitoring Using Low-Rank Tensor Decomposition , 2015, IEEE Transactions on Automation Science and Engineering.

[88]  Peihua Qiu,et al.  On Image Registration in Magnetic Resonance Imaging , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[89]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[90]  Hao Yan,et al.  Anomaly Detection in Images With Smooth Background via Smooth-Sparse Decomposition , 2017, Technometrics.

[91]  Massimo Pacella,et al.  Monitoring and diagnosis of multichannel nonlinear profile variations using uncorrelated multilinear principal component analysis , 2013 .

[92]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[93]  Peihua Qiu,et al.  Difference Detection Between Two Images for Image Monitoring , 2018, Technometrics.

[94]  B. Yandell,et al.  Jump Detection in Regression Surfaces , 1997 .

[95]  Wei Jiang,et al.  Spatiotemporal surveillance methods in the presence of spatial correlation , 2011, Statistics in medicine.

[96]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[97]  Peihua Qiu,et al.  Jump Detection in a Regression Curve and Its Derivative , 2009, Technometrics.

[98]  Enrique del Castillo,et al.  Geodesic Gaussian Processes for the Parametric Reconstruction of a Free-Form Surface , 2015, Technometrics.

[99]  Suchendra M. Bhandarkar,et al.  An edge detection technique using local smoothing and statistical hypothesis testing , 1996, Pattern Recognit. Lett..

[100]  Peihua Qiu,et al.  Discontinuous regression surfaces fitting , 1998 .

[101]  Yazhen Wang.  Jump and sharp cusp detection by wavelets , 1995 .

[102]  Fugee Tsung,et al.  Monitoring General Linear Profiles Using Multivariate Exponentially Weighted Moving Average Schemes , 2007, Technometrics.

[103]  Peihua Qiu,et al.  BLIND DECONVOLUTION AND DEBLURRING IN IMAGE ANALYSIS , 2006 .

[104]  Peihua Qiu,et al.  The Local Piecewisely Linear Kernel Smoothing Procedure for Fitting Jump Regression Surfaces , 2004, Technometrics.

[105]  Alberto Ferrer,et al.  Statistical process control based on Multivariate Image Analysis: A new proposal for monitoring and defect detection , 2014, Comput. Chem. Eng..

[106]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[107]  Karen A. F. Copeland.  Cumulative Sum Charts and Charting for Quality Improvement , 1999 .

[108]  Partha Sarathi Mukherjee,et al.  Edge Structure Preserving 3D Image Denoising by Local Surface Approximation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[109]  Peihua Qiu,et al.  ON JUMP DETECTION IN REGRESSION CURVES USING LOCAL POLYNOMIAL KERNEL ESTIMATION , 2009 .

[110]  Jun Li,et al.  Nonparametric dynamic screening system for monitoring correlated longitudinal data , 2016 .

[111]  Peihua Qiu,et al.  Intensity-based 3D local image registration , 2017, Pattern Recognit. Lett..

[112]  Peihua Qiu,et al.  Using Conventional Edge Detectors and Postsmoothing for Segmentation of Spotted Microarray Images , 2009 .

[113]  Jean-Francois Mangin,et al.  What is the best similarity measure for motion correction in fMRI time series? , 2002, IEEE Transactions on Medical Imaging.

[114]  John F. MacGregor,et al.  Multivariate image analysis in the process industries: A review , 2012 .

[115]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[116]  Douglas M. Hawkins,et al.  The Changepoint Model for Statistical Process Control , 2003 .

[117]  Elisabeth J. Umble,et al.  Cumulative Sum Charts and Charting for Quality Improvement , 2001, Technometrics.

[118]  K. Worsley.  Testing for a Two-Phase Multiple Regression , 1983 .

[119]  Yazhen Wang,et al.  Change Curve Estimation via Wavelets , 1998 .

[120]  Charles E Kahn,et al.  DICOM and radiology: past, present, and future. , 2007, Journal of the American College of Radiology : JACR.

[121]  Jyhwen Wang,et al.  Gaussian process method for form error assessment using coordinate measurements , 2008 .

[122]  Peihua Qiu,et al.  A jump-preserving curve fitting procedure based on local piecewise-linear kernel estimation , 2003 .

[123]  Jaime A. Camelio,et al.  A Review and Perspective on Control Charting with Image Data , 2011 .

[124]  Peihua Qiu,et al.  Jump information criterion for statistical inference in estimating discontinuous curves , 2015 .

[125]  Peihua Qiu,et al.  Intensity-Based Image Registration by Nonparametric Local Smoothing , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[126]  Peihua Qiu,et al.  Efficient Bias Correction For MRI Image Denoising , 2012 .

[127]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[128]  D. Hinkley.  Inference in Two-Phase Regression , 1971 .

[129]  Jionghua Jin,et al.  Feature-preserving data compression of stamping tonnage information using wavelets , 1999 .

[130]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[131]  Peihua Qiu,et al.  Tracking Edges, Corners and Vertices in an Image , 2008 .

[132]  N Saeed,et al.  Magnetic resonance image segmentation using pattern recognition, and applied to image registration and quantitation , 1998, NMR in biomedicine.