Spatially and Robustly Hybrid Mixture Regression Model for Inference of Spatial Dependence

In this paper, we propose a Spatial Robust Mixture Regression model to investigate the relationship between a response variable and a set of explanatory variables over the spatial domain, assuming that the relationships may exhibit complex spatially dynamic patterns that cannot be captured by constant regression coefficients. Our method integrates the robust finite mixture Gaussian regression model with spatial constraints, to simultaneously handle the spatial non-stationarity, local homogeneity, and outlier contaminations. Compared with existing spatial regression models, our proposed model assumes the existence a few distinct regression models that are estimated based on observations that exhibit similar response-predictor relationships. As such, the proposed model not only accounts for non-stationarity in the spatial trend, but also clusters observations into a few distinct and homogenous groups. This provides an advantage on interpretation with a few stationary sub-processes identified that capture the predominant relationships between response and predictor variables. Moreover, the proposed method incorporates robust procedures to handle contaminations from both regression outliers and spatial outliers. By doing so, we robustly segment the spatial domain into distinct local regions with similar regression coefficients, and sporadic locations that are purely outliers. Rigorous statistical hypothesis testing procedure has been designed to test the significance of such segmentation. Experimental results on many synthetic and real-world datasets demonstrate the robustness, accuracy, and effectiveness of our proposed method, compared with other robust finite mixture regression, spatial regression and spatial segmentation methods.

[1]  Chun Yu,et al.  Robust mixture regression using the t-distribution , 2014, Comput. Stat. Data Anal..

[2]  M. Markatou Mixture Models, Robustness, and the Weighted Likelihood Methodology , 2000, Biometrics.

[3]  Temporal and Spatial Information Diffusion in Real Estate Price Changes and Variances , 1997 .

[4]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[5]  Huiyan Sang,et al.  Spatial Homogeneity Pursuit of Regression Coefficients for Large Datasets , 2019, Journal of the American Statistical Association.

[6]  Peter Filzmoser,et al.  Robust fitting of mixtures using the trimmed likelihood estimator , 2007, Comput. Stat. Data Anal..

[7]  W. Yao,et al.  A Selective Overview and Comparison of Robust Mixture Regression Estimators , 2019, International Statistical Review.

[8]  Weixin Yao,et al.  Robust mixture regression model fitting by Laplace distribution , 2014, Comput. Stat. Data Anal..

[9]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[10]  Luis Angel García-Escudero,et al.  Computational Statistics and Data Analysis Robust Clusterwise Linear Regression through Trimming , 2022 .

[11]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[12]  Weixin Yao,et al.  Robust fitting of mixture regression models , 2012, Comput. Stat. Data Anal..

[13]  Marie Chavent,et al.  ClustGeo: an R package for hierarchical clustering with spatial constraints , 2017, Computational Statistics.

[14]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[15]  Diansheng Guo,et al.  Regionalization with dynamically constrained agglomerative clustering and partitioning (REDCAP) , 2008, Int. J. Geogr. Inf. Sci..

[16]  A. Stewart Fotheringham,et al.  Geographically Weighted Regression: A Method for Exploring Spatial Nonstationarity , 2010 .

[17]  mrf2d: Markov random field image models in R. , 2020, 2006.00383.

[18]  M. Fuentes Spectral methods for nonstationary spatial processes , 2002 .

[19]  Shaheena Bashir,et al.  Robust Mixture of Linear Regression Models , 2012 .

[20]  Q. M. Jonathan Wu,et al.  Gaussian-Mixture-Model-Based Spatial Neighborhood Relationships for Pixel Labeling Problem , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Sw. Banerjee,et al.  Hierarchical Modeling and Analysis for Spatial Data , 2003 .

[22]  P. Deb Finite Mixture Models , 2008 .

[23]  Eric R. Ziegel,et al.  Geographically Weighted Regression , 2006, Technometrics.

[24]  Wennan Chang,et al.  RobMixReg: an R package for robust, flexible and high dimensional mixture regression , 2020 .

[25]  S. Fotheringham,et al.  Geographically Weighted Regression , 1998 .

[26]  Olcay Arslan,et al.  Robust mixture regression modeling using the least trimmed squares (LTS)-estimation method , 2018, Commun. Stat. Simul. Comput..

[27]  Weixin Yao,et al.  A new method for robust mixture regression , 2017, The Canadian journal of statistics = Revue canadienne de statistique.

[28]  Q. M. Jonathan Wu,et al.  Fast and Robust Spatially Constrained Gaussian Mixture Model for Image Segmentation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Luis Angel García-Escudero,et al.  Robust estimation of mixtures of regressions with random covariates, via trimming and constraints , 2017, Stat. Comput..

[30]  Wei Pan,et al.  A New Algorithm and Theory for Penalized Regression-based Clustering , 2016, J. Mach. Learn. Res..

[31]  Shitong Wang,et al.  Outlier Detecting in Fuzzy Switching Regression Models , 2004, AIMSA.

[32]  R. Bivand Spatial Dependence: Weighting Schemes, Statistics and Models , 2015 .