Expectile regression neural network model with applications

The expectile regression neural network (ERNN) model is proposed.It is flexible and can be used to explore potential nonlinear effects of covariates.It is a general model that incorporates several popular models as specials cases.It can be estimated through standard gradient based optimization algorithms.It outputs conditional expectile functions directly. Recently, nonlinear expectile regression becomes popular because it can not only explore nonlinear relationships among variables, but also describe the complete distribution of a response variable conditional on covariates information. In contrast, the traditional nonlinear expectile regression mainly confronts two shortcomings. First, it is difficult to select an appropriate form of nonlinear function. Second, it ignores the interaction effects among covariates. In this paper, we develop a new expectile regression neural network (ERNN) model by adding a neural network structure to expectile regression approach. The proposed ERNN model is flexible and can be used to explore potential nonlinear effects of covariates on expectiles of the response. The ERNN model can be easily estimated through standard gradient based optimization algorithms and output conditional expectile functions directly. The advantage of ERNN model is illustrated by Monte Carlo simulation studies. The numerical results show that the ERNN model outperforms the conventional expectile regression and support vector machine models in terms of predictive ability with both in-sample and out-of-sample test. We also apply the ERNN model to the predictions of concrete compressive strength and housing price. It turns out the marginal contribution of each predictor to the conditional expectile of a response is useful for decision-making.

[1]  Alexander S. Poznyak,et al.  Orientation of radio-telescope secondary mirror via adaptive sliding mode control , 2017, Neurocomputing.

[2]  Michael W. Mahoney,et al.  Quantile Regression for Large-Scale Applications , 2013, SIAM J. Sci. Comput..

[3]  Paul H. C. Eilers,et al.  Flexible smoothing with B-splines and penalties , 1996 .

[4]  Paul H. C. Eilers,et al.  Optimal expectile smoothing , 2009, Comput. Stat. Data Anal..

[5]  Kin Keung Lai,et al.  Measuring financial risk with generalized asymmetric least squares regression , 2011, Appl. Soft Comput..

[6]  Shanlin Yang,et al.  Short-term power load probability density forecasting based on quantile regression neural network and triangle kernel function , 2016 .

[7]  Sangyeol Lee,et al.  Nonlinear expectile regression with application to Value-at-Risk and expected shortfall estimation , 2016, Comput. Stat. Data Anal..

[8]  James W. Taylor Estimating Value at Risk and Expected Shortfall Using Expectiles , 2007 .

[9]  Rogelio Lozano,et al.  Second order sliding mode controllers for altitude control of a quadrotor UAS: Real-time implementation in outdoor environments , 2017, Neurocomputing.

[10]  D. Poirier,et al.  On the Estimation of Production Frontiers: Maximum Likelihood Estimation of the Parameters of a Discontinuous Density Function , 1976 .

[11]  R. Koenker Additive models for quantile regression: Model selection and confidence bandaids , 2010 .

[12]  W. Newey,et al.  Asymmetric Least Squares Estimation and Testing , 1987 .

[13]  Chung-Ming Kuan,et al.  Assessing Value at Risk With CARE, the Conditional Autoregressive Expectile Models , 2008 .

[14]  Runze Li,et al.  Robust neural network with applications to credit portfolio data analysis. , 2010, Statistics and its interface.

[15]  R. Kelley Pace,et al.  Nonparametric methods with applications to hedonic models , 1993 .

[16]  Gülçin Büyüközkan,et al.  A new hesitant fuzzy QFD approach: An application to computer workstation selection , 2016, Appl. Soft Comput..

[17]  Xi Liu,et al.  Quantile autoregression neural network model with applications to evaluating value at risk , 2016, Appl. Soft Comput..

[18]  Kjell A. Doksum,et al.  On average derivative quantile regression , 1997 .

[19]  M. C. Jones Expectiles and M-quantiles are quantiles , 1994 .

[20]  Ieroham S. Baruch,et al.  Complex-valued neural network topology and learning applied for identification and control of nonlinear systems , 2017, Neurocomputing.

[21]  Alejandro Justo Malo Tamayo,et al.  Inverse models and robust parametric-step neuro-control of a Humanoid Robot , 2017, Neurocomputing.

[22]  H. White Nonparametric Estimation of Conditional Quantiles Using Neural Networks , 1990 .

[23]  Michal Tkác,et al.  Artificial neural networks in business: Two decades of research , 2016, Appl. Soft Comput..

[24]  James W. Taylor A Quantile Regression Neural Network Approach to Estimating the Conditional Density of Multiperiod Returns , 2000 .

[25]  Xuming He,et al.  Monotone B-Spline Smoothing , 1998 .

[26]  H. Tong,et al.  Asymmetric least squares regression estimation: A nonparametric approach ∗ , 1996 .

[27]  H. Zou,et al.  Composite quantile regression and the oracle Model Selection Theory , 2008, 0806.2905.

[28]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[29]  Jianping Fan,et al.  iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning , 2017, IEEE Transactions on Information Forensics and Security.

[30]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[31]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .

[32]  Fernando Castaños,et al.  Implementing robust neuromodulation in neuromorphic circuits , 2016, Neurocomputing.

[33]  Ignacio Rojas,et al.  Neural networks: An overview of early research, current frameworks and new challenges , 2016, Neurocomputing.

[34]  Wen Yu,et al.  Path planning of multi-agent systems in unknown environment with neural kernel smoothing and reinforcement learning , 2017, Neurocomputing.

[35]  Jun Yu,et al.  Machine learning and signal processing for big multimedia analysis , 2017, Neurocomputing.

[36]  Linglong Kong,et al.  Partial functional linear quantile regression for neuroimaging data analysis , 2015, Neurocomputing.

[37]  Hui Zou,et al.  Nonparametric multiple expectile regression via ER-Boost , 2015 .

[38]  Thomas Kneib,et al.  Geoadditive expectile regression , 2012, Comput. Stat. Data Anal..

[39]  Alex J. Cannon Quantile regression neural networks: Implementation in R and application to precipitation downscaling , 2011, Comput. Geosci..

[40]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.