House price forecasting with neural networks

Abstract The house market has been rapidly growing for the past decade in China, making price forecasting an important issue to the people and policy makers. We approach this problem by exploring neural networks for forecasting of house prices from one hundred major cities for the period of June 2010–May 2019, serving as the first study with such wide coverage for the emerging Chinese market through a machine learning technique. We aim at constructing simple and accurate neural networks as a contribution to pure technical forecasting of house prices. To facilitate the analysis, we investigate different model settings over the algorithm (the Levenberg-Marquardt, scaled conjugate gradient, and Bayesian regularization), delay (from two to six), hidden neuron (two, three, five, and eight), and data spitting ratio (70%–15%–15%, 60%–20%–20%, and 80%–10%–10% for trainingvalidationtesting), and arrive at a rather simple neural network with only four delays and three hidden neurons that leads to stable performance of 1% average relative root mean square error across the one hundred cities for the training, validation, and testing phases. We demonstrate the usefulness of the machine learning approach to the house price forecasting problem in the Chinese market. Our results could be used on a standalone basis or combined with fundamental forecasting in forming perspectives of house price trends and conducting policy analysis. Our empirical framework should not be difficult to deploy, which is an important consideration to many decision makers, and has potential to be generalized for house price forecasting of other cities in China.

[1]  Yoshinobu Kawahara,et al.  Analyzing relationships among ARMA processes based on non-Gaussianity of external influences , 2011, Neurocomputing.

[2]  Lu Zong,et al.  Spatial Prediction of Housing Prices in Beijing Using Machine Learning Algorithms , 2020, HPCCT/BDAI.

[3]  Charles Blundell,et al.  Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , 2016, NIPS.

[4]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[5]  V. Limsombunchai House Price Prediction: Hedonic Price Model vs. Artificial Neural Network , 2004 .

[6]  Salvatore Joseph Terregrossa,et al.  Combining Housing Price Forecasts Generated Separately by Hedonic and Artificial Neural Network Models , 2021 .

[7]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[8]  Ping-Feng Pai,et al.  Using Machine Learning Models and Actual Transaction Data for Predicting Real Estate Prices , 2020, Applied Sciences.

[9]  Xiaojie Xu The rolling causal structure between the Chinese stock index and futures , 2017 .

[10]  Xiaojie Xu Corn Cash Price Forecasting , 2020 .

[11]  Leonardo Caggiani,et al.  A Neural Network based Model for Real Estate Price Estimation Considering Environmental Quality of Property Location , 2014 .

[12]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[13]  Xiaojie Xu Price dynamics in corn cash and futures markets: cointegration, causality, and forecasting through a rolling window approach , 2019, Financial Markets and Portfolio Management.

[14]  J. W. Kim,et al.  REITs' dynamics under structural change with unknown break points , 2007 .

[15]  R. Hacıoğlu PREDICTION OF SOLAR RADIATION BASED ON MACHINE LEARNING METHODS , 2017 .

[16]  Xiaojie Xu Short-run price forecast performance of individual and composite models for 496 corn cash markets , 2017 .

[17]  Xiaojie Xu Causality and Price Discovery in U.S. Corn Markets: An Application of Error Correction Modeling and Directed Acyclic Graphs , 2014 .

[18]  Xiaojie Xu Contemporaneous and Granger causality among US corn cash and futures prices , 2018, European Review of Agricultural Economics.

[19]  Ali Azadeh,et al.  A Flexible Neuro-Fuzzy Approach for Improvement of Seasonal Housing Price Estimation in Uncertain and Non-Linear Environments , 2014 .

[20]  Tao Fu,et al.  Forecasting Second-hand Housing Price using Artificial Intelligence and Machine Learning Techniques , 2018 .

[21]  Nghiep Nguyen,et al.  Predicting Housing Value: A Comparison of Multiple Regression Analysis and Artificial Neural Networks , 2001 .

[22]  Albert P.C. Chan,et al.  Improving property valuation accuracy: a comparison of hedonic pricing model and artificial neural network , 2018 .

[23]  Abhishek Mishra,et al.  Indian stock market prediction using artificial neural networks on tick data , 2019, Financial Innovation.

[24]  Rotimi Abidoye,et al.  Modelling property values in Nigeria using artificial neural network , 2017 .

[25]  Rifat Hacioglu,et al.  ESTIMATION OF FAST VARIED WIND SPEED BASED ON NARX NEURAL NETWORK BY USING CURVE FITTING , 2017 .

[26]  S. Liong,et al.  GENERALIZATION FOR MULTILAYER NEURAL NETWORK BAYESIAN REGULARIZATION OR EARLY STOPPING , 2004 .

[27]  Xike Xie,et al.  An Integrated Model for Urban Subregion House Price Forecasting: A Multi-source Data Perspective , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[28]  Kyong Joo Oh,et al.  Developing a Forecasting Model for Real Estate Auction Prices Using Artificial Intelligence , 2020, Sustainability.

[29]  Jae Kwon Bae,et al.  Using machine learning algorithms for housing price prediction: The case of Fairfax County, Virginia housing data , 2015, Expert Syst. Appl..

[30]  Theophilos Papadimitriou,et al.  Forecasting the U.S. Real House Price Index , 2014 .

[31]  Yu Wei,et al.  Forecasting house prices using dynamic model averaging approach: Evidence from China , 2017 .

[32]  Stephanie Thomas,et al.  Practical MATLAB Deep Learning: A Project-Based Approach , 2020 .

[33]  Wasim Ahmad,et al.  A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series , 2020 .

[34]  Hu Xiaolong,et al.  Applied research on real estate price prediction by the neural network , 2010, 2010 The 2nd Conference on Environmental Science and Information Application Technology.

[35]  Aapo Hyvärinen,et al.  Estimation of a Structural Vector Autoregression Model Using Non-Gaussianity , 2010, J. Mach. Learn. Res..

[36]  Qing Chang,et al.  Housing price prediction using neural networks , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[37]  R. Li,et al.  Walled Buildings, Sustainability, and Housing Prices: An Artificial Neural Network Approach , 2018 .

[38]  So Igbinosa Determinants of Residential Property Value in Nigeria – A Neural Network Approach , 2011 .

[39]  Zeeshan Shahid,et al.  Comparative Performance Analysis of Levenberg-Marquardt, Bayesian Regularization and Scaled Conjugate Gradient for the Prediction of flash Floods , 2019 .

[40]  Rifat Hacioglu,et al.  Prediction of wind speed with non-linear autoregressive (NAR) neural networks , 2017, 2017 25th Signal Processing and Communications Applications Conference (SIU).

[41]  Juan Ramón Rico-Juan,et al.  Machine learning with explainability or spatial hedonics tools? An analysis of the asking prices in the housing market in Alicante, Spain , 2021, Expert Syst. Appl..

[42]  J. N. Tabales,et al.  Artificial neural networks for predicting real estate prices , 2013 .

[43]  Xiaojie Xu Cointegration among regional corn cash prices , 2015 .

[44]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[45]  Yun Zhang,et al.  Individual time series and composite forecasting of the Chinese stock index , 2021 .

[46]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[47]  Xiaojie Xu Intraday price information flows between the CSI300 and futures market: an application of wavelet analysis , 2018 .

[48]  Orkhan Baghirli,et al.  Comparison of Lavenberg-Marquardt, Scaled Conjugate Gradient and Bayesian Regularization Backpropagation Algorithms for Multistep Ahead Wind Speed Forecasting Using Multilayer Perceptron Feedforward Neural Network , 2015 .

[49]  Tao Wang,et al.  Linear and Nonlinear Predictability of International Securitized Real Estate Returns: A Reality Check , 2011 .

[50]  Abdul Ghani Sarip,et al.  Application Of Fuzzy Regression Model For Real Estate Price Prediction , 2016 .

[51]  Roy Kouwenberg,et al.  Forecasting the US housing market , 2014 .

[52]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[53]  Woubishet Zewdu Taffese,et al.  Case-based reasoning and neural networks for real state valuation , 2007 .

[54]  Hasan Selim,et al.  Determinants of house prices in Turkey: Hedonic regression versus artificial neural network , 2009, Expert Syst. Appl..

[55]  Yan Wang,et al.  Prediction on Housing Price Based on Deep Learning , 2018 .

[56]  W. Z. Taffese,et al.  Case-based reasoning and neural networks for real estate valuation , 2007, Artificial Intelligence and Applications.

[57]  Jianwei Zhang,et al.  Study on the Prediction of Real estate Price Index based on HHGA-RBF Neural Network Algorithm , 2015 .

[58]  Tao Wang,et al.  Nonlinearity and Intraday Efficiency Tests on Energy Futures Markets , 2009 .

[59]  Aytaç Altan,et al.  Recognition Model for Solar Radiation Time Series based on Random Forest with Feature Selection Approach , 2019, 2019 11th International Conference on Electrical and Electronics Engineering (ELECO).

[60]  George Milunovich Forecasting Australia's real house price index: A comparison of time series and machine learning methods , 2020 .

[61]  Stelios D. Bekiros,et al.  Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques , 2019, Chaos, Solitons & Fractals.

[62]  PIERLUIGI MORANO,et al.  Artificial intelligence in property valuations An application of artificial neural networks to housing appraisal , 2015 .

[63]  Xiaojie Xu Price Discovery in U.S. Corn Cash and Futures Markets: The Role of Cash Market Selection , 2014 .

[64]  Jian Yang,et al.  Price Jump Risk in the US Housing Market , 2016 .

[65]  Hong Zhao,et al.  A SVR based forecasting approach for real estate price prediction , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[66]  Steven P. Peterson,et al.  Neural Network Hedonic Pricing Models in Mass Real Estate Appraisal , 2008 .

[67]  James W. Kolari,et al.  Do Euro Exchange Rates Follow a Martingale? Some Out-of-Sample Evidence , 2008 .

[68]  Murat Kayri,et al.  Predictive Abilities of Bayesian Regularization and Levenberg–Marquardt Algorithms in Artificial Neural Networks: A Comparative Empirical Study on Social Data , 2016 .

[69]  Xiaojie Xu,et al.  Corn cash price forecasting with neural networks , 2021, Comput. Electron. Agric..

[70]  Xiaojie Xu,et al.  Network analysis of corn cash price comovements , 2021 .

[71]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[72]  Xiaojie Xu Cointegration and price discovery in US corn cash and futures markets , 2018 .

[73]  Hieu Pham,et al.  Optimizing Ensemble Weights for Machine Learning Models: A Case Study for Housing Price Prediction , 2019 .

[74]  Yong Piao,et al.  Housing Price Prediction Based on CNN , 2019, 2019 9th International Conference on Information Science and Technology (ICIST).

[75]  Yitong Huang,et al.  Predicting Home Value in California, United States via Machine Learning Modeling , 2019, Statistics, Optimization & Information Computing.

[76]  Jian Yang,et al.  Housing price spillovers in China: A high-dimensional generalized VAR approach , 2018 .

[77]  Kilian Q. Weinberger,et al.  On Calibration of Modern Neural Networks , 2017, ICML.

[78]  Marijana Lazarevska,et al.  Assessment of the Real Estate Market Value in the European Market by Artificial Neural Networks Application , 2018, Complex..

[79]  Lu Liu,et al.  Predicting housing price in China based on long short-term memory incorporating modified genetic algorithm , 2019, Soft Comput..

[80]  Xiaojie Xu Contemporaneous causal orderings of US corn cash prices through directed acyclic graphs , 2017 .

[81]  Xiaojie Xu Contemporaneous Causal Orderings of CSI300 and Futures Prices through Directed Acyclic Graphs , 2019 .

[82]  Bowen Chen,et al.  Predicting the rental value of houses in household surveys in Tanzania, Uganda and Malawi: Evaluations of hedonic pricing and machine learning approaches , 2021, PloS one.

[83]  Chih-Hung Wu,et al.  Hybrid Genetic-Based Support Vector Regression with Feng Shui Theory for Appraising Real Estate Price , 2009, 2009 First Asian Conference on Intelligent Information and Database Systems.

[84]  J. Andrew Ware,et al.  Residential property price time series forecasting with neural networks , 2002, Knowl. Based Syst..

[85]  T. Xiong,et al.  The Behavioral Mechanism and Forecasting of Beijing Housing Prices from a Multiscale Perspective , 2020 .

[86]  Enrico Zio,et al.  A new hybrid model for wind speed forecasting combining long short-term memory neural network, decomposition methods and grey wolf optimizer , 2021, Appl. Soft Comput..

[87]  Francesco Tajani,et al.  Bare ownership evaluation. Hedonic price model vs. artificial neural network , 2013, Int. J. Bus. Intell. Data Min..

[88]  D. Bessler,et al.  Cointegration Analysis of Regional House Prices in U.S. , 2008 .

[89]  Zhongwu Li,et al.  A New Appraisal Model of Second-Hand Housing Prices in China’s First-Tier Cities Based on Machine Learning Algorithms , 2020 .

[90]  Mingcang Zhu,et al.  Housing price forecasting based on genetic algorithm and support vector machine , 2011, Expert Syst. Appl..

[91]  G. Runeson,et al.  Modeling Property Prices Using Neural Network Model for Hong Kong , 2004 .

[92]  Xiaojie Xu Causal structure among US corn futures and regional cash prices in the time and frequency domain , 2018 .

[93]  Jon A. Brandt,et al.  Price forecasting and evaluation: An application in agriculture , 1983 .

[94]  Winky K.O. Ho,et al.  Predicting property prices with machine learning algorithms , 2021 .

[95]  X. Ge Modeling Property Prices Using Neural Network Model for Hong Kong , 2005 .

[96]  Lipo Wang,et al.  Predicting public housing prices using delayed neural networks , 2016, 2016 IEEE Region 10 Conference (TENCON).

[97]  Aapo Hyvärinen,et al.  A Linear Non-Gaussian Acyclic Model for Causal Discovery , 2006, J. Mach. Learn. Res..

[98]  Xu Xiaojie Linear and Nonlinear Causality between Corn Cash and Futures Prices , 2018 .

[99]  Yihao Zhang,et al.  Real estate price forecasting based on SVM optimized by PSO , 2014 .

[100]  Xu Xiaojie Using Local Information to Improve Short-Run Corn Price Forecasts , 2018 .

[101]  Jian Yang,et al.  Nonlinearity, data-snooping, and stock index ETF return predictability , 2010, Eur. J. Oper. Res..

[102]  Tarık Türk,et al.  The Use of Artificial Neural Networks (ANN) in Forecasting Housing Prices in Ankara, Turkey , 2017 .

[103]  Ahmed Khalafallah,et al.  Neural Network Based Model for Predicting Housing Market Performance , 2008 .

[104]  Lifeng Wu,et al.  Predicting housing prices in China based on modified Holt's exponential smoothing incorporating whale optimization algorithm , 2020 .

[105]  Suriatini Ismail,et al.  THE ARTIFICIAL NEURAL NETWORK MODEL (ANN) FOR MALAYSIAN HOUSING MARKET ANALYSIS , 2019, PLANNING MALAYSIA JOURNAL.

[106]  Mohammad Hossein Rafiei,et al.  A Novel Machine Learning Model for Estimation of Sale Prices of Real Estate Units , 2016 .

[107]  Hans-Jörg von Mettenheim,et al.  Forecasting Government Bond Yields with Neural Networks Considering Cointegration , 2016 .

[108]  Simon Fong,et al.  Forecasting the REITs and stock indices: Group Method of Data Handling Neural Network approach , 2017 .

[109]  Xiaojie Xu Using Local Information to Improve Short-Run Corn Price Forecasts , 2018 .

[110]  Leonid N. Yasnitsky,et al.  The Complex Neural Network Model for Mass Appraisal and Scenario Forecasting of the Urban Real Estate Market Value That Adapts Itself to Space and Time , 2021, Complex..

[111]  Jieh-Haur Chen,et al.  Forecasting spatial dynamics of the housing market using Support Vector Machine , 2017 .

[112]  K. Lam,et al.  An Artificial Neural Network and Entropy Model for Residential Property Price Forecasting in Hong Kong , 2008 .

[113]  Xiaojie Xu,et al.  Forecasting Local Grain Prices: An Evaluation of Composite Models in 500 Corn Cash Markets , 2015 .

[114]  D. Kaur,et al.  A Comparative Study of Different Curve Fitting Algorithms in Artificial Neural Network using Housing Dataset , 2018, NAECON 2018 - IEEE National Aerospace and Electronics Conference.