Predicting agricultural and livestock products purchases using the Internet search index and data mining techniques

PurposeThis study identifies whether the Internet search index can be used as effective enough data to identify agricultural and livestock product demand and compare the accuracy of the prediction of major agricultural and livestock products purchases between these prediction models using artificial neural network, linear regression and a decision tree.Design/methodology/approachArtificial neural network, linear regression and decision tree algorithms were used in this study to compare the accuracy of the prediction of major agricultural and livestock products purchases. The analysis data were studied using 10-fold cross validation.FindingsFirst, the importance of the Internet search index among the 20 explanatory variables was found to be high for most items, so the Internet search index can be used as a variable to explain agricultural and livestock products purchases. Second, as a result of comparing the accuracy of the prediction of six agricultural and livestock purchases using three models, beef was the most predictable, followed by radishes, chicken, Chinese cabbage, garlic and dried peppers, and by model, a decision tree shows the highest accuracy of prediction, followed by linear regression and an artificial neural network.Originality/valueThis study is meaningful in that it analyzes the purchase of agricultural and livestock products using data from actual consumers' purchases of agricultural and livestock products. In addition, the use of data mining techniques and Internet search index in the analysis of agricultural and livestock purchases contributes to improving the accuracy and efficiency of agricultural and livestock purchase predictions.

[1]  Torsten Schmidt,et al.  A monthly consumption indicator for Germany based on Internet search query data , 2010 .

[2]  Yuqing Zheng,et al.  Nowcasting Food Stock Movement using Food Safety Related Web Search Queries , 2018 .

[3]  A monthly consumption indicator for Germany based on Internet search query data , 2012 .

[4]  Yongmoo Suh,et al.  Identifying financial statement fraud with decision rules obtained from Modified Random Forest , 2020, Data Technol. Appl..

[5]  sungju Yun,et al.  Development of Price Forecast Models for International Grains Using Artificial Neural Networks , 2016 .

[6]  H. Varian,et al.  Predicting the Present with Google Trends , 2009 .

[7]  C. Lee Giles,et al.  A Strategic Perspective on Search Engines: Thought Candies for Practitioners and Researchers , 2009 .

[8]  David M. Pennock,et al.  Using internet searches for influenza surveillance. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[9]  Jeremy Ginsberg,et al.  Detecting influenza epidemics using search engine query data , 2009, Nature.

[10]  Michael J Gibney,et al.  Analysis of meal patterns with the use of supervised data mining techniques--artificial neural networks and decision trees. , 2008, The American journal of clinical nutrition.

[11]  Peter Molnár,et al.  Google Searches and Stock Returns , 2016 .

[12]  Minsoo Kim,et al.  A Study on Big Data Based Investment Strategy Using Internet Search Trends , 2013 .

[13]  H. Varian,et al.  Predicting the Present with Google Trends , 2012 .

[14]  Juri Marcucci,et al.  The Predictive Power of Google Searches in Forecasting Unemployment , 2012 .

[15]  Juyoung Song,et al.  Multivariate Analysis of Factors for Search on Suicide Using Social Big Data , 2013 .

[16]  Muhammad Shahid Iqbal,et al.  Agricultural Fruit Prediction Using Deep Neural Networks , 2020 .

[17]  John H. Gerdes,et al.  Using web-based search data to predict macroeconomic statistics , 2005, CACM.

[18]  김대원,et al.  A Dynamic Relationship Between Internet Search Activity, Housing Price, and Trading Volume , 2014 .

[19]  Amulya Yadav,et al.  Improving Lives of Indebted Farmers Using Deep Learning: Predicting Agricultural Produce Prices Using Convolutional Neural Networks , 2020, AAAI.

[20]  H Eugene Stanley,et al.  Complex dynamics of our economic life on different scales: insights from search engine query data , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.