Investigation in the influences of public opinion indicators on vegetable prices by corpora construction and WeChat article analysis

Abstract In China, vegetable production plays a critical role directly to national economics and social stability. With the rapid development of social media, public opinions through the Internet is transmitted to the vegetable market in a direct way Previously, focus of most systems was to investigate whether large scale network public opinion is capable of affecting or predicting vegetable price changes. In this paper, we analysed the impact of network public opinions based on a hybrid research strategy. The strategy combined natural language processing (NLP), convolutional neural network (CNN) and classic economic methods. First, we designed corpora indicating different domains of the vegetable market, including supply, demand, natural environment, and government policy; second, we used CNN to perform the topic modelling upon public opinions in a large scale; Third, we investigated vegetable prices volatility with Granger causality test on account of time-lag effects, and results show the correlation between vegetable prices and three public opinion indicators, i.e. demand, supply and natural environment. A subsequent multiple linear regression model augmented the results. Eventually, two linear and three nonlinear predictive models were presented. Results suggested that there is a weak linear correlation between vegetable prices and these three public opinion indicators. This indicated that network public opinions have a potential impact on vegetable prices volatility and can be treated as potential factor to predict vegetable prices.

[1]  Jianfeng Guo,et al.  How Does Market Concern Derived from the Internet Affect Oil Prices? , 2013 .

[2]  S. Fan,et al.  Anatomy of a crisis: The causes and consequences of surging food prices , 2008 .

[3]  Rockbill Haklak,et al.  Quantitative evaluation of positive or negative feelings for biotechnology- or health-related scenes in movies , 2006, Scientometrics.

[4]  A. Marshall Principles of Economics: An Introductory Volume , 1949 .

[5]  Xiangji Huang,et al.  Mining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain , 2012, IEEE Transactions on Knowledge and Data Engineering.

[6]  Ting Liu,et al.  A Gaussian Copula Regression Model for Movie Box-office Revenue Prediction with Social Media , 2015, SMP.

[7]  J. Torrie,et al.  Principles and Procedures of Statistics with Special Reference to the Biological Sciences , 1962 .

[8]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[9]  G. M. Nasira,et al.  Radial basis function model for vegetable price prediction , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.

[10]  Nikos Alexandratos,et al.  Food Price Surges: Possible Causes, Past Experience, and Longer Term Relevance , 2008 .

[11]  Victor Chang,et al.  A proposed social network analysis platform for big data analytics , 2017 .

[12]  Victor I. Chang,et al.  Towards data analysis for weather cloud computing , 2017, Knowl. Based Syst..

[13]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[14]  Ramanathan V. Guha,et al.  The predictive power of online chatter , 2005, KDD '05.

[15]  Jingbo Xia,et al.  Construction of an Early-Warning System for Vegetable Prices Based on Index Contribution Analysis , 2015 .

[16]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[17]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[18]  Do ilYoo Vegetable Price Prediction Using Unstructured Web-Based Data: An Application to Garlic, Onion, and Pepper in Korea , 2016 .

[19]  R. Lamm,et al.  The Effects of Changing Input Costs on Food Prices , 1981 .

[20]  Xin Li,et al.  How does Google search affect trader positions and crude oil prices , 2015 .

[21]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[22]  Véronique Hoste,et al.  Fine-grained analysis of explicit and implicit sentiment in financial news articles , 2015, Expert Syst. Appl..

[23]  Victor I. Chang,et al.  Organisational sustainability modelling - An emerging service and analytics model for evaluating Cloud Computing adoption with two case studies , 2016, Int. J. Inf. Manag..

[24]  Liang Weihong,et al.  Vegetable Price Prediction Based on PSO-BP Neural Network , 2015, 2015 8th International Conference on Intelligent Computation Technology and Automation (ICICTA).

[25]  Victor I. Chang,et al.  The Business Intelligence as a Service in the Cloud , 2014, Future Gener. Comput. Syst..

[26]  Pei-Chann Chang,et al.  Using a contextual entropy model to expand emotion words and their intensity for the sentiment classification of stock market news , 2013, Knowl. Based Syst..

[27]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[28]  Patrick Paroubek,et al.  Twitter as a Corpus for Sentiment Analysis and Opinion Mining , 2010, LREC.

[29]  J. Subić,et al.  Economic effectiveness of activities of vegetable growers’ associations in Serbia , 2008 .

[30]  Yan Song,et al.  Research on agricultural monitoring system based on convolutional neural network , 2018, Future Gener. Comput. Syst..

[31]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[32]  Michael K. Wohlgenant,et al.  Competitive Storage, Rational Expectations, and Short-Run Food Price Determination , 1985 .

[33]  Wu Tie-jun,et al.  Support Vector Machines for Regression , 2003 .

[34]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[35]  Dr. R. R. Sedamkar,et al.  A Model for Predicting Movie’s Performance using Online Rating and Revenue , 2013 .

[36]  Muthu Ramachandran,et al.  Financial Modeling and Prediction as a Service , 2017, Journal of Grid Computing.