Modeling IoT Equipment With Graph Neural Networks

Traditional neural networks usually concentrate on temporal data in system simulation, and lack of capabilities to reason inner logic relations between different dimensions of data collected from embedded sensors. This paper proposes a graph neural network-based modeling approach for IoT equipment (called GNNM-IoT), which considers both temporal and inner logic relations of data, in which vertices denote sensor data and edges denote relationships between vertices. The GNNM-IoT model’s relationships between sensors with neural networks to produce nonlinear complex relationships. We have evaluated the GNNM-IoT using air-conditioner data from a world leading IoT company, which demonstrates that it is effective and outperforms ARIMA and LSTM methods.

[1]  Feng Xia,et al.  Resource requests prediction in the cloud computing environment with a deep belief network , 2017, Softw. Pract. Exp..

[2]  António E. Ruano,et al.  Prediction of building's temperature using neural networks models , 2006 .

[3]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[4]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[5]  Maohua Wang,et al.  Support vector machines regression and modeling of greenhouse environment , 2009 .

[6]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[7]  Victor C. M. Leung,et al.  Social Sensor Cloud: Framework, Greenness, Issues, and Outlook , 2018, IEEE Network.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Yitao Liu,et al.  Deep Learning-Based Interval State Estimation of AC Smart Grids Against Sparse Cyber Attacks , 2018, IEEE Transactions on Industrial Informatics.

[10]  Masanobu Inubushi,et al.  Reservoir Computing Beyond Memory-Nonlinearity Trade-off , 2017, Scientific Reports.

[11]  L. Bouirden,et al.  Prediction of the intern parameters tomato greenhouse in a semi-arid area using a time-series model of artificial neural networks , 2009 .

[12]  Igor Melnyk,et al.  Deep learning algorithm for data-driven simulation of noisy dynamical system , 2018, J. Comput. Phys..

[13]  Yitao Liu,et al.  Deep learning based ensemble approach for probabilistic wind power forecasting , 2017 .

[14]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[15]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[16]  Chenxi Liu,et al.  Deep Nets: What have They Ever Done for Vision? , 2018, International Journal of Computer Vision.

[17]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[18]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[19]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Rameen AbdelHady,et al.  Modeling and simulation of a micro grid-connected solar PV system , 2017 .

[21]  Abbas Rohani,et al.  Applied machine learning in greenhouse simulation; new application and analysis , 2018, Information Processing in Agriculture.

[22]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[23]  Morteza Taki,et al.  An Analysis of Energy input-output and Emissions of Greenhouse Gases from Agricultural Productions , 2012 .

[24]  Jaideep Pathak,et al.  Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach. , 2018, Physical review letters.

[25]  L. Mili,et al.  Electric Load Forecasting Based on Statistical Robust Methods , 2011, IEEE Transactions on Power Systems.

[26]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[29]  Zheng Yi Wu,et al.  Optimized Deep Learning Framework for Water Distribution Data-Driven Modeling , 2017 .

[30]  Ahmet Teke,et al.  A state-of-the-art review of artificial intelligence techniques for short-term electric load forecasting , 2017, 2017 6th International Youth Conference on Energy (IYCE).

[31]  Tyrus Berry,et al.  Ensemble Kalman Filtering without a Model , 2016 .

[32]  Bo Li,et al.  LSTM-Based Analysis of Industrial IoT Equipment , 2018, IEEE Access.

[33]  Michael S. Horn,et al.  Defining Computational Thinking for Mathematics and Science Classrooms , 2016 .

[34]  Weishan Zhang,et al.  PARMTRD: Parallel Association Rules Based Multiple-Topic Relationships Detection , 2018, ICWS.

[35]  Xavier Pelorson,et al.  Theoretical simulation and experimental validation of inverse quasi-one-dimensional steady and unsteady glottal flow models. , 2008, The Journal of the Acoustical Society of America.

[36]  Jonathan Berant,et al.  Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction , 2018, NeurIPS.

[37]  Georg Frey,et al.  Modeling and simulation of local flexibilities and their effect to the entire power system , 2018, Computer Science - Research and Development.

[38]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[39]  Joohyung Lee,et al.  Deep Learning Based Pilot Allocation Scheme (DL-PAS) for 5G Massive MIMO System , 2018, IEEE Communications Letters.

[40]  Reza Abdi,et al.  Study on Energy Use Pattern, Optimization of Energy Consumption and CO2 Emission For Greenhouse Tomato Production , 2013 .

[41]  Xin Zhang,et al.  Modeling of nonlinear system based on deep learning framework , 2016 .

[42]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[43]  Mianxiong Dong,et al.  When Weather Matters: IoT-Based Electrical Load Forecasting for Smart Grid , 2017, IEEE Communications Magazine.

[44]  Baihai Zhang,et al.  Verification and predicting temperature and humidity in a solar greenhouse based on convex bidirectional extreme learning machine algorithm , 2017, Neurocomputing.

[45]  Tyrus Berry,et al.  Predicting chaotic time series with a partial model. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.