BigClue Analytics: A Middleware Component for Modeling Sensor Data in IoT Systems

The typology of most IoT projects requires data processing to be handled in a low latency scenario. In this article we first introduce BigClue, a middle-ware capable of collecting, processing and modeling sensor data in such a scenario. Then we present BigClue Analytics, a specialized component which is part of the middle-ware that has multiple features: data modeling, data prediction, anomaly detection and sensor correlation. While our experimental work is validated in a greenhouse environment the intention is to extend its applicability to other problem domains.

[1]  Mark Roantree,et al.  A framework for real-time context provision in ubiquitous sensing environments , 2010, The IEEE symposium on Computers and Communications.

[2]  V. R. Thool,et al.  Big data in precision agriculture: Weather forecasting for future farming , 2015, 2015 1st International Conference on Next Generation Computing Technologies (NGCT).

[3]  藤井 光昭,et al.  Autoregressive Integrated Moving Average (p,d,q)モデルについて (時系列解析の推測 : 理論と応用) , 1981 .

[4]  Jae-Hun Kim,et al.  SCONSTREAM: A Spatial Context Stream Processing System , 2010, 2010 International Conference on Computational Science and Its Applications.

[5]  Ravindra C. Thool,et al.  Big Data in Precision Agriculture Through ICT: Rainfall Prediction Using Neural Network Approach , 2016 .

[6]  Chandra Krintz,et al.  SmartFarm : Improving Agriculture Sustainability Using Modern Information Technology , 2016 .

[7]  P. Eredics,et al.  Data Cleaning and Anomaly Detection for an Intelligent Greenhouse , 2012 .

[8]  Yang Zhang,et al.  The CarTel mobile sensor computing system , 2006, SenSys '06.

[9]  Foster J. Provost,et al.  Predictive Modeling With Big Data: Is Bigger Really Better? , 2013, Big Data.

[10]  Minrui Fei,et al.  The Application of Spark-Based Gaussian Mixture Model for Farm Environmental Data Analysis , 2016 .

[11]  Markus Endler,et al.  Middleware: Context Management in Heterogeneous, Evolving Ubiquitous Environments , 2006, IEEE Distributed Systems Online.

[12]  Everette S. Gardner,et al.  Exponential smoothing: The state of the art , 1985 .

[13]  Florin Pop,et al.  Soil Management Services in CLUeFARM , 2015, 2015 14th International Symposium on Parallel and Distributed Computing.

[14]  Tarek F. Abdelzaher,et al.  GreenGPS: a participatory sensing fuel-efficient maps application , 2010, MobiSys '10.

[15]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[16]  Miriam A. M. Capretz,et al.  Contextual Anomaly Detection in Big Sensor Data , 2014, 2014 IEEE International Congress on Big Data.

[17]  Kirthi Kalyanam,et al.  Future Store Technologies and Their Impact on Grocery Retailing , 2006 .

[18]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .