A cloud platform for big IoT data analytics by combining batch and stream processing technologies

The Internet of things is a current major developing technology, which is a network of everyday physical objects that enhances the quality of lifestyle. Application of the internet of things encounters dealing with huge amount of data. One of the directions of big data is this huge amount of data with respect to the internet of things. As the name implies, big data refers to the data that cannot be analyzed by a traditional data processing software. The key challenge of this phenomenon is to use a proper way to analyse, which can provide useful features from the data absorbed by the perception layer of the internet of things in order to provide feedback to end users, which helps them in better decision making and improves the performance of the corresponding internet of things network. Analysis of big data in the internet of things is obviously a hard task. Data storages are distributed and there should be parallel data processing. Transmission of the data across the network can slow down because of the massive amount of data. In this regard, this paper focuses on how to analyze the massive and heterogeneous data of the internet of things in a proper way. At first, the internet of things and the big data are discussed separately with architectures, applications, challenges etc. Since these two technologies are interrelated, data analysis in the internet of things is discussed with various methodologies and challenges-Finally, the study discusses a proper framework that can analyze the big data in the internet of things in an efficient way.

[1]  Srinath Perera,et al.  Big Data Analytics Platforms for Real-Time Applications in IoT , 2016 .

[2]  Manuel Díaz,et al.  \lambda -CoAP: An Internet of Things and Cloud Computing Integration Based on the Lambda Architecture and CoAP , 2015, CollaborateCom.

[3]  Anirban Kundu,et al.  Experimental Analysis on Big Data in IOT-Based Architecture , 2017 .

[4]  V. Markl,et al.  Security Framework for Distributed Data Processing , 2016 .

[5]  Dave Evans,et al.  How the Next Evolution of the Internet Is Changing Everything , 2011 .

[6]  Ciprian Dobre,et al.  The Art of Advanced Healthcare Applications in Big Data and IoT Systems , 2017 .

[7]  Xike Xie,et al.  Survey of real-time processing systems for big data , 2014, IDEAS.

[8]  Parth Goel The Internet of Things: A Main Source of Big Data Analytics , 2017 .

[9]  Antonio Puliafito,et al.  AllJoyn Lambda: An architecture for the management of smart environments in IoT , 2014, 2014 International Conference on Smart Computing Workshops.

[10]  Athanasios V. Vasilakos,et al.  IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and Challenges , 2017, IEEE Internet of Things Journal.

[11]  Felix Wortmann,et al.  Internet of Things , 2015, Business & Information Systems Engineering.

[12]  Houbing Song,et al.  Internet of Things and Big Data Analytics for Smart and Connected Communities , 2016, IEEE Access.

[13]  Dimitris Mourtzis,et al.  Industrial Big Data as a Result of IoT Adoption in Manufacturing , 2016 .

[14]  Inder Monga,et al.  Lambda architecture for cost-effective batch and speed big data processing , 2015, 2015 IEEE International Conference on Big Data (Big Data).