Storage and retrieval of massive heterogeneous IoT data based on hybrid storage

With the rapid development of the Internet of Things (IoT), the IoT is characterized by a wide variety of data sources, large scale and heterogeneous structure. But those characteristics bring great difficulties to the storage and rapid retrieval of IoT data. By considering the common attributes of IoT data, based on plug-in ideas, combined with Redis and HBase, the paper proposes a framework named HSFRH-IoT, which solves the problem of efficient storage and retrieval of massive heterogeneous IOT. Finally, the insertion and query performance of the proposed HSFRH-IoT framework is tested in detail, and the results shows that it has better performance than other RDBMS based solutions.

[1]  Christian Bonnet,et al.  oneM2M architecture based IoT framework for mobile crowd sensing in smart cities , 2016, 2016 European Conference on Networks and Communications (EuCNC).

[2]  Sun Yu,et al.  Mobile Crowd Sensing for Internet of Things: A Credible Crowdsourcing Model in Mobile-Sense Service , 2015 .

[3]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[4]  Tao Liu,et al.  The application of IOT in medical system , 2011, 2011 IEEE International Symposium on IT in Medicine and Education.

[5]  Sajal K. Das,et al.  A Storage Infrastructure for Heterogeneous and Multimedia Data in the Internet of Things , 2012, 2012 IEEE International Conference on Green Computing and Communications.

[6]  John R. Williams,et al.  A Comparative Study of Data Storage and Processing Architectures for the Smart Grid , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[7]  Chao Li,et al.  SemanMedical: A kind of semantic medical monitoring system model based on the IoT sensors , 2012, 2012 IEEE 14th International Conference on e-Health Networking, Applications and Services (Healthcom).

[8]  Ganggang Zhang,et al.  Improving the Efficiency of Storing for Small Files in HDFS , 2012, 2012 International Conference on Computer Science and Service System.

[9]  Diego Klabjan,et al.  Warehousing and Analyzing Massive RFID Data Sets , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[10]  Yang Zhang,et al.  Improving the Efficiency of Storing for Small Files in HDFS , 2012 .

[11]  Dirk Meister,et al.  hashFS: Applying Hashing to Optimize File Systems for Small File Reads , 2010, 2010 International Workshop on Storage Network Architecture and Parallel I/Os.

[12]  Yu Sun,et al.  Mobile Crowd Sensing for Internet of Things: A Credible Crowdsourcing Model in Mobile-Sense Service , 2015, 2015 IEEE International Conference on Multimedia Big Data.

[13]  A. Anusha,et al.  Online Monitoring Of Geological Co2 Storage And Leakage Based On Wireless Sensor Networks , 2014 .

[14]  Gunter Saake,et al.  Research Directions in Database Architectures for the Internet of Things: A Communication of the First International Workshop on Database Architectures for the Internet of Things (DAIT 2009) , 2009, BNCOD.

[15]  Wei Wang,et al.  Optimizing the storage of massive electronic pedigrees in HDFS , 2012, 2012 3rd IEEE International Conference on the Internet of Things.

[16]  Chenxue Xu,et al.  A Development Analysis of China's Intelligent Transportation System , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[17]  Tsan-Pin Wang,et al.  Supporting Personal Mobility with Integrated RFID in VoIP Systems , 2009, 2009 International Conference on New Trends in Information and Service Science.

[18]  Yuan Quan,et al.  Research on the framework of the Environmental Internet of Things , 2013 .

[19]  Duan Yan-e,et al.  Design of Intelligent Agriculture Management Information System Based on IoT , 2011, 2011 Fourth International Conference on Intelligent Computation Technology and Automation.

[20]  Keith Jeffery.  The Internet of Things: The Death of a Traditional Database? , 2009 .

[21]  Zhi-Ming Ding,et al.  A Database Cluster System Framework for Managing Massive Sensor Sampling Data in the Internet of Things , 2012 .