Real-Time Information Derivation from Big Sensor Data via Edge Computing

In data-intensive real-time applications, e.g., cognitive assistance and mobile health (mHealth), the amount of sensor data is exploding. In these applications, it is desirable to extract value-added information, e.g., mental or physical health conditions, from sensor data streams in real-time rather than overloading users with massive raw data. However, achieving the objective is challenging due to the data volume and complex data analysis tasks with stringent timing constraints. Most existing big data management systems, e.g., Hadoop, are not directly applicable to real-time sensor data analytics, since they are timing agnostic and focus on batch processing of previously stored data that are potentially outdated and subject to I/O overheads. Moreover, embedded sensors and IoT devices lack enough resources to perform sophisticated data analytics. To address the problem, we design a new real-time big data management framework to support periodic in-memory real-time sensor data analytics at the network edge by extending the map-reduce model originated in functional programming, while providing adaptive sensor data transfer to the edge server based on data importance. In this paper, a prototype system is designed and implemented as a proof of concept. In the performance evaluation, it is empirically shown that important sensor data are delivered in a preferred manner and they are analyzed in a timely fashion.

[1]  Anirban Basu,et al.  Deadline constrained Cost Effective Workflow scheduler for Hadoop clusters in cloud datacenter , 2016, 2016 International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS).

[2]  Rashmi Q Learning Based Workflow Scheduling in Hadoop , 2017 .

[3]  Michael D. Ernst,et al.  HaLoop , 2010, Proc. VLDB Endow..

[4]  Lothar Thiele,et al.  End-to-End Real-Time Guarantees in Wireless Cyber-Physical Systems , 2016, 2016 IEEE Real-Time Systems Symposium (RTSS).

[5]  János Tapolcai,et al.  A resource-aware and time-critical IoT framework , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[6]  Chenyang Lu,et al.  Parallel Real-Time Scheduling of DAGs , 2014, IEEE Transactions on Parallel and Distributed Systems.

[7]  Jane W.-S. Liu Real-Time Systems , 2000, Encyclopedia of Algorithms.

[8]  Sanjoy K. Baruah,et al.  A Categorization of Real-Time Multiprocessor Scheduling Problems and Algorithms , 2004, Handbook of Scheduling.

[9]  Chien-Fu Cheng,et al.  Data gathering problem with the data importance consideration in Underwater Wireless Sensor Networks , 2017, J. Netw. Comput. Appl..

[10]  Aakanksha Chowdhery,et al.  The Design and Implementation of a Wireless Video Surveillance System , 2015, MobiCom.

[11]  Mubashir Husain Rehmani,et al.  Mobile Edge Computing: Opportunities, solutions, and challenges , 2017, Future Gener. Comput. Syst..

[12]  Lui Sha,et al.  Real-time communication and coordination in embedded sensor networks , 2003, Proc. IEEE.

[13]  Richard S. Bird,et al.  Introduction to functional programming , 1988, Prentice Hall International series in computer science.

[14]  Alan Burns,et al.  A survey of hard real-time scheduling for multiprocessor systems , 2011, CSUR.

[15]  Anis Yazidi,et al.  Cost Efficient Batch Processing in Amazon Cloud with Deadline Awareness , 2017, 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA).

[16]  Song Han,et al.  Improving Control Performance by Minimizing Jitter in RT-WiFi Networks , 2014, 2014 IEEE Real-Time Systems Symposium.

[17]  Vlado Handziski,et al.  Industrial Wireless IP-Based Cyber –Physical Systems , 2016, Proceedings of the IEEE.

[18]  Song Han,et al.  RT-WiFi: Real-Time High-Speed Communication Protocol for Wireless Cyber-Physical Control Applications , 2013, 2013 IEEE 34th Real-Time Systems Symposium.

[19]  Pablo Basanta-Val,et al.  Patterns for Distributed Real-Time Stream Processing , 2017, IEEE Transactions on Parallel and Distributed Systems.

[20]  Rodrigo Fonseca,et al.  C-MR: continuously executing MapReduce workflows on multi-core processors , 2012, MapReduce '12.

[21]  Yon Dohn Chung,et al.  Parallel data processing with MapReduce: a survey , 2012, SGMD.

[22]  Indranil Gupta,et al.  WOHA: Deadline-Aware Map-Reduce Workflow Scheduling Framework over Hadoop Clusters , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[23]  Kemafor Anyanwu,et al.  Scheduling Hadoop Jobs to Meet Deadlines , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[24]  Charles U. Martel,et al.  On non-preemptive scheduling of period and sporadic tasks , 1991, [1991] Proceedings Twelfth Real-Time Systems Symposium.

[25]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[26]  Zhao Li,et al.  Scheduling real-time workflow on MapReduce-based cloud , 2013, Third International Conference on Innovative Computing Technology (INTECH 2013).

[27]  Tei-Wei Kuo,et al.  Similarity-based load adjustment for real-time data-intensive applications , 1997, Proceedings Real-Time Systems Symposium.

[28]  Mahadev Satyanarayanan,et al.  Edge Computing , 2017, Computer.

[29]  Dimosthenis Kyriazis,et al.  Dynamic QoS-aware data replication in grid environments based on data "importance" , 2012, Future Gener. Comput. Syst..

[30]  Kyoung-Don Kang,et al.  A Framework for Real-Time Information Derivation from Big Sensor Data , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[31]  Mahadev Satyanarayanan,et al.  The Case for Offload Shaping , 2015, HotMobile.

[32]  Insup Lee,et al.  An empirical analysis of scheduling techniques for real-time cloud-based data processing , 2011, 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[33]  Honghai Liu,et al.  Intelligent Video Systems and Analytics: A Survey , 2013, IEEE Transactions on Industrial Informatics.

[34]  Thomas Watteyne,et al.  Orchestra: Robust Mesh Networks Through Autonomously Scheduled TSCH , 2015, SenSys.

[35]  Xianguo Zhang,et al.  The IEEE 1857 Standard: Empowering Smart Video Surveillance Systems , 2014, IEEE Intelligent Systems.

[36]  Chenyang Lu,et al.  Analysis of Federated and Global Scheduling for Parallel Real-Time Tasks , 2014, 2014 26th Euromicro Conference on Real-Time Systems.

[37]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[38]  Yixin Chen,et al.  Real-Time Wireless Sensor-Actuator Networks for Industrial Cyber-Physical Systems , 2016, Proceedings of the IEEE.