GradeSense: Gradation Aware Storage for Robust Activity Recognition in a Multimodal Smarthome

A wide range of multimodal sensors such as sensors, video cameras, wearables worn by users in an IoT powered smarthome provide important albeit huge amount of data through which applications derive meaningful Activities of Daily Living (ADLs). Storing this massive amount of data is a significant challenge for efficient execution of the corresponding applications to meet real-time demands; there is scope for improving it as it is found that a substantial amount of the data produced may be unimportant. In this paper, we propose an end-to-end system GradeSense, which implements a grading mechanism based on multimodal data fusion by categorizing ‘important’ data. GradeSense is made complete by an applicationindependent storage module that leverages our grading scheme (as opposed to traditional usage-based models) for efficient storing. Activity prediction algorithms perform well (up to 17% improvement) with this now-fused and important data which is a mere fraction of the entire data, achieving 87% data reduction on average in faster storage tier. The throughput of GradeSense, measured through runtime, gives improvement up to 46% due to our enhanced data-categorization and storing mechanism.

[1]  Gang Chen,et al.  Adaptive Logging: Optimizing Logging and Recovery Costs in Distributed In-memory Databases , 2016, SIGMOD Conference.

[2]  Takashi Toriu,et al.  A Markov Random Walk Model for Loitering People Detection , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[3]  Laura Cabrera-Quiros,et al.  Gestures In-The-Wild: Detecting Conversational Hand Gestures in Crowded Scenes Using a Multimodal Fusion of Bags of Video Trajectories and Body Worn Acceleration , 2020, IEEE Transactions on Multimedia.

[4]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[5]  Zhu Han,et al.  Computation Offloading With Data Caching Enhancement for Mobile Edge Computing , 2018, IEEE Transactions on Vehicular Technology.

[6]  Bernard Ghanem,et al.  ActivityNet: A large-scale video benchmark for human activity understanding , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Anthony Fleury,et al.  Smart Sweet Home… A Pervasive Environment for Sensing our Daily Activity? , 2011 .

[8]  Steven Swanson,et al.  Ziggurat: A Tiered File System for Non-Volatile Main Memories and Disks , 2019, FAST.

[9]  Nasser Kehtarnavaz,et al.  UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  Raghupathy Sivakumar,et al.  A 3: application-aware acceleration for wireless data networks , 2006, MobiCom '06.

[11]  A. Rosenfeld,et al.  Background Subtraction Algorithm Based Human Motion Detection , 2013 .

[12]  Chia-Wen Lin,et al.  Automatic Fall Incident Detection in Compressed Video for Intelligent Homecare , 2007, 2007 16th International Conference on Computer Communications and Networks.

[13]  Morteza Hoseinzadeh,et al.  A Survey on Tiering and Caching in High-Performance Storage Systems , 2019, ArXiv.

[14]  Rupali S. Rakibe,et al.  Background Subtraction Algorithm Based Human Behavior Detection , 2014 .

[15]  Enrique Saurez,et al.  Incremental deployment and migration of geo-distributed situation awareness applications in the fog , 2016, DEBS.

[16]  Philipp Leitner,et al.  Optimized IoT service placement in the fog , 2017, Service Oriented Computing and Applications.

[17]  Giovanni Cherubini,et al.  Cognitive Storage for Big Data , 2016, Computer.

[18]  Shuang Wang,et al.  A Review on Human Activity Recognition Using Vision-Based Method , 2017, Journal of healthcare engineering.

[19]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[20]  Hyojun Kim,et al.  Evaluating Phase Change Memory for Enterprise Storage Systems: A Study of Caching and Tiering Approaches , 2014, TOS.

[21]  Zhuo Chen,et al.  Edge Analytics in the Internet of Things , 2015, IEEE Pervasive Computing.

[22]  Michel Vacher,et al.  SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results , 2010, IEEE Transactions on Information Technology in Biomedicine.

[23]  Beng Chin Ooi,et al.  In-Memory Big Data Management and Processing: A Survey , 2015, IEEE Transactions on Knowledge and Data Engineering.

[24]  Salvatore Venticinque,et al.  A methodology for deployment of IoT application in fog , 2018, Journal of Ambient Intelligence and Humanized Computing.

[25]  Thomas E. Anderson,et al.  Strata: A Cross Media File System , 2017, SOSP.

[26]  Jian Xu,et al.  NOVA: A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories , 2016, FAST.

[27]  Artem Katasonov,et al.  Smart Semantic Middleware for the Internet of Things , 2008, ICINCO-ICSO.