From Offline to Real-Time Distributed Activity Recognition in Wireless Sensor Networks for Healthcare: A Review

This review presents the state of the art and a global overview of research challenges of real-time distributed activity recognition in the field of healthcare. Offline activity recognition is discussed as a starting point to establish the useful concepts of the field, such as sensor types, activity labeling and feature extraction, outlier detection, and machine learning. New challenges and obstacles brought on by real-time centralized activity recognition such as communication, real-time activity labeling, cloud and local approaches, and real-time machine learning in a streaming context are then discussed. Finally, real-time distributed activity recognition is covered through existing implementations in the scientific literature, and six main angles of optimization are defined: Processing, memory, communication, energy, time, and accuracy. This survey is addressed to any reader interested in the development of distributed artificial intelligence as well activity recognition, regardless of their level of expertise.

[1]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[2]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[3]  Kevin Bouchard,et al.  Exploiting Passive RFID Technology for Activity Recognition in Smart Homes , 2015, IEEE Intelligent Systems.

[4]  Antonio F. Gómez-Skarmeta,et al.  Performance Evaluation of LoRa Considering Scenario Conditions , 2018, Sensors.

[5]  Albert Y. Zomaya,et al.  On the Correlation of Sensor Location and Human Activity Recognition in Body Area Networks (BANs) , 2018, IEEE Systems Journal.

[6]  Sajal K. Das,et al.  An Adaptive Bayesian System for Context-Aware Data Fusion in Smart Environments , 2017, IEEE Transactions on Mobile Computing.

[7]  F. Bellifemine,et al.  ASPINE: An Agent-oriented Design of SPINE , 2009, WOA.

[8]  Li-Chen Fu,et al.  Robust Location-Aware Activity Recognition Using Wireless Sensor Network in an Attentive Home , 2009, IEEE Transactions on Automation Science and Engineering.

[9]  J. Bongaarts,et al.  United Nations Department of Economic and Social Affairs, Population Division World Family Planning 2020: Highlights, United Nations Publications, 2020. 46 p. , 2020 .

[10]  Özlem Durmaz Incel,et al.  Multimodal Wireless Sensor Network-Based Ambient Assisted Living in Real Homes with Multiple Residents , 2014, Sensors.

[11]  Yuting Zhang,et al.  Continuous functional activity monitoring based on wearable tri-axial accelerometer and gyroscope , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[12]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Wei Lu,et al.  Wearable Computing for Internet of Things: A Discriminant Approach for Human Activity Recognition , 2019, IEEE Internet of Things Journal.

[14]  Szilveszter Pletl,et al.  Comparison of time- and frequency-domain features for movement classification using data from wrist-worn sensors , 2017, 2017 IEEE 15th International Symposium on Intelligent Systems and Informatics (SISY).

[15]  Logarithmic Incremental Parameter Tuning of Support Vector Machines for Human Activity Recognition , 2016 .

[16]  Zongjian He,et al.  A wearable wireless body area network for human activity recognition , 2014, 2014 Sixth International Conference on Ubiquitous and Future Networks (ICUFN).

[17]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[18]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[19]  Brian Hayes,et al.  What Is Cloud Computing? , 2019, Cloud Technologies.

[20]  Maximiliano Bottazzi,et al.  DT-WBAN: Disruption tolerant wireless body area networks in healthcare applications , 2013, 2013 IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[21]  Kevin Bouchard,et al.  Clustering of human activities from emerging movements , 2018, J. Ambient Intell. Humaniz. Comput..

[22]  Geoff Hulten,et al.  Mining high-speed data streams , 2000, KDD '00.

[23]  Rabindranath Bera,et al.  A Comprehensive Survey on Internet of Things (IoT) Toward 5G Wireless Systems , 2020, IEEE Internet of Things Journal.

[24]  Daniel Roggen,et al.  Limited-Memory Warping LCSS for Real-Time Low-Power Pattern Recognition in Wireless Nodes , 2015, EWSN.

[25]  Jerzy Stefanowski,et al.  Stream Classification , 2017, Encyclopedia of Machine Learning and Data Mining.

[26]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[27]  Girija Chetty,et al.  Body sensor networks for human activity recognition , 2016, 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN).

[28]  Kevin Bouchard,et al.  A More Efficient Transportable and Scalable System for Real-Time Activities and Exercises Recognition , 2018, Sensors.

[29]  Krishna Gopal,et al.  A VERSATILE LATTICE BASED MODEL FOR SITUATION RECOGNITION FROM DYNAMIC AMBIENT SENSORS , 2013 .

[30]  Sungyoung Lee,et al.  A Method for Cricket Bowling Action Classification and Analysis Using a System of Inertial Sensors , 2013, ICCSA.

[31]  Ioannis N. Kouris,et al.  Activity Recognition Using Smartphones and Wearable Wireless Body Sensor Networks , 2011, MobiHealth.

[32]  Abdenour Bouzouane,et al.  Activity inference engine for real-time cognitive assistance in smart environments , 2017, Journal of Ambient Intelligence and Humanized Computing.

[33]  Kevin Bouchard,et al.  Highly Accurate Bathroom Activity Recognition Using Infrared Proximity Sensors , 2019, IEEE Journal of Biomedical and Health Informatics.

[34]  Stefano Chessa,et al.  Multisensor Data Fusion for Activity Recognition Based on Reservoir Computing , 2013, EvAAL.

[35]  Richard Harper,et al.  Inside the Smart Home , 2003, Springer London.

[36]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[37]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[38]  Lochan Verma,et al.  Wifi on steroids: 802.11AC and 802.11AD , 2013, IEEE Wireless Communications.

[39]  Atif Alamri,et al.  An Efficient Activity Recognition Framework: Toward Privacy-Sensitive Health Data Sensing , 2017, IEEE Access.

[40]  Ahmed H. Tewfik,et al.  A feature combination approach for the detection of early morning bathroom activities with wireless sensors , 2007, HealthNet '07.

[41]  Subhas Mukhopadhyay,et al.  Forecasting the behavior of an elderly using wireless sensors data in a smart home , 2013, Eng. Appl. Artif. Intell..

[42]  Gerhard Tröster,et al.  On-body activity recognition in a dynamic sensor network , 2007, BODYNETS.

[43]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[44]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[45]  T. Kuroda,et al.  Human Activity Recognition from Environmental Background Sounds for Wireless Sensor Networks , 2007, 2007 IEEE International Conference on Networking, Sensing and Control.

[46]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[47]  Gamze Uslu,et al.  Medication intake adherence with real time activity recognition on IoT , 2015, 2015 IEEE 11th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[48]  Xiaomu Luo,et al.  Simultaneous Indoor Tracking and Activity Recognition Using Pyroelectric Infrared Sensors , 2017, Sensors.

[49]  Yuto Lim,et al.  RF-ARP: RFID-Based Activity Recognition and Prediction in Smart Home , 2019, 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS).

[50]  Gerhard Tröster,et al.  Recognition of User Activity Sequences Using Distributed Event Detection , 2007, EuroSSC.

[51]  Karl Aberer,et al.  ExposureSense: Integrating daily activities with air quality using mobile participatory sensing , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[52]  Guang-Zhong Yang,et al.  Real-Time Activity Classification Using Ambient and Wearable Sensors , 2009, IEEE Transactions on Information Technology in Biomedicine.

[53]  Muhammed Enes Bayrakdar,et al.  Priority based health data monitoring with IEEE 802.11af technology in wireless medical sensor networks , 2019, Medical & Biological Engineering & Computing.

[54]  Hsueh-Chun Lin,et al.  An Activity Recognition Model Using Inertial Sensor Nodes in a Wireless Sensor Network for Frozen Shoulder Rehabilitation Exercises , 2015, Sensors.

[55]  Asher Shkedi.  Narrative survey: A Methodology for studying multiple populations , 2004 .

[56]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .

[57]  Long Cheng,et al.  Human activity recognition based on compressed sensing , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[58]  R. K. Rayudu,et al.  Applying SARIMA time series to forecast sleeping activity for wellness model of elderly monitoring in smart home , 2012, 2012 Sixth International Conference on Sensing Technology (ICST).

[59]  Hsueh-Chun Lin,et al.  Fuzzy Computing Model of Activity Recognition on WSN Movement Data for Ubiquitous Healthcare Measurement , 2016, Sensors.

[60]  Tinku Mohamed Rasheed,et al.  On the spectrum efficiency of mesh and star topology wide area wireless sensor networks , 2014, 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC).

[61]  Jian Lu,et al.  Real-Time Activity Recognition in Wireless Body Sensor Networks: From Simple Gestures to Complex Activities , 2010, 2010 IEEE 16th International Conference on Embedded and Real-Time Computing Systems and Applications.

[62]  Seok-Won Lee,et al.  User-Independent Activity Recognition via Three-Stage GA-Based Feature Selection , 2014, Int. J. Distributed Sens. Networks.

[63]  Nitinder Mohan,et al.  Edge-Fog cloud: A distributed cloud for Internet of Things computations , 2016, 2016 Cloudification of the Internet of Things (CIoT).

[64]  甘堯江,et al.  An Activity Recognition Model Using Inertial Sensor Nodes in a Wireless Sensor Network for Frozen Shoulder Rehabilitation Exercises , 2015 .

[65]  Li-Chen Fu,et al.  Context-aware activity prediction using human behavior pattern in real smart home environments , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[66]  Zhigang Liu,et al.  Human daily activity recognition based on online sequential extreme learning machine , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[67]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[68]  Bala Srinivasan,et al.  Activity Recognition with Evolving Data Streams , 2018, ACM Comput. Surv..

[69]  V. Vaidehi,et al.  Sensor based efficient decision making framework for remote healthcare , 2015, J. Ambient Intell. Smart Environ..

[70]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[71]  Urbashi Mitra,et al.  Multimodal Physical Activity Recognition by Fusing Temporal and Cepstral Information , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[72]  Matthias Wagner,et al.  Using Machine Learning Techniques for User Specific Activity Recognition , 2016, INC.

[73]  Ian Craddock,et al.  A dataset for room level indoor localization using a smart home in a box , 2019, Data in brief.

[74]  Jiming Chen,et al.  On Optimal Scheduling in Wireless Rechargeable Sensor Networks for Stochastic Event Capture , 2011, 2011 IEEE Eighth International Conference on Mobile Ad-Hoc and Sensor Systems.

[75]  Ignas G. Niemegeers,et al.  IEEE 802.11ah: Advantages in standards and further challenges for sub 1 GHz Wi-Fi , 2012, 2012 IEEE International Conference on Communications (ICC).

[76]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[77]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[78]  Simon A. Dobson,et al.  Fault detection for binary sensors in smart home environments , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[79]  Emilio Parrado-Hernández,et al.  Distributed support vector machines , 2006, IEEE Trans. Neural Networks.

[80]  Nirmalya Roy,et al.  Recent trends in machine learning for human activity recognition—A survey , 2018, WIREs Data Mining Knowl. Discov..

[81]  João Gama,et al.  Ensemble learning for data stream analysis: A survey , 2017, Inf. Fusion.

[82]  Mehdi Boukhechba,et al.  Online recognition of people's activities from raw GPS data: semantic trajectory data analysis , 2015, PETRA.

[83]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[84]  Matthew S. Goodwin,et al.  Moving towards a real-time system for automatically recognizing stereotypical motor movements in individuals on the autism spectrum using wireless accelerometry , 2014, UbiComp.

[85]  Marco Aiello,et al.  Beyond Indoor Presence Monitoring with Simple Sensors , 2012, PECCS.

[86]  Claudio Gallicchio,et al.  Human activity recognition using multisensor data fusion based on Reservoir Computing , 2016, J. Ambient Intell. Smart Environ..

[87]  Stanley K. Smith,et al.  Aging and Disability: Implications for the Housing Industry and Housing Policy in the United States , 2008 .

[88]  Ran Wolff,et al.  Distributed Decision‐Tree Induction in Peer‐to‐Peer Systems , 2008, Stat. Anal. Data Min..

[89]  Sébastien Gaboury,et al.  Recognizing activities of daily living from UWB radars and deep learning , 2021, Expert Syst. Appl..

[90]  J. Stankovic,et al.  An Assisted Living Oriented Information System Based on a Residential Wireless Sensor Network , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[91]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[92]  Klaus David,et al.  5G Based Collision Avoidance - Benefit from Unobtrusive Activities , 2018, 2018 European Conference on Networks and Communications (EuCNC).

[93]  Charles Gouin-Vallerand,et al.  Unsupervised graph-based feature selection via subspace and pagerank centrality , 2018, Expert Syst. Appl..

[94]  Kai-Chun Liu,et al.  An Analysis of Segmentation Approaches and Window Sizes in Wearable-Based Critical Fall Detection Systems With Machine Learning Models , 2020, IEEE Sensors Journal.

[95]  Edward Sazonov,et al.  Monitoring of Posture Allocations and Activities by a Shoe-Based Wearable Sensor , 2011, IEEE Transactions on Biomedical Engineering.

[96]  Ian Cleland,et al.  Dynamic detection of window starting positions and its implementation within an activity recognition framework , 2016, J. Biomed. Informatics.

[97]  Zhihua Wang,et al.  Activity Recognition in Wearable ECG Monitoring Aided by Accelerometer Data , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[98]  Ahmed Nait Aicha,et al.  How lonely is your grandma?: detecting the visits to assisted living elderly from wireless sensor network data , 2013, UbiComp.

[99]  J. Weuve,et al.  2016 Alzheimer's disease facts and figures , 2016 .

[100]  Abdenour Bouzouane,et al.  Activity Recognition in the City using Embedded Systems and Anonymous Sensors , 2020, ANT/EDI40.

[101]  Peng Sun,et al.  Sensor Fusion for Recognition of Activities of Daily Living , 2018, Sensors.

[102]  Zhu Xiao,et al.  Energy-efficient recognition of human activity in body sensor networks via compressed classification , 2016, Int. J. Distributed Sens. Networks.

[103]  Farkas Ioana-Iuliana,et al.  Detection of daily movements from data collected with two tri-axial accelerometers , 2011, 2011 34th International Conference on Telecommunications and Signal Processing (TSP).

[104]  S AbdallahZahraa,et al.  Activity Recognition with Evolving Data Streams , 2018 .

[105]  Giancarlo Fortino,et al.  Activity-aaService: Cloud-assisted, BSN-based system for physical activity monitoring , 2015, 2015 IEEE 19th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[106]  Sameer Qazi,et al.  Internet of Things (IoT) for Next-Generation Smart Systems: A Review of Current Challenges, Future Trends and Prospects for Emerging 5G-IoT Scenarios , 2020, IEEE Access.

[107]  Laura A. Zanella-Calzada,et al.  A Generalized Model for Indoor Location Estimation Using Environmental Sound from Human Activity Recognition , 2018, ISPRS Int. J. Geo Inf..

[108]  L. Benini,et al.  Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[109]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[110]  Richard P. Martin,et al.  Tackling the Fidelity-Energy Trade-Off in Wireless Body Sensor Networks , 2017, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[111]  Ye Li,et al.  Motion aware transmission power control scheme in wireless body area network , 2015, 2015 IEEE Workshop on Signal Processing Systems (SiPS).

[112]  Koushik Maharatna,et al.  Real-time arm movement recognition using FPGA , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[113]  Bassem Alhalabi,et al.  A Machine Learning Based WSN System for Autism Activity Recognition , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[114]  Mohd Azlan Abu,et al.  Bluetooth 5.0 throughput comparison for internet of thing usability a survey , 2017, 2017 International Conference on Engineering Technology and Technopreneurship (ICE2T).

[115]  Tarek R. Sheltami,et al.  An RFID Based Activity of Daily Living for Elderly with Alzheimer's , 2017, HealthyIoT.

[116]  Mark Weiser,et al.  The Computer for the 21st Century: Specialized elements of hardware and software, connected by wires, radio waves and infrared, will be so ubiquitous that no one will notice their presence , 1995 .

[117]  Luca Benini,et al.  Interfacing human and computer with wireless body area sensor networks: the WiMoCA solution , 2008, Multimedia Tools and Applications.

[118]  Sevgi Zubeyde Gurbuz,et al.  Human activity recognition using a low cost, COTS radar network , 2014, 2014 IEEE Radar Conference.

[119]  K. Venkatalakshmi,et al.  Hybrid outlier detection (HOD) method in sensor data for human activity classification , 2018, Intell. Data Anal..

[120]  Hirozumi Yamaguchi,et al.  MicroDeep: In-network Deep Learning by Micro-Sensor Coordination for Pervasive Computing , 2018, 2018 IEEE International Conference on Smart Computing (SMARTCOMP).