A Survey on Anomalous Behavior Detection for Elderly Care Using Dense-Sensing Networks

Facing the gradual ageing society, elderly people living independently are in need of serious attention. In order to assist them to live in a safer environment, the increasing cost of nursing care and the shortage of health-care workers urges the demand of home-based assisted living in recent times. Therefore, home-based health-care has become an active research domain, particularly the abnormal activities detection involving information and communications technologies. This survey paper highlights this kind of technologies that exist for human anomalous behavior detection. It also reviews and discusses the current research trends, their outcomes and effects in elderly care. Our study is mainly focused on dense sensing network based activities and anomaly detection, which are robust to environment change, non-intrusive, user-friendly in the sense that do not require the occupant to wear any devices. From our study, we observe that employing sensor fusion techniques could significantly increases the efficiency of dense sensing network. In addition, sensor fusion models ensure a high level of robustness and effectiveness compared to the traditional methods.

[1]  Gert R. G. Lanckriet,et al.  A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers , 2014, Physiological measurement.

[2]  Quang Vinh Nguyen,et al.  RFID Systems in Healthcare Settings and Activity of Daily Living in Smart Homes: A Review , 2017 .

[3]  Miguel Damas,et al.  Multi-sensor Fusion Based on Asymmetric Decision Weighting for Robust Activity Recognition , 2014, Neural Processing Letters.

[4]  Juan Carlos Niebles,et al.  Sparse composition of body poses and atomic actions for human activity recognition in RGB-D videos , 2017, Image Vis. Comput..

[5]  Song Guo,et al.  Information and Communications Technologies for Sustainable Development Goals: State-of-the-Art, Needs and Perspectives , 2018, IEEE Communications Surveys & Tutorials.

[6]  Hamid Jafarkhani,et al.  Sensor Deployment With Limited Communication Range in Homogeneous and Heterogeneous Wireless Sensor Networks , 2016, IEEE Transactions on Wireless Communications.

[7]  Julie Doyle,et al.  Visualisation of movement of older adults within their homes based on PIR sensor data , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[8]  Sutharshan Rajasegarar,et al.  Non-invasive sensor based automated smoking activity detection , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Christine Julien,et al.  BraceForce: a middleware to enable sensing integration in mobile applications for novice programmers , 2014, MOBILESoft 2014.

[10]  Bo Chen,et al.  RFree-ID: An Unobtrusive Human Identification System Irrespective of Walking Cofactors Using COTS RFID , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[11]  Bruce A. MacDonald,et al.  The Role of Healthcare Robots for Older People at Home: A Review , 2014, Int. J. Soc. Robotics.

[12]  Xin Zhang,et al.  Learning multi-level features for sensor-based human action recognition , 2016, Pervasive Mob. Comput..

[13]  Xuemei Guo,et al.  Design and implementation of a distributed fall detection system based on wireless sensor networks , 2012, EURASIP Journal on Wireless Communications and Networking.

[14]  Paolo Remagnino,et al.  Anomalous Behaviour Detection: Supporting Independent Living , 2008 .

[15]  Julián Colorado,et al.  Wearable-Based Human Activity Recognition Using an IoT Approach , 2017, J. Sens. Actuator Networks.

[16]  Yong Du,et al.  Hierarchical recurrent neural network for skeleton based action recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Guangchun Cheng,et al.  Advances in Human Action Recognition: A Survey , 2015, ArXiv.

[18]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[19]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[20]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[21]  Chien-Chen Chen,et al.  RFID-based human behavior modeling and anomaly detection for elderly care , 2010, Mob. Inf. Syst..

[22]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[23]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[24]  Yunhao Liu,et al.  Mobility Increases Localizability , 2015, ACM Comput. Surv..

[25]  Yun Liu,et al.  An Integrated Model for Robust Multisensor Data Fusion , 2014, Sensors.

[26]  Xiaomu Luo,et al.  Simultaneous Indoor Tracking and Activity Recognition Using Pyroelectric Infrared Sensors , 2017, Sensors.

[27]  Paul Lukowicz,et al.  Adapting magnetic resonant coupling based relative positioning technology for wearable activitiy recogniton , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[28]  Chris D. Nugent,et al.  Evidential fusion of sensor data for activity recognition in smart homes , 2009, Pervasive Mob. Comput..

[29]  Tim Smithers,et al.  Whistling to Machines , 2006, Ambient Intelligence in Everyday.

[30]  Silvio Savarese,et al.  Deep Metric Learning via Lifted Structured Feature Embedding , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Yimin Zhang,et al.  Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring , 2016, IEEE Signal Processing Magazine.

[32]  Robert X. Gao,et al.  Multisensor Data Fusion for Physical Activity Assessment , 2012, IEEE Transactions on Biomedical Engineering.

[33]  Nestor Michael C. Tiglao,et al.  Basic Human Activity Recognition based on sensor fusion in smartphones , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[34]  Enamul Hoque,et al.  Holmes: A Comprehensive Anomaly Detection System for Daily In-home Activities , 2015, 2015 International Conference on Distributed Computing in Sensor Systems.

[35]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[36]  Jun Gao,et al.  Learning universal multiview dictionary for human action recognition , 2017, Pattern Recognit..

[37]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[38]  M. Novák,et al.  Anomaly Detection in User Daily Patterns in Smart-Home Environment , 2022 .

[39]  Bernt Schiele,et al.  Daily Routine Recognition through Activity Spotting , 2009, LoCA.

[40]  Plamen Angelov,et al.  Vision Based Human Activity Recognition: A Review , 2016, UKCI.

[41]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[42]  Ifeyinwa E. Achumba,et al.  Sensor Data Acquisition and Processing Parameters for Human Activity Classification , 2014, Sensors.

[43]  Xiaopei Wu,et al.  Driver Drowsiness Detection Using Multi-Channel Second Order Blind Identifications , 2019, IEEE Access.

[44]  António J. S. Teixeira,et al.  Elderly Centered Design for Interaction - The Case of the S4S Medication Assistant , 2013, DSAI.

[45]  Nicola Blefari-Melazzi,et al.  Bringing 5G into Rural and Low-Income Areas: Is It Feasible? , 2017, IEEE Communications Standards Magazine.

[46]  Hao Chen,et al.  Enabling cyber-physical communication in 5G cellular networks: challenges, spatial spectrum sensing, and cyber-security , 2017, IET Cyper-Phys. Syst.: Theory & Appl..

[47]  Daniel Gatica-Perez,et al.  Anomaly Detection in Elderly Daily Behavior in Ambient Sensing Environments , 2016, HBU.

[48]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[49]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[50]  Vikas Vippalapalli,et al.  Internet of things (IoT) based smart health care system , 2016, 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES).

[51]  Juha Röning,et al.  Reducing Uncertainty in User-independent Activity Recognition - A Sensor Fusion-based Approach , 2016, ICPRAM.

[52]  Jeffrey M. Hausdorff,et al.  Potentials of Enhanced Context Awareness in Wearable Assistants for Parkinson's Disease Patients with the Freezing of Gait Syndrome , 2009, 2009 International Symposium on Wearable Computers.

[53]  Özlem Durmaz Incel,et al.  Feature Engineering for Activity Recognition from Wrist-worn Motion Sensors , 2016, PECCS.

[54]  Ian Craddock,et al.  Residential wearable RSSI and accelerometer measurements with detailed location annotations , 2018, Scientific data.

[55]  Miguel A. Labrador,et al.  Centinela: A human activity recognition system based on acceleration and vital sign data , 2012, Pervasive Mob. Comput..

[56]  Lei Gao,et al.  Activity recognition using dynamic multiple sensor fusion in body sensor networks , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[57]  Ruzena Bajcsy,et al.  Sequence of the Most Informative Joints (SMIJ): A new representation for human skeletal action recognition , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[58]  Hamid K. Aghajan,et al.  Data Fusion with a Dense Sensor Network for Anomaly Detection in Smart Homes , 2014, Human Behavior Understanding in Networked Sensing.

[59]  Fabio Tozeto Ramos,et al.  Multi-scale Conditional Random Fields for first-person activity recognition , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[60]  Jun Zhong,et al.  Towards unsupervised physical activity recognition using smartphone accelerometers , 2016, Multimedia Tools and Applications.

[61]  Seiichi Uchida,et al.  Behavior Analysis Using Unsupervised Anomaly Detection , 2014 .

[62]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[63]  Araceli Sanchis,et al.  Sensor-based Bayesian detection of anomalous living patterns in a home setting , 2014, Personal and Ubiquitous Computing.

[64]  Amit K. Roy-Chowdhury,et al.  Context-Aware Activity Recognition and Anomaly Detection in Video , 2013, IEEE Journal of Selected Topics in Signal Processing.

[65]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[66]  Sonia,et al.  A Voting-Based Sensor Fusion Approach for Human Presence Detection , 2016, IHCI.

[67]  Ryosuke Shibasaki,et al.  Human Sensing in Crowd Using Laser Scanners , 2012 .

[68]  Paul J. M. Havinga,et al.  Fusion of Smartphone Motion Sensors for Physical Activity Recognition , 2014, Sensors.

[69]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[70]  Mani B. Srivastava,et al.  SenseGen: A deep learning architecture for synthetic sensor data generation , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[71]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[72]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[73]  Emmanuel Andrès,et al.  From Fall Detection to Fall Prevention: A Generic Classification of Fall-Related Systems , 2017, IEEE Sensors Journal.

[74]  Amy Loutfi,et al.  Context Recognition in Multiple Occupants Situations: Detecting the Number of Agents in a Smart Home Environment with Simple Sensors , 2017, AAAI Workshops.

[75]  Matthias Budde,et al.  An Extensible Modular Recognition Concept That Makes Activity Recognition Practical , 2010, KI.

[76]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[77]  Song Guo,et al.  Achieve Sustainable Ultra-Dense Heterogeneous Networks for 5G , 2017, ArXiv.

[78]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[79]  Gary V. Engelhardt,et al.  Home safety, accessibility, and elderly health: Evidence from falls , 2015 .

[80]  Peter Robinson,et al.  Dimensional affect recognition using Continuous Conditional Random Fields , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[81]  Chung-Hao Huang,et al.  Real-Time RFID Indoor Positioning System Based on Kalman-Filter Drift Removal and Heron-Bilateration Location Estimation , 2015, IEEE Transactions on Instrumentation and Measurement.

[82]  Yuri Vershinin,et al.  A data fusion algorithm for multisensor systems , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[83]  Fabien Cardinaux,et al.  Modelling of Behavioural Patterns for Abnormality Detection in the Context of Lifestyle Reassurance , 2008, CIARP.

[84]  Song Guo,et al.  Big Data Meet Green Challenges: Big Data Toward Green Applications , 2016, IEEE Systems Journal.

[85]  Fucai Zhou,et al.  Anomaly detection model of user behavior based on principal component analysis , 2016, J. Ambient Intell. Humaniz. Comput..

[86]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[87]  Paul J. M. Havinga,et al.  A hierarchical lazy smoking detection algorithm using smartwatch sensors , 2016, 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom).

[88]  Kai Liu,et al.  Profile HMMs for skeleton-based human action recognition , 2016, Signal Process. Image Commun..

[89]  Sang Min Yoon,et al.  Human activity recognition from accelerometer data using Convolutional Neural Network , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[90]  M. Bouet,et al.  RFID tags: Positioning principles and localization techniques , 2008, 2008 1st IFIP Wireless Days.

[91]  Shuang Wang,et al.  A Review on Human Activity Recognition Using Vision-Based Method , 2017, Journal of healthcare engineering.

[92]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[93]  S. Mukhopadhyay,et al.  Activity and Anomaly Detection in Smart Home: A Survey , 2016 .

[94]  Diane J. Cook,et al.  Detecting Anomalous Sensor Events in Smart Home Data for Enhancing the Living Experience , 2011, Artificial Intelligence and Smarter Living.

[95]  Sung-Bae Cho,et al.  Human activity recognition using smartphone sensors with two-stage continuous hidden Markov models , 2014, 2014 10th International Conference on Natural Computation (ICNC).

[96]  Nasser Kehtarnavaz,et al.  A Real-Time Human Action Recognition System Using Depth and Inertial Sensor Fusion , 2016, IEEE Sensors Journal.

[97]  Nuno M. Garcia,et al.  From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices , 2016, Sensors.

[98]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[99]  Valentin Fuster,et al.  Changing Demographics: A New Approach to Global Health Care Due to the Aging Population. , 2017, Journal of the American College of Cardiology.

[100]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[101]  Jurek Z. Sasiadek,et al.  Multi Sensor Fusion Based on Adaptive Kalman Filtering , 2018 .

[102]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[103]  Marco Morana,et al.  Human Activity Recognition Process Using 3-D Posture Data , 2015, IEEE Transactions on Human-Machine Systems.

[104]  Abdelsalam Helal,et al.  Robotic Companions for Smart Space Interactions , 2009, IEEE Pervasive Computing.

[105]  Nannan Li,et al.  Video anomaly detection based on a hierarchical activity discovery within spatio-temporal contexts , 2014, Neurocomputing.

[106]  Jesse S. Jin,et al.  Sensor Data Fusion for Accurate Cloud Presence Prediction Using Dempster-Shafer Evidence Theory , 2010, Sensors.

[107]  Dongkyoo Shin,et al.  Detecting and predicting of abnormal behavior using hierarchical Markov model in smart home network , 2010, 2010 IEEE 17Th International Conference on Industrial Engineering and Engineering Management.

[108]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[109]  Min Chen,et al.  Smart Clothing: Connecting Human with Clouds and Big Data for Sustainable Health Monitoring , 2016, Mobile Networks and Applications.

[110]  Long Hu,et al.  Enabling RFID technology for healthcare: application, architecture, and challenges , 2015, Telecommun. Syst..

[111]  Wenfeng Li,et al.  Optimizing multi-sensor deployment via ensemble pruning for wearable activity recognition , 2018, Inf. Fusion.

[112]  Martin McKee,et al.  Macroeconomic implications of population ageing and selected policy responses , 2015, The Lancet.

[113]  Philip H. S. Torr,et al.  Higher Order Conditional Random Fields in Deep Neural Networks , 2015, ECCV.

[114]  J. Guilbert,et al.  The World Health Report 2006: working together for health. , 2006, Education for health.

[115]  Dominik Schuldhaus,et al.  Hierarchical, Multi-Sensor Based Classification of Daily Life Activities: Comparison with State-of-the-Art Algorithms Using a Benchmark Dataset , 2013, PloS one.

[116]  Hao Wang,et al.  An Adaptive Hidden Markov Model for Activity Recognition Based on a Wearable Multi-Sensor Device , 2015, Journal of Medical Systems.

[117]  Md Taufeeq Uddin,et al.  A guided random forest based feature selection approach for activity recognition , 2015, 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT).

[118]  Guilin Chen,et al.  Human Activity Recognition in a Smart Home Environment with Stacked Denoising Autoencoders , 2016, WAIM Workshops.

[119]  Weihua Sheng,et al.  Wearable Sensor-Based Behavioral Anomaly Detection in Smart Assisted Living Systems , 2015, IEEE Transactions on Automation Science and Engineering.

[120]  Pedro Ponce,et al.  A novel robust liquid level controller for coupled-tanks systems using artificial hydrocarbon networks , 2015, Expert Syst. Appl..

[121]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[122]  Ekram Hossain,et al.  Context-aware networking and communications: Part 1 [Guest editorial] , 2014, IEEE Commun. Mag..

[123]  Tong Liu,et al.  Abnormal Activity Detection Using Pyroelectric Infrared Sensors , 2016, Sensors.

[124]  Rainer Stiefelhagen,et al.  CNN-based sensor fusion techniques for multimodal human activity recognition , 2017, SEMWEB.

[125]  Amit K. Roy-Chowdhury,et al.  A Continuous Learning Framework for Activity Recognition Using Deep Hybrid Feature Models , 2015, IEEE Transactions on Multimedia.

[126]  Pedro Henriques Abreu,et al.  Using Kalman Filters to Reduce Noise from RFID Location System , 2014, TheScientificWorldJournal.

[127]  V. Ramasubramanian,et al.  Towards fast, view-invariant human action recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[128]  Lina Yao,et al.  Compressive Representation for Device-Free Activity Recognition with Passive RFID Signal Strength , 2018, IEEE Transactions on Mobile Computing.

[129]  Yeh-Ching Chung,et al.  Heterogeneous Wireless Sensor Network Deployment and Topology Control Based on Irregular Sensor Model , 2007, GPC.

[130]  Dorothy Monekosso,et al.  Anomalous Behaviour Detection: Supporting Independent Living , 2008 .

[131]  Duncan Clarke,et al.  Active-RFID System Accuracy and Its Implications for Clinical Applications , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[132]  Gourab Sen Gupta,et al.  Elder Care Based on Cognitive Sensor Network , 2011, IEEE Sensors Journal.

[133]  Richa Singh,et al.  Robust memory-efficient data level information fusion of multi-modal biometric images , 2007, Inf. Fusion.

[134]  Jenny Benois-Pineau,et al.  Hierarchical Hidden Markov Model in detecting activities of daily living in wearable videos for studies of dementia , 2011, Multimedia Tools and Applications.

[135]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[136]  Nasser Kehtarnavaz,et al.  A survey of depth and inertial sensor fusion for human action recognition , 2015, Multimedia Tools and Applications.

[137]  Pavel Smrž,et al.  Design of the Human-Robot Interaction for a Semi-Autonomous Service Robot to Assist Elderly People , 2015 .

[138]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[139]  Kevin Bouchard,et al.  Human activity recognition in smart homes based on passive RFID localization , 2014, PETRA.

[140]  Christine Julien,et al.  WiP abstract: BraceForce: Software engineering support for sensing in CPS applications , 2014, 2014 ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

[141]  Samaneh Aminikhanghahi,et al.  Real-Time Change Point Detection with Application to Smart Home Time Series Data , 2019, IEEE Transactions on Knowledge and Data Engineering.

[142]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[143]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[144]  Anton Umek,et al.  Hierarchical Feature Reduction with Max Relevance and Low Dimensional Embedding Strategy and Its Application in Activity Recognition with Multi-sensors , 2017, IIKI.

[145]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[146]  Franziska Hoffmann,et al.  Spatial Tessellations Concepts And Applications Of Voronoi Diagrams , 2016 .

[147]  Boreom Lee,et al.  Detection of Abnormal Living Patterns for Elderly Living Alone Using Support Vector Data Description , 2011, IEEE Transactions on Information Technology in Biomedicine.

[148]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[149]  Wei Lu,et al.  Wearable Computing for Internet of Things: A Discriminant Approach for Human Activity Recognition , 2019, IEEE Internet of Things Journal.