Assisted Living System with Adaptive Sensor’s Contribution

Multimodal sensing and data processing have become a common approach in modern assisted living systems. This is widely justified by the complementary properties of sensors based on different sensing paradigms. However, all previous proposals assume data fusion to be made based on fixed criteria. We proved that particular sensors show different performance depending on the subject’s activity and consequently present the concept of an adaptive sensor’s contribution. In the proposed prototype architecture, the sensor information is first unified and then modulated to prefer the most reliable sensors. We also take into consideration the dynamics of the subject’s behavior and propose two algorithms for the adaptation of sensors’ contribution, and discuss their advantages and limitations based on case studies.

[1]  Ta-Te Lin,et al.  A wearable walking monitoring system for gait analysis , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Piotr Augustyniak,et al.  Sensorized elements of a typical household in behavioral studies and prediction of a health setback , 2015, 2015 8th International Conference on Human System Interaction (HSI).

[3]  Magdalena Smoleń,et al.  Consistency of Outputs of the Selected Motion Acquisition Methods for Human Activity Recognition , 2019, Journal of healthcare engineering.

[4]  Abdellah Touhafi,et al.  Ambient Assisted living system's models and architectures: A survey of the state of the art , 2020, J. King Saud Univ. Comput. Inf. Sci..

[5]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[6]  Yael Edan,et al.  A sensor fusion framework for online sensor and algorithm selection , 2008, Robotics Auton. Syst..

[7]  Victor Ströele,et al.  Event-Driven Framework for Detecting Unusual Patterns in AAL Environments , 2020, 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS).

[8]  Weria Khaksar,et al.  Ambient Sensors for Elderly Care and Independent Living: A Survey , 2018, Sensors.

[9]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[10]  N. Noury,et al.  Supervised classification of activities of daily living in health smart homes using SVM , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Kimiaki Shirahama,et al.  A general framework for sensor-based human activity recognition , 2018, Comput. Biol. Medicine.

[12]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[13]  Ashish Patel,et al.  Real-time human behaviour monitoring using hybrid ambient assisted living framework , 2020, Journal of Reliable Intelligent Environments.

[14]  Roberto Pierdicca,et al.  Robust and affordable retail customer profiling by vision and radio beacon sensor fusion , 2016, Pattern Recognit. Lett..

[15]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[16]  Paul Fergus,et al.  Detecting Activities of Daily Living and Routine Behaviours in Dementia Patients Living Alone Using Smart Meter Load Disaggregation , 2019, IEEE Transactions on Emerging Topics in Computing.

[17]  Piotr Augustyniak,et al.  Wearable Patient Home Monitoring Based on ECG and ACC Sensors , 2011 .

[18]  Piotr Augustyniak,et al.  The system of a touchfree personal computer navigation by using the information on the human eye movements , 2010, 3rd International Conference on Human System Interaction.

[19]  Piotr Augustyniak,et al.  Seamless Tracing of Human Behavior Using Complementary Wearable and House-Embedded Sensors , 2014, Sensors.

[20]  Emanuele Frontoni,et al.  Shopper Analytics: A Customer Activity Recognition System Using a Distributed RGB-D Camera Network , 2014, VAAM@ICPR.

[21]  Piotr Augustyniak,et al.  Sleep Evaluation Device for Home-Care , 2010 .

[22]  K. Czopek,et al.  Cardiac Activity Based on Acoustic Signal Properties , 2012 .

[23]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Wooi-Haw Tan,et al.  Indoor location and motion tracking system for elderly assisted living home , 2017, 2017 International Conference on Robotics, Automation and Sciences (ICORAS).

[25]  D.M. Sherrill,et al.  A neural network approach to monitor motor activities , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[26]  H. Nagai,et al.  Wearable Sensor System for Human Behavior Recognition (First Report: Basic Architecture and Behavior Prediction Method) , 2007, TRANSDUCERS 2007 - 2007 International Solid-State Sensors, Actuators and Microsystems Conference.

[27]  Piotr Augustyniak,et al.  Graph-based representation of behavior in detection and prediction of daily living activities , 2017, Comput. Biol. Medicine.

[28]  Young Soo Suh,et al.  Monitoring of basic daily activities with inertial sensors and wireless modules , 2010, 2010 IEEE Sensors Applications Symposium (SAS).

[29]  Antonios Tsourdos,et al.  Distributed estimation over a low-cost sensor network: A Review of state-of-the-art , 2020, Inf. Fusion.

[30]  Zbigniew Mikrut,et al.  Combining Pattern Matching and Optical Flow Methods in Home Care Vision System , 2012, ITIB.

[31]  P. Bonato,et al.  Monitoring Mobility Assistive Device Use in Post-Stroke Patients , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Yuan F. Zheng,et al.  EV-Loc: Integrating Electronic and Visual Signals for Accurate Localization , 2014, IEEE/ACM Transactions on Networking.

[33]  Cristiano André da Costa,et al.  Baptizo: A sensor fusion based model for tracking the identity of human poses , 2020, Inf. Fusion.

[34]  Guang-Zhong Yang,et al.  Real-Time Activity Classification Using Ambient and Wearable Sensors , 2009, IEEE Transactions on Information Technology in Biomedicine.

[35]  M Smolen,et al.  Non-invasive sensors based human state in nightlong sleep analysis for home-care , 2010, 2010 Computing in Cardiology.

[36]  Piotr Augustyniak,et al.  Data Integration in Multimodal Home Care Surveillance and Communication System , 2010 .

[37]  Madhusanka Liyanage,et al.  An Emergency Situation Detection System for Ambient Assisted Living , 2020, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).

[38]  Kai Lin,et al.  Multi-sensor fusion for body sensor network in medical human-robot interaction scenario , 2020, Inf. Fusion.

[39]  Piotr Augustyniak,et al.  Wearable Mobile Network as an Integrated Part of Assisted Living Technologies , 2012, ITIB.

[40]  A. Broniec.  Control of cursor movement based on EEG motor cortex rhythm using autoregressive spectral analysis , 2011 .

[41]  Jaromir Przybylo,et al.  Vision Based Facial Action Recognition System for People with Disabilities , 2012, ITIB.

[42]  Haoyu Wang,et al.  Pose Flow: Efficient Online Pose Tracking , 2018, BMVC.

[43]  Jesús García,et al.  Adaptive sensor fusion architecture through ontology modeling and automatic reasoning , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[44]  Huosheng Hu,et al.  A preliminary study assessing time-domain EMG features of classifying exercises in preventing falls in the elderly , 2012, 2012 9th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[45]  Piotr Augustyniak,et al.  Wireless body area network system based on ECG and accelerometer pattern , 2011, 2011 Computing in Cardiology.

[46]  Junichi Suzuki,et al.  An Adaptive , Scalable and Self-Healing Sensor Network Architecture for Autonomous Coastal Environmental Monitoring , 2007 .

[47]  Osman Hasan,et al.  Survey of fall detection and daily activity monitoring techniques , 2010, 2010 International Conference on Information and Emerging Technologies.