Adaptive sliding window based activity recognition for assisted livings

Abstract The incessant diffusion of smart wearable devices and Body Area Networks (BANs) systems is pushing more and more researches on human activity recognition. Previous studies usually adopted fixed time window or chose an optimal window size depending on the characteristics of the activity. In this paper, we propose an adaptive time window-based algorithm of activity recognition, which addresses the problem of different types of activities having different time duration that usually causes poor recognition results. Multivariate Gaussian Distribution (MGD) method was used to detect the signal difference between each determined time window and the defined activity characteristics, and we more accurately define the time window size for each activity. To evaluate the proposed algorithm, we focused on the activities performed by wheelchair users in their daily life, so as to provide them with better healthcare services. We construct two different datasets, respectively considering static and dynamic wheelchair user activities on different ground surfaces. Then, we use time window expansion and contraction method to determine and dynamically adjust the window size for each activity. Different comparison criteria such as recognition precision and F-score were used to evaluate our algorithm. Experiment results revealed that, according to F-score, the proposed algorithm performs 15.3% better than traditional methods in static conditions. In dynamic scenarios we observed 6.4% and 24.5% improvements on flat and rough floors, respectively.

[1]  Ali Hassan Sodhro,et al.  A Joint Transmission Power Control and Duty-Cycle Approach for Smart Healthcare System , 2019, IEEE Sensors Journal.

[2]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.

[3]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[4]  Roozbeh Jafari,et al.  Hierarchical Signal Segmentation and Classification for Accurate Activity Recognition , 2018, UbiComp/ISWC Adjunct.

[5]  Raffaele Gravina,et al.  Emotion-relevant activity recognition based on smart cushion using multi-sensor fusion , 2019, Inf. Fusion.

[6]  Tim Dallas,et al.  Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer , 2014, IEEE Transactions on Biomedical Engineering.

[7]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[8]  Giancarlo Fortino,et al.  Posture Detection Based on Smart Cushion for Wheelchair Users , 2017, Sensors.

[9]  Min Chen,et al.  Wearable 2.0: Enabling Human-Cloud Integration in Next Generation Healthcare Systems , 2017, IEEE Communications Magazine.

[10]  Ali Hassan Sodhro,et al.  Power Control Algorithms for Media Transmission in Remote Healthcare Systems , 2018, IEEE Access.

[11]  Ali Hassan Sodhro,et al.  An adaptive QoS computation for medical data processing in intelligent healthcare applications , 2019, Neural Computing and Applications.

[12]  Qingquan Li,et al.  Impact of Sliding Window Length in Indoor Human Motion Modes and Pose Pattern Recognition Based on Smartphone Sensors , 2018, Sensors.

[13]  Kai Tang,et al.  Kernel fusion based extreme learning machine for cross-location activity recognition , 2017, Inf. Fusion.

[14]  Athanasios V. Vasilakos,et al.  Cloud-assisted body area networks: state-of-the-art and future challenges , 2014, Wirel. Networks.

[15]  Giancarlo Fortino,et al.  A framework for collaborative computing and multi-sensor data fusion in body sensor networks , 2015, Inf. Fusion.

[16]  Zoran A. Salcic,et al.  Adaptive sliding window segmentation for physical activity recognition using a single tri-axial accelerometer , 2017, Pervasive Mob. Comput..

[17]  Abdulmotaleb El-Saddik,et al.  Towards Whole Body Fatigue Assessment of Human Movement: A Fatigue-Tracking System Based on Combined sEMG and Accelerometer Signals , 2014, Sensors.

[18]  Giancarlo Fortino,et al.  Cloud-Based Wheelchair Assist System for Mobility Impaired Individuals , 2016, IDCS.

[19]  Giancarlo Fortino,et al.  Cloud-based Activity-aaService cyber-physical framework for human activity monitoring in mobility , 2017, Future Gener. Comput. Syst..

[20]  Fabio Bellifemine,et al.  SPINE: a domain‐specific framework for rapid prototyping of WBSN applications , 2011, Softw. Pract. Exp..

[21]  Ali Hassan Sodhro,et al.  Role of 5G in medical health , 2017, 2017 International Conference on Innovations in Electrical Engineering and Computational Technologies (ICIEECT).

[22]  Matthias Budde,et al.  An Extensible Modular Recognition Concept That Makes Activity Recognition Practical , 2010, KI.

[23]  Dae-Sung Park,et al.  The Effects of Trunk Exercise on Mobility, Balance and Trunk Control of Stroke Patients , 2017 .

[24]  Hassan Ghasemzadeh,et al.  Power-Aware Activity Monitoring Using Distributed Wearable Sensors , 2014, IEEE Transactions on Human-Machine Systems.

[25]  Giancarlo Fortino,et al.  Activity Level Assessment Using a Smart Cushion for People with a Sedentary Lifestyle , 2017, Sensors.

[26]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[28]  Arun Kumar Sangaiah,et al.  Convergence of IoT and product lifecycle management in medical health care , 2018, Future Gener. Comput. Syst..

[29]  Lei Zhang,et al.  A Heterogeneous Ensemble Approach for Activity Recognition with Integration of Change Point-Based Data Segmentation , 2018, Applied Sciences.

[30]  Giancarlo Fortino,et al.  A Task-Oriented Framework for Networked Wearable Computing , 2016, IEEE Transactions on Automation Science and Engineering.

[31]  Ali Hassan Sodhro,et al.  5G-Based Transmission Power Control Mechanism in Fog Computing for Internet of Things Devices , 2018 .

[32]  Giancarlo Fortino,et al.  Activity level assessment of wheelchair users using smart cushion , 2016 .