A software architecture for generic human activity recognition from smartphone sensor data

In these last few years, several recent studies have demonstrated the possibility to perform Human Activity Recognition (HAR) by smartphone sensor data, enabling in this way a new generation of context-aware mobile applications. Smartphone-based HAR systems can exploit the full set of embedded sensors beside the accelerometer in order to increase the accuracy of the detection process. At the same time, the practical deployment of such systems can result highly challenging since it must cope with the limited computational resources and the battery constraints of the mobile devices. In this paper, we address such issues by proposing a novel, generic HAR architecture for Android devices. The system design takes into account the energy constraints by: (i) limiting the number of sensors/features used for the recognition process, while still guaranteeing satisfactory performance in terms of activity detection; (ii) allocating the most CPU intensive tasks, like the training and data processing phases, on an external server. At the same time, the system operations automatize the full learning process, simply notifying the user when a new classification model has been installed on the client. We validate the proposed HAR systems on two use-cases, i.e. transportation mode detection and walking mode detection, and we describe an application for indoor floor detection. Measurements show that the overall accuracy of the activity recognition process can be up to 90% for both the use-cases.

[1]  Wei Tu,et al.  Activity Sequence-Based Indoor Pedestrian Localization Using Smartphones , 2015, IEEE Transactions on Human-Machine Systems.

[2]  Paul J. M. Havinga,et al.  Towards Physical Activity Recognition Using Smartphone Sensors , 2013, 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing.

[3]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[4]  Xianbin Wang,et al.  Human activity detection based on multiple smart phone sensors and machine learning algorithms , 2015, 2015 IEEE 19th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[5]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.

[6]  Jie Qiu,et al.  HARLib: A human activity recognition library on Android , 2014, 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing(ICCWAMTIP).

[7]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.

[8]  Luciano Bononi,et al.  Park Here! a smart parking system based on smartphones' embedded sensors and short range Communication Technologies , 2015, 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT).

[9]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[10]  Qi Cheng,et al.  Human activity recognition via motion and vision data fusion , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[11]  Min Chen,et al.  Energy-Efficient and Context-Aware Smartphone Sensor Employment , 2015, IEEE Transactions on Vehicular Technology.

[12]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[13]  Luciano Bononi,et al.  Context-aware Android applications through transportation mode detection techniques , 2016, Wirel. Commun. Mob. Comput..

[14]  Sotiris E. Nikoletseas,et al.  Hierarchical algorithm for daily activity recognition via smartphone sensors , 2015, 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT).

[15]  Jafet Morales,et al.  Physical activity recognition by smartphones, a survey , 2017 .

[16]  Yufei Chen,et al.  Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition , 2017, IEEE Access.

[17]  Sasu Tarkoma,et al.  Accelerometer-based transportation mode detection on smartphones , 2013, SenSys '13.