Application of IndRNN for human activity recognition: the Sussex-Huawei locomotion-transportation challenge

We propose a human activity recognition method using Independently Recurrent Neural Network (IndRNN) on the spectrum for the Sussex-Huawei Locomotion-Transportation (SHL) recognition challenge 2019. The proposed method takes advantage of FFT and IndRNN to obtain short-time and long-time features, respectively. To be specific, since the signal obtained by Smartphone-sensors is strongly periodic, it is first processed into spectrum by FFT in a one-second sliding window to obtain short-time features. Then, the spectrum of 21 overlapped window extracted from 5-second data is processed by IndRNN in order to explore the correlation of FFT spectrums of all windows to obtain longtime features for the final action classification. To obtain a phone-position independent model, the training data of three phone locations (bag, hips, torso) is used to train the IndRNN model, which is further fine-tuned with half of the validation data in hand position (a relatively small amount of data which can be obtained in practical applications). The proposed method achieved 82.6% accuracy of validation in hand position, which have been submitted to SHL recognition challenge as "UESTC_IndRNN".

[1]  Shuai Li,et al.  Smartphone-sensors Based Activity Recognition Using IndRNN , 2018, UbiComp/ISWC Adjunct.

[2]  Jani Bizjak,et al.  Applying Multiple Knowledge to Sussex-Huawei Locomotion Challenge , 2018, UbiComp/ISWC Adjunct.

[3]  Kazuya Murao,et al.  Summary of the Sussex-Huawei locomotion-transportation recognition challenge 2019 , 2019, UbiComp/ISWC Adjunct.

[4]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[5]  Jae-Young Pyun,et al.  Deep Recurrent Neural Networks for Human Activity Recognition , 2017, Sensors.

[6]  Stefan Valentin,et al.  Enabling Reproducible Research in Sensor-Based Transportation Mode Recognition With the Sussex-Huawei Dataset , 2019, IEEE Access.

[7]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[8]  Jani Bizjak,et al.  A New Frontier for Activity Recognition: The Sussex-Huawei Locomotion Challenge , 2018, UbiComp/ISWC Adjunct.

[9]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[10]  Hans-Olav Hessen,et al.  Human Activity Recognition With Two Body-Worn Accelerometer Sensors , 2016 .

[11]  Sung-Bae Cho,et al.  Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models , 2017, Int. J. Distributed Sens. Networks.

[12]  Md. Atiqur Rahman Ahad,et al.  A Comparative Approach to Classification of Locomotion and Transportation Modes Using Smartphone Sensor Data , 2018, UbiComp/ISWC Adjunct.

[13]  Lin Wang,et al.  The University of Sussex-Huawei Locomotion and Transportation Dataset for Multimodal Analytics With Mobile Devices , 2018, IEEE Access.

[14]  Ed Zaluska,et al.  Unobstrusive human activity recognition using smartphones and Hidden Markov Models , 2013 .

[15]  Shuai Li,et al.  A Fully Trainable Network with RNN-based Pooling , 2017, Neurocomputing.

[16]  Shuai Li,et al.  Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.