Benchmark Performance for the Sussex-Huawei Locomotion and Transportation Recognition Challenge 2018

The Sussex-Huawei Transportation-Locomotion (SHL) Recognition Challenge 2018 aims to recognize eight transportation activities (Still, Walk, Run, Bike, Bus, Car, Train, Subway) from the inertial and pressure sensor data of a smartphone. In this chapter, we, as part of competition organizing team, present reference recognition performance obtained by applying various classical and deep-learning classifiers to the testing dataset. The classical classifiers include naive Bayes, decision tree, random forest, K-nearest neighbours and support vector machine, while the deep-learning classifiers include fully-connected and convolutional deep neural networks. We feed different types of input to the classifier, including hand-crafted features, raw sensor data in the time domain, and in the frequency domain. We additionally employ a post-processing scheme, which smoothens the predictions in order and improves the recognition performance. Results show that convolutional neural network operating on frequency-domain raw data achieves the best performance among all the classifiers. Finally, we achieve a benchmark result with F1 score 92.9%, which is comparable to the best result from the team that won the competition (achieving F1 score 93.9%). The competition dataset and the benchmark implementation is made available online (http://www.shl-dataset.org/).