MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and evaluating quality of exercise performance to support patients with Musculoskeletal Disorders(MSD). We select 7 exercises regularly recommended for MSD patients by physiotherapists and collected data with four sensors a pressure mat, a depth camera and two accelerometers. The dataset contains three data modalities; numerical time-series data, video data and pressure sensor data posing interesting research challenges when reasoning for HAR and Exercise Quality Assessment. This paper presents our evaluation of the dataset on number of standard classification algorithms for the HAR task by comparing different feature representation algorithms for each sensor. These results set a reference performance for each individual sensor that expose their strengths and weaknesses for the future tasks. In addition we visualise pressure mat data to explore the potential of the sensor to capture exercise performance quality. With the recent advancement in multi-modal fusion, we also believe MEx is a suitable dataset to benchmark not only HAR algorithms, but also fusion algorithms of heterogeneous data types in multiple application domains.
[1]
Sergey Ioffe,et al.
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
,
2015,
ICML.
[2]
Mahesh K. Marina,et al.
Towards multimodal deep learning for activity recognition on mobile devices
,
2016,
UbiComp Adjunct.
[3]
Stewart Massie,et al.
Learning Deep and Shallow Features for Human Activity Recognition
,
2017,
KSEM.
[4]
Daniel Roggen,et al.
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
,
2016,
Sensors.
[5]
T. Vos,et al.
Global, regional, and national incidence and prevalence, and years lived with disability for 328 diseases and injuries in 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016
,
2017
.
[6]
Shaohan Hu,et al.
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
,
2016,
WWW.