Effects of Time-Series Data Pre-processing on the Transformer-based Classification of Activities from Smart Glasses

Time-series classification is gaining significance in pattern recognition as time-series data becomes more abundant along with the increasing digitization of daily life and the rise of the Internet of Things (IoT). One of the biggest challenges lies in the ordered nature of time-series attributes, making traditional machine learning (ML) algorithms designed for static data unsuitable for processing temporal data. The Transformer architecture was introduced as a novel approach in natural language processing for machine translation tasks, relying solely on attention mechanisms without the need for convolution or recurrence. Since machine translation is similar to time-series data, where order is an important factor, it is also worth considering the Transformer for time-series classification. Pre-processing the data is a crucial step in the ML process and can influence the data and impact the effectiveness of the ML models. In this paper, we aim to address the effects of time-series pre-processing and data representation in combination with the Transformer model for Human Activity Recognition (HAR) using IMU data from smart glasses as input. We analyze the results based on established evaluation metrics such as the F1-score and the area under the curve (AUC).

[1]  K. Oltmanns,et al.  SenseHunger: Machine Learning Approach to Hunger Detection Using Wearable Sensors , 2022, Sensors.

[2]  Sebastian J. F. Fudickar,et al.  Transformer-Based Recognition of Activities of Daily Living from Wearable Sensor Data , 2022, iWOAR.

[3]  Junchi Yan,et al.  Transformers in Time Series: A Survey , 2022, IJCAI.

[4]  Martin Kubovčík,et al.  Wearable Sensor-Based Human Activity Recognition with Transformer Model , 2022, Sensors.

[5]  Kimiaki Shirahama,et al.  Deep Transfer Learning for Time Series Data Based on Sensor Modality Classification , 2020, Sensors.

[6]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[7]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[8]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[9]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[10]  M. N. Sulaiman,et al.  A Review On Evaluation Metrics For Data Classification Evaluations , 2015 .

[11]  Aishwarya Asesh.  Normalization and Bias in Time Series Data , 2021, MIDI.

[12]  Andreas Hein,et al.  Stair Climb Power Measurements via Inertial Measurement Units - Towards an Unsupervised Assessment of Strength in Domestic Environments , 2018, HEALTHINF.

[13]  Andreas Hein,et al.  Technology Supported Geriatric Assessment , 2017 .