Automatic equine activity detection by convolutional neural networks using accelerometer data

Abstract In recent years, with a widespread of sensors embedded in all kind of mobile devices, human activity analysis is occurring more often in several domains like healthcare monitoring and fitness tracking. This trend did also enter the equestrian world because monitoring behaviours can yield important information about the health and welfare of horses. In this research, a deep learning-based approach for activity detection of equines is proposed to classify seven activities based on accelerometer data. We propose using Convolutional Neural Networks (CNN) by which features are extracted automatically by using strong computing capabilities. Furthermore, we investigate the impact of the sampling frequency, the time series length and the type of underground on which the data is gathered on the recognition accuracy and evaluate the model on three types of experimental datasets that are compiled of labelled accelerometer data gathered from six different subjects performing seven different activities. Afterwards, a horse-wise cross validation is carried out to investigate the impact of the subjects themselves on the model recognition accuracy. Finally, a slightly adjusted model is validated on different amounts of 50 Hz sensor data. A 99% accuracy can be reached for detecting seven behaviours of a seen horse when the sampling rate is 25 Hz and the time interval is 2.1 s. Four behaviours of an unseen horse can be detected with the same accuracy when the sampling rate is 69 Hz and the time interval is 2.4 s. Moreover, the accuracy of the model for the three datasets decreased on average with about 4.75% when the sampling rate was decreased from 200 Hz to 25 Hz and with 5.27% when the time interval was decreased from 3 s to 0.6 s. In addition, the classification performance of the activity ”walk” was not influenced by the type of underground the horse was performing this movement on and even the model could conclude from which underground the data was gathered for three out of four undergrounds with accuracies above 93% at time intervals higher than 1.2 s. This ensures the evaluation of activity patterns in real world circumstances. The performance and ability of the model to generalise is validated on 50 Hz data from different horse types, using ten-fold cross validation, reaching a mean classification accuracy of 97.84% and 96.10% when validated on a lame horse and pony, respectively. Moreover, in this work we show that using data from one sensors is at the cost of only 0.24% reduction in accuracy (99.42% vs 99.66%).

[1]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[2]  Guang-Zhong Yang,et al.  A Deep Learning Approach to on-Node Sensor Data Analytics for Mobile or Wearable Devices , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Hai Wang,et al.  3D-CNN-based feature extraction of ground-based cloud images for direct normal irradiance prediction , 2019, Solar Energy.

[4]  Roland Langrock,et al.  Flexible and practical modeling of animal telemetry data: hidden Markov models and extensions. , 2012, Ecology.

[5]  Buket D. Barkana,et al.  Utilizing CNNs and transfer learning of pre-trained models for age range classification from unconstrained face images , 2019, Image Vis. Comput..

[6]  J. V. Loon,et al.  Monitoring acute equine visceral pain with the Equine Utrecht University Scale for Composite Pain Assessment (EQUUS-COMPASS) and the Equine Utrecht University Scale for Facial Assessment of Pain (EQUUS-FAP): A scale-construction study. , 2015 .

[7]  Santosh K. Pitla,et al.  Location on the Body of a Wearable Accelerometer Affects Accuracy of Data for Identifying Equine Gaits , 2017 .

[8]  K. Slocombe,et al.  Primate Communication: A Multimodal Approach , 2013 .

[9]  Hennie Brugman,et al.  Annotating Multi-media/Multi-modal Resources with ELAN , 2004, LREC.

[10]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[11]  Rory P. Wilson,et al.  Love Thy Neighbour: Automatic Animal Behavioural Classification of Acceleration Data Using the K-Nearest Neighbour Algorithm , 2014, PloS one.

[12]  Dana Kulic,et al.  Exercise motion classification from large-scale wearable sensor data using convolutional neural networks , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  O. Paltiel,et al.  A behaviour-based pain scale for horses with acute colic: scale construction. , 2013, Veterinary journal.

[14]  Heike Schulze Westerath,et al.  Gait determination and activity measurement in horses using an accelerometer , 2014 .

[15]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[16]  Elizabeth J Davidson,et al.  Lameness Evaluation of the Athletic Horse. , 2018, The Veterinary clinics of North America. Equine practice.