Smart Device based Initial Movement Detection of Cyclists using Convolutional Neuronal Networks

For future traffic scenarios, we envision interconnected traffic participants, who exchange information about their current state, e.g., position, their predicted intentions, allowing to act in a cooperative manner. Vulnerable road users (VRUs), e.g., pedestrians and cyclists, will be equipped with smart device that can be used to detect their intentions and transmit these detected intention to approaching cars such that their drivers can be warned. In this article, we focus on detecting the initial movement of cyclist using smart devices. Smart devices provide the necessary sensors, namely accelerometer and gyroscope, and therefore pose an excellent instrument to detect movement transitions (e.g., waiting to moving) fast. Convolutional Neural Networks prove to be the state-of-the-art solution for many problems with an ever increasing range of applications. Therefore, we model the initial movement detection as a classification problem. In terms of Organic Computing (OC) it be seen as a step towards self-awareness and self-adaptation. We apply residual network architectures to the task of detecting the initial starting movement of cyclists.

[1]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.

[2]  Michael Goldhammer,et al.  Trajectory prediction of cyclists using a physical model and an artificial neural network , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[3]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[4]  Paul Lukowicz,et al.  Transforming sensor data to the image domain for deep learning — An application to footstep detection , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Konrad Doll,et al.  Early Start Intention Detection of Cyclists Using Motion History Images and a Deep Residual Network , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[7]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[8]  Konrad Doll,et al.  Detecting Intentions of Vulnerable Road Users Based on Collective Intelligence , 2018, ArXiv.

[9]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[10]  Konrad Doll,et al.  Cooperative starting intention detection of cyclists based on smart devices and infrastructure , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[11]  Konrad Doll,et al.  Cooperative Starting Movement Detection of Cyclists Using Convolutional Neural Networks and a Boosted Stacking Ensemble , 2018, IEEE Transactions on Intelligent Vehicles.

[12]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.