Cyclist Intent Prediction using 3D LIDAR Sensors for Fully Automated Vehicles

One of the main barriers against the full deployment of autonomous vehicles in urban traffic environments is the understanding of the intentions and behaviours of the human around them. Moreover, understanding and predicting intentions of vulnerable road users such as cyclists is still one of the most challenging tasks. In this work, we are proposing a novel framework for the task of intent prediction of cyclists via hand signalling from point cloud scans. We utilised our developed data generation pipeline for generating synthetic point cloud scans of cyclists doing a set of hand signals in urban traffic environments. Then, we feed a sequence of the generated point cloud scans to our framework which jointly segments all cyclists instances and predicts their most probable intended actions in an end-to-end fashion. Our proposed framework has achieved superior results with 83% in F1-Measure score over the testing split of our generated dataset. Additionally, the proposed framework outperformed other compared baseline approaches with more than 39% improvement in F1-Measure score.

[1]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Saeid Nahavandi,et al.  Kangaroo Vehicle Collision Detection Using Deep Semantic Segmentation Convolutional Neural Network , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[3]  Saeid Nahavandi,et al.  A Skeleton-Free Fall Detection System From Depth Images Using Random Decision Forest , 2018, IEEE Systems Journal.

[4]  Vladlen Koltun,et al.  Open3D: A Modern Library for 3D Data Processing , 2018, ArXiv.

[5]  Harris Drucker,et al.  Comparison of learning algorithms for handwritten digit recognition , 1995 .

[6]  Saeid Nahavandi,et al.  Towards trusted autonomous vehicles from vulnerable road users perspective , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[7]  Saeid Nahavandi,et al.  Intent prediction of vulnerable road users from motion trajectories using stacked LSTM network , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[8]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[9]  Ian Walker,et al.  Signals are informative but slow down responses when drivers meet bicyclists at road junctions. , 2005, Accident; analysis and prevention.

[10]  Saeid Nahavandi,et al.  Early intent prediction of vulnerable road users from visual attributes using multi-task learning network , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[11]  Andreas Uhl,et al.  BlenSor: Blender Sensor Simulation Toolbox , 2011, ISVC.

[12]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Saeid Nahavandi,et al.  Body joints regression using deep convolutional neural networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[16]  J Jos Elfring,et al.  Predicting the intention of cyclists , 2017 .

[17]  Albert Dipanda,et al.  3D Point Cloud Descriptor for Posture Recognition , 2018, VISIGRAPP.

[18]  S. Nahavandi,et al.  A skeleton-free kinect system for body mass index assessment using deep neural networks , 2017, 2017 IEEE International Systems Engineering Symposium (ISSE).

[19]  Michael Beetz,et al.  Human Action Recognition Using Global Point Feature Histograms and Action Shapes , 2009, Adv. Robotics.

[20]  B. Freeman,et al.  Simple formula for the surface area of the body and a simple model for anthropometry , 2005, Clinical anatomy.

[21]  Saeid Nahavandi,et al.  RGB-D Fall Detection via Deep Residual Convolutional LSTM Networks , 2018, 2018 Digital Image Computing: Techniques and Applications (DICTA).

[22]  Dariu Gavrila,et al.  Using road topology to improve cyclist path prediction , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[23]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Mohammed Hossny,et al.  A Low Cost Anthropometric Body Scanning System Using Depth Cameras , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[25]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[26]  Csaba Benedek,et al.  Lidar-Based Gait Analysis and Activity Recognition in a 4D Surveillance System , 2018, IEEE Transactions on Circuits and Systems for Video Technology.