Learning a Curve Guardian for Motorcycles

Up to 17% of all motorcycle accidents occur when the rider is maneuvering through a curve and the main cause of curve accidents can be attributed to inappropriate speed and wrong intra-lane position of the motorcycle. Existing curve warning systems lack crucial state estimation components and do not scale well. We propose a new type of road curvature warning system for motorcycles, combining the latest advances in computer vision, optimal control and mapping technologies to alleviate these shortcomings. Our contributes are fourfold: 1) we predict the motorcycle’s intra-lane position using a convolutional neural network (CNN), 2) we predict the motorcycle roll angle using a CNN, 3) we use an upgraded controller model that incorporates road incline for a more realistic model and prediction, 4) we design a scale-able system by utilizing HERE Technologies map database to obtain the accurate road geometry of the future path. In addition, we present two datasets that are used for training and evaluating of our system respectively, both datasets will be made publicly available. We test our system on a diverse set of real world scenarios and present a detailed case-study. We show that our system is able to predict more accurate and safer curve trajectories, and consequently warn and improve the safety for motorcyclists.

[1]  Manfred Morari,et al.  Optimization‐based autonomous racing of 1:43 scale RC cars , 2015, ArXiv.

[2]  C. K. Chen,et al.  Modelling and model predictive control for a bicycle-rider system , 2018 .

[3]  Javier Alonso-Mora,et al.  Parallel autonomy in automated vehicles: Safe motion generation with minimal intervention , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Luc Van Gool,et al.  End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners , 2018, ECCV.

[5]  Alexander Liniger,et al.  Real-time control for at-limit handling driving on a predefined path , 2020, Vehicle System Dynamics.

[6]  Alexander Domahidi,et al.  FORCES NLP: an efficient implementation of interior-point methods for multistage nonlinear nonconvex programs , 2020, Int. J. Control.

[7]  Francesco Biral,et al.  A Curvilinear Abscissa Approach for the Lap Time Optimization of Racing Vehicles , 2014 .

[8]  Francesco Borrelli,et al.  Predictive Active Steering Control for Autonomous Vehicle Systems , 2007, IEEE Transactions on Control Systems Technology.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Hicham Hadj-Abdelkader,et al.  Image-Based Lateral Position, Steering Behavior Estimation, and Road Curvature Prediction for Motorcycles , 2018, IEEE Robotics and Automation Letters.

[11]  John R. Hauser,et al.  Motorcycle modeling for high-performance maneuvering , 2006, IEEE Control Systems.

[12]  Mauro Da Lio,et al.  On Curve Negotiation: From Driver Support to Automation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[13]  Marc Schlipsing,et al.  Video-based roll angle estimation for two-wheeled vehicles , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[14]  Thierry Hermitte,et al.  TRACE Project. Deliverable 1.3. Road users and accident causation. Part 3: Summary report , 2008 .

[15]  John Lygeros,et al.  Real-Time Control for Autonomous Racing Based on Viability Theory , 2017, IEEE Transactions on Control Systems Technology.

[16]  Mara Tanelli,et al.  Roll angle estimation in two-wheeled vehicles , 2009 .

[17]  John R. Hauser,et al.  A virtual rider for motorcycles: An approach based on optimal control and maneuver regulation , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[18]  Francesco Biral,et al.  Experimental evaluation of a system for assisting motorcyclists to safely ride road bends , 2014 .

[19]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[20]  Francesco Biral,et al.  An intelligent curve warning system for powered two wheel vehicles , 2010 .

[21]  A. Beghi,et al.  Model predictive for path following with motorcycles: application to the development of the pilot model for virtual prototyping , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[22]  Luc Van Gool,et al.  Learning Accurate, Comfortable and Human-like Driving , 2019, ArXiv.

[23]  Matteo Massaro,et al.  Real-Time Roll Angle Estimation for Two-Wheeled Vehicles , 2012 .

[24]  Hicham Hadj-Abdelkader,et al.  Inverse Perspective Mapping Roll Angle Estimation for Motorcycles , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[25]  Thomas Brox,et al.  Image Orientation Estimation with Convolutional Networks , 2015, GCPR.

[26]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..