Forward Collision Prediction with Online Visual Tracking

Safety is the key aspect when comes to driving. Self-driving vehicles are equipped with driver-assistive technologies like Adaptive Cruise Control, Forward Collision Warning system (FCW) and Collsion Mitigation by Breaking (CMbB) to ensure safety while driving. This paper proposes a method by following a lean way of multi-target tracking implementation and 3D bounding box detection without processing much visual information. Object Tracking is an integral part of environment sensing, which enables the vehicle to estimate the surrounding object’s trajectories to accomplish motion planning. The advancement in the object detection methods greatly benefits when following the tracking by detection approach. This will lead to less complex tracking methodology and thus decreasing the computational cost. Estimation based on particle filter is added to precisely associate the tracklets with detections. The model estimates and plots bounding box for the objects in its camera range and predict the 3D positions in camera coordinates from monocular camera data using a deep learning combined with geometric constraints using 2D bounding box, then the actual distance from the vehicle camera is calculated. The model is evaluated on the KITTI car dataset.

[1]  YangMing-Hsuan,et al.  Structural Constraint Data Association for Online Multi-object Tracking , 2019 .

[2]  Ming-Hsuan Yang,et al.  Structural Constraint Data Association for Online Multi-object Tracking , 2018, International Journal of Computer Vision.

[3]  Xinyu Zhang,et al.  Real-time vehicle detection and tracking using improved histogram of gradient features and Kalman filters , 2018 .

[4]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[5]  Volker Eiselein,et al.  High-Speed tracking-by-detection without using image information , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[6]  Jana Kosecka,et al.  3D Bounding Box Estimation Using Deep Learning and Geometry , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Kuk-Jin Yoon,et al.  Robust Online Multi-object Tracking Based on Tracklet Confidence and Online Discriminative Appearance Learning , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Hong Wang,et al.  Evolving boxes for fast vehicle detection , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Tobias Senst,et al.  Extending IOU Based Multi-Object Tracking by Visual Information , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Mark Reynolds,et al.  Toward Occlusion Handling in Visual Tracking via Probabilistic Finite State Machines , 2020, IEEE Transactions on Cybernetics.

[13]  Dushyant Rao,et al.  Deep tracking in the wild: End-to-end tracking using recurrent neural networks , 2018, Int. J. Robotics Res..

[14]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[15]  Dewant Katare,et al.  Embedded System Enabled Vehicle Collision Detection: An ANN Classifier , 2019, 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC).

[16]  Han Wang,et al.  Vision-based navigation of an unmanned surface vehicle with object detection and tracking abilities , 2017, Machine Vision and Applications.

[17]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.