Group Multi-Object Tracking for Dynamic Risk Map and Safe Path Planning

This paper studies the group multi-object tracking (MOT) problem in dynamic pedestrian environments, with intended application to safe navigation for autonomous vehicles. We complete a full autonomous vehicle navigation pipeline from object detection, tracking, grouping, to risk map generation and safe path planning. Our main contribution is to instantiate a group multi-object tracking algorithm, which provides the crucial grouped activity information, i.e. group position, group velocity, group size, to the risk map generator, and therewith produce a stable and robust risk map for the downstream safe path planner. Experimental results with real world data show the socially acceptable, robust and stable performance of the proposed algorithm over its individual MOT counterpart.

[1]  Shuo Yang,et al.  SMOT: Single-Shot Multi Object Tracking , 2020, ArXiv.

[2]  D. Rus,et al.  Safe Path Planning with Multi-Model Risk Level Sets , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Ming Liu,et al.  Robust Pedestrian Tracking in Crowd Scenarios Using an Adaptive GMM-based Framework , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Qi Zou,et al.  Looking ahead: Joint small group detection and tracking in crowd scenes , 2020, J. Vis. Commun. Image Represent..

[5]  Xinggang Wang,et al.  FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking , 2020, International Journal of Computer Vision.

[6]  Vladlen Koltun,et al.  Tracking Objects as Points , 2020, ECCV.

[7]  Marcelo H. Ang,et al.  Safe Path Planning with Gaussian Process Regulated Risk Map , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Daniela Rus,et al.  Dynamic Risk Density for Autonomous Navigation in Cluttered Environments without Object Detection , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[9]  Xingyi Zhou,et al.  Objects as Points , 2019, ArXiv.

[10]  Laura Leal-Taixé,et al.  Tracking Without Bells and Whistles , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Daniela Rus,et al.  Navigating Congested Environments with Risk Level Sets , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Xiangyu Zhang,et al.  CrowdHuman: A Benchmark for Detecting Human in a Crowd , 2018, ArXiv.

[13]  Trevor Darrell,et al.  Deep Layer Aggregation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[15]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Anurag Mittal,et al.  Co-operative Pedestrians Group Tracking in Crowded Scenes Using an MST Approach , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[20]  Javier V. Gómez,et al.  Fast marching solution for the social path planning problem , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  R. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Noname manuscript No. (will be inserted by the editor) Probabilistically Safe Motion Planning to Avoid Dynamic Obstacles with Uncertain Motion Patterns , 2022 .