A Combined Voxel and Particle Filter-Based Approach for Fast Obstacle Detection and Tracking in Automotive Applications

In this paper, a new method for real-time detection, motion estimation, and tracking of generic obstacles using just a 3-D point cloud and odometry information as input is presented. In this approach, a simplification of the world is done using voxels, supported by a particle filter-based 3-D object segmentation and a motion estimation scheme. That combination of techniques leverages a fast and reliable object detection, providing also motion speed and direction information. Four detailed studies have been performed in order to assess the suitability of the method, two of them related to the parameterization of the method and its input point cloud. Another one compares the tracking and detection results with other state-of-the-art methods. Last tests are intended for the characterization of the execution times required. Results are encouraging, with a high detection rate, low error rate, and real-time capable computing performance. In the attached video, it is possible to observe the behavior of the method, both using a stereovision and a light-detection and ranging generated point clouds as an input.

[1]  Sergiu Nedevschi,et al.  Particle Grid Tracking System Stereovision Based Obstacle Perception in Driving Environments , 2012, IEEE Intelligent Transportation Systems Magazine.

[2]  S. Savarese,et al.  Learning an Image-Based Motion Context for Multiple People Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  S. Birchfiled.  A Pixel Dissimilarity Measure That Is Insensitive to Image Sampling , 1998 .

[4]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[6]  Reinhard Klette,et al.  Robust Vehicle Detection and Distance Estimation Under Challenging Lighting Conditions , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Cheng-Chew Lim,et al.  Histogram probabilistic multi-hypothesis tracker with colour attributes , 2015 .

[8]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[9]  Bodo Rosenhahn,et al.  Efficient Multiple People Tracking Using Minimum Cost Arborescences , 2014, GCPR.

[10]  Andreas Zell,et al.  Robust and efficient volumetric occupancy mapping with an application to stereo vision , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Stefan Roth,et al.  Stixmantics: A Medium-Level Model for Real-Time Semantic Scene Understanding , 2014, ECCV.

[12]  Véronique Berge-Cherfaoui,et al.  Multi-modal object detection and localization for high integrity driving assistance , 2014, Machine Vision and Applications.

[13]  Tobias Gindele,et al.  Bayesian Occupancy grid Filter for dynamic environments using prior map knowledge , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[14]  Jayan Eledath,et al.  Collision sensing by stereo vision and radar sensor fusion , 2008 .

[15]  Charles V. Stewart,et al.  A probabilistic representation of LiDAR range data for efficient 3D object detection , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Ram Nevatia,et al.  Learning to associate: HybridBoosted multi-target tracker for crowded scene , 2009, CVPR.

[17]  Christian Laugier,et al.  Bayesian Occupancy Filtering for Multitarget Tracking: An Automotive Application , 2006, Int. J. Robotics Res..

[18]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[19]  Paulo Vinicius Koerich Borges,et al.  Joint Human Detection From Static and Mobile Cameras , 2015, IEEE Transactions on Intelligent Transportation Systems.

[20]  Dezhen Song,et al.  Featureless Motion Vector-Based Simultaneous Localization, Planar Surface Extraction, and Moving Obstacle Tracking , 2014, WAFR.

[21]  Jean-Jacques Bourdin,et al.  A Faster Algorithm for 3D Discrete Lines , 1998, Eurographics.

[22]  Wolfram Burgard,et al.  OctoMap : A Probabilistic , Flexible , and Compact 3 D Map Representation for Robotic Systems , 2010 .

[23]  Christian Laugier,et al.  Dynamic Environment Modeling with Gridmap: A Multiple-Object Tracking Application , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[24]  Dariu Gavrila,et al.  A Probabilistic Framework for Joint Pedestrian Head and Body Orientation Estimation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Alexander Barth,et al.  Estimating the Driving State of Oncoming Vehicles From a Moving Platform Using Stereo Vision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[26]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Leopoldo Acosta,et al.  Generating automatic road network definition files for unstructured areas using a multiclass support vector machine , 2016, Inf. Sci..

[28]  Raúl Rojas,et al.  Large scale Semi-Global Matching on the CPU , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[29]  Cheng Wang,et al.  Automated Extraction of Urban Road Facilities Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[30]  Luc Van Gool,et al.  Robust Multiperson Tracking from a Mobile Platform , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Néstor Morales,et al.  Performance analysis of stereo reconstruction algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[32]  Luc Van Gool,et al.  Moving obstacle detection in highly dynamic scenes , 2009, 2009 IEEE International Conference on Robotics and Automation.

[33]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[35]  Silvio Savarese,et al.  Data-driven 3D Voxel Patterns for object category recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  J. Edmonds.  Paths, Trees, and Flowers , 1965, Canadian Journal of Mathematics.

[37]  Alberto Broggi,et al.  A full-3D voxel-based dynamic obstacle detection for urban scenario using stereo vision , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[38]  Heiko Hirschmüller,et al.  Evaluation of Stereo Matching Costs on Images with Radiometric Differences , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Maziar Palhang,et al.  A region based CAMShift tracking with a moving camera , 2014, 2014 Second RSI/ISM International Conference on Robotics and Mechatronics (ICRoM).

[40]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[41]  Y. Bar-Shalom,et al.  The probabilistic data association filter , 2009, IEEE Control Systems.

[42]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[43]  Bodo Rosenhahn,et al.  Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[44]  Uwe Franke,et al.  Dense, Robust, and Accurate Motion Field Estimation from Stereo Image Sequences in Real-Time , 2010, ECCV.

[45]  Rafael Arnay,et al.  Safe and reliable navigation in crowded unstructured pedestrian areas , 2016, Eng. Appl. Artif. Intell..

[46]  Luc Van Gool,et al.  Depth and Appearance for Mobile Scene Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[47]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[48]  Sergiu Nedevschi,et al.  Stereovision-Based Multiple Object Tracking in Traffic Scenarios Using Free-Form Obstacle Delimiters and Particle Filters , 2015, IEEE Transactions on Intelligent Transportation Systems.

[49]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[50]  Antonio Morell,et al.  MCL with sensor fusion based on a weighting mechanism versus a particle generation approach , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[51]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.