Robust modeling and prediction in dynamic environments using recurrent flow networks

To enable safe motion planning in a dynamic environment, it is vital to anticipate and predict object movements. In practice, however, an accurate object identification among multiple moving objects is extremely challenging, making it infeasible to accurately track and predict individual objects. Furthermore, even for a single object, its appearance can vary significantly due to external effects, such as occlusions, varying perspectives, or illumination changes. In this paper, we propose a novel recurrent network architecture called a recurrent flow network that can infer the velocity of each cell and the probability of future occupancy from a sequence of occupancy grids which we refer to as an occupancy flow. The parameters of the recurrent flow network are optimized using Bayesian optimization. The proposed method outperforms three baseline optical flow methods, Lucas-Kanade, Lucas-Kanade with Tikhonov regularization, and HornSchunck methods, and a Bayesian occupancy grid filter in terms of both prediction accuracy and robustness to noise.

[1]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[4]  Ryan M. Eustice,et al.  Ford Campus vision and lidar data set , 2011, Int. J. Robotics Res..

[5]  Narendra Ahuja,et al.  A potential field approach to path planning , 1992, IEEE Trans. Robotics Autom..

[6]  Christian Laugier,et al.  Dynamic Environment Modeling with Gridmap: A Multiple-Object Tracking Application , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[7]  Karolin Baecker,et al.  Two Dimensional Signal And Image Processing , 2016 .

[8]  Michael Himmelsbach,et al.  Driving with tentacles: Integral structures for sensing and motion , 2008 .

[9]  Jitendra Malik,et al.  Large displacement optical flow , 2009, CVPR.

[10]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[11]  Gerhard Lakemeyer,et al.  Exploring artificial intelligence in the new millennium , 2003 .

[12]  Wolfram Burgard,et al.  Occupancy Grid Models for Robot Mapping in Changing Environments , 2012, AAAI.

[13]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[14]  Tobias Gindele,et al.  Bayesian Occupancy grid Filter for dynamic environments using prior map knowledge , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[15]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[16]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[17]  Kimon P. Valavanis,et al.  Mobile robot navigation in 2-D dynamic environments using an electrostatic potential field , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[19]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[20]  Hans P. Moravec Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[21]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.