On modeling ego-motion uncertainty for moving object detection from a mobile platform

In this paper, we propose an effective approach for moving object detection based on modeling the ego-motion uncertainty and using a graph-cut based motion segmentation. First, the relative camera pose is estimated by minimizing the sum of reprojection errors and its covariance matrix is calculated using a first-order errors propagation method. Next, a motion likelihood for each pixel is obtained by propagating the uncertainty of the ego-motion to the Residual Image Motion Flow (RIMF). Finally, the motion likelihood and the depth gradient are used in a graph-cut based approach as region and boundary terms respectively, in order to obtain the moving objects segmentation. Experimental results on real-world data show that our approach can detect dynamic objects which move on the epipolar plane or that are partially occluded in complex urban traffic scenes.

[1]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[2]  Julius Ziegler,et al.  Sparse scene flow segmentation for moving object detection in urban environments , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[3]  K. Madhava Krishna,et al.  Motion segmentation of multiple objects from a freely moving monocular camera , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Juan I. Nieto,et al.  Stereo-based motion detection and tracking from a moving platform , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[5]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[6]  Xiaoyan Hu,et al.  A Quantitative Evaluation of Confidence Measures for Stereo Vision , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[8]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[9]  Larry H. Matthies,et al.  Real-time detection of moving objects from moving vehicles using dense stereo and optical flow , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[10]  Jorge S. Marques,et al.  Performance evaluation of object detection algorithms for video surveillance , 2006, IEEE Transactions on Multimedia.

[11]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Concetto Spampinato,et al.  Adaptive Background Modeling Integrated With Luminosity Sensors and Occlusion Processing for Reliable Vehicle Detection , 2011, IEEE Transactions on Intelligent Transportation Systems.

[13]  Takeo Kanade,et al.  Background Subtraction for Freely Moving Cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Mubarak Shah,et al.  Detection of Independently Moving Objects in Non-planar Scenes via Multi-Frame Monocular Epipolar Constraint , 2012, ECCV.

[15]  K. Madhava Krishna,et al.  Moving object detection by multi-view geometric techniques from a single camera mounted robot , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[17]  J. Clarke Modelling uncertainty: A primer , 1998 .

[18]  Robert M. Haralick Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[19]  Z. Hu,et al.  U-V-disparity: an efficient algorithm for stereovision based scene analysis , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  Daniel Cremers,et al.  Stereo Scene Flow for 3D Motion Analysis , 2011 .

[22]  Sergio Escalera,et al.  Graph cuts optimization for multi-limb human segmentation in depth maps , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, CVPR.

[24]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[25]  Benjamin Quost,et al.  Moving objects detection and credal boosting based recognition in urban environments , 2013, 2013 IEEE Conference on Cybernetics and Intelligent Systems (CIS).

[26]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.