A Line Segment Based Approach for 3D Motion Estimation and Tracking of Multiple Objects

A line segment based approach for 3D motion estimation and tracking of multiple objects from a monocular image sequence is presented. Objects are described by means of 3D line segments, and their presence in the scene is associated with the detection of 2D line segments on the image plane. A change detection algorithm is applied to detect moving objects on the image plane and a Hough-based algorithm is used to individuate 2D line segments. 3D parameters of each line segment are estimated, at each time instant, by means of an extended Kalman filter (EKF), whose observations are the displacements of 2D line segment endpoints on the image plane. Results on both synthetic and real scenes are presented.

[1]  Ramesh C. Jain,et al.  Illumination independent change detection for real world image sequences , 1989, Comput. Vis. Graph. Image Process..

[2]  S. G. Johnson,et al.  The application of automated recognition techniques to side-scan sonar imagery , 1994 .

[3]  Gian Luca Foresti,et al.  Grouping as a Searching Process for Minimum-Energy Configurations of Labelled Random Fields , 1996, Comput. Vis. Image Underst..

[4]  Gian Luca Foresti,et al.  A Hough-Based Matching of 2D Line Segments in a Monocular Image Sequence , 1996, Int. J. Pattern Recognit. Artif. Intell..

[5]  Thomas S. Huang,et al.  Three-dimensional motion determination from real scene images using straight line correspondences , 1992, Pattern Recognit..

[6]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..

[8]  Minas E. Spetsakis,et al.  Closed Form Solution to the Structure from Motion Problem from Line Correspondences , 1987, AAAI.

[9]  Vittorio Murino,et al.  A real-time image-processing system for visual inspection of real environments , 1994 .

[10]  Stuart Russell,et al.  Symbolic Traffic Scene Analysis Using Dynamic Belief Networks , 1993 .

[11]  Tieniu Tan,et al.  Structure from Motion Using the Ground Plane Constraint , 1992, ECCV.

[12]  Joachim Heel.  Temporal surface reconstruction , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[14]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[15]  Thomas S. Huang,et al.  Estimation of rigid body motion using straight line correspondences , 1986, Comput. Vis. Graph. Image Process..

[16]  Thomas S. Huang,et al.  A linear algorithm for motion estimation using straight line correspondences , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[17]  Zhengyou Zhang.  Estimating Motion and Structure from Correspondences of Line Segments between Two Perspective Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Gian Luca Foresti,et al.  Distributed hierarchical regularization system for recognition of planar surfaces , 1993 .