Tracking of rigid-bodies for autonomous surveillance

For robotic surveillance systems, real-time knowledge of the motion of objects in the surrounding environment allows greater autonomy and interactivity. In some applications, orientation is of just as much interest as the position of an object. This paper presents a novel 3D model based method for tracking the full 3D pose of a rigid body. The proposed method projects a texture-mapped model of the target object back onto the camera's image plane at the target's current predicted pose. Optical-flow is used to correct the error between the predicted pose and the real pose. Finally, the pose in the next time-step is estimated using a motion predictor such as a Kalman filter (KF). The proposed tracking algorithm was tested using both synthetic and real video sequences of a 50/spl times/50/spl times/50 mm textured cube. This cube's pose was successfully tracked to within 2.5 mm positionally and 0.6/spl deg/ angularly. The cube was approximately 600-840 mm away from the camera.

[1]  Mei Han,et al.  An algorithm for multiple object trajectory tracking , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Michel Dhome,et al.  Real Time Robust Template Matching , 2002, BMVC.

[3]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[4]  Tieniu Tan,et al.  Model-Based Localisation and Recognition of Road Vehicles , 1998, International Journal of Computer Vision.

[5]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Beno Benhabib,et al.  Robotic interception of moving objects using an augmented ideal proportional navigation guidance technique , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Jitendra Malik,et al.  Robust computation of optical flow in a multi-scale differential framework , 2005, International Journal of Computer Vision.

[8]  Ken Sasaki,et al.  Motion planning and control method of dexterous manipulation utilizing a simulation system for a multi-fingered robotic hand , 2001 .

[9]  N. V. Afzulpurkar,et al.  Adaptive linear robot control for tracking and grasping a dynamic object , 2002, 2002 IEEE International Conference on Industrial Technology, 2002. IEEE ICIT '02..

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Stefano Soatto,et al.  Real-time 3D motion and structure of point features: a front-end system for vision-based control and interaction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Louise A. Dennis,et al.  System Description: Embedding Verification into Microsoft Excel , 2000, CADE.

[13]  Min Wang,et al.  Robust neuro-fuzzy sensor-based motion control among dynamic obstacles for robot manipulators , 2003, IEEE Trans. Fuzzy Syst..

[14]  Yasumichi Aiyama,et al.  Stability Map for Graspless Manipulation Planning , 2001 .

[15]  Jitendra Malik,et al.  Robust computation of optical flow in a multi-scale differential framework , 1993, 1993 (4th) International Conference on Computer Vision.

[16]  Jin-Long Chen,et al.  Determining Pose of 3D Objects With Curved Surfaces , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Charles R. Dyer,et al.  Real-time motion tracking of three-dimensional objects , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[18]  Stephen J. McKenna,et al.  Tracking interacting people , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  R.P. Kornfeld,et al.  New millennium ST6 autonomous rendezvous experiment (ARX) , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[21]  Jens-Steffen Gutmann,et al.  Model-based object tracking using stereo vision , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).