Real-Time Visual Tracking Insensitive to Three-Dimensional Rotation of Objects

Visual tracking is essential for many applications such as vision-based control of intelligent robots, surveillance, agriculture automation, medical image processing, and so on. Especially, a fast and reliable visual tracking is important since the performance of visual tracking determines the reliability and real-time characteristics of overall system. It is not easy in visual tracking, however, to estimate the configuration of a target object in real-time when the three-dimensional pose of the target object is changing. On the contrary, a human being is able to track an object without the estimation of three-dimensional pose of the object even though three-dimensional rotations and /or occlusion by other objects change the original image of the object. This paper proposes a fast and reliable SSD-based visual tracker insensitive to three-dimensional rotation of an object as well as translation, two-dimensional rotation, scaling, and shear of an object by proposing a performance measure for distortion of current image with respect to an original reference image. The performance measure is a combination of aspect ratio of a rectangle, variations of four internal angles of the rectangle from ninety degrees, the direction of rotation and the angular velocity of the rectangle. So, the reference image for visual tracking is updated whenever the performance measure is greater than an initialized distortion rate without the estimation of three-dimensional pose of an object. The algorithm is experimented in real-time successfully at a personal computer adopted with a general-purpose frame grabber.

[1]  Alistair J. Bray Tracking objects using image disparities , 1990, Image Vis. Comput..

[2]  Kevin Nickels,et al.  Measurement error estimation for feature tracking , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[3]  Gregory D. Hager,et al.  Model-based 3D object tracking using projective invariance , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[4]  Yoshiaki Shirai,et al.  Robust Visual Tracking by Integrating Various Cues , 1998 .

[5]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[6]  Gregory D. Hager,et al.  X Vision: A Portable Substrate for Real-Time Vision Applications , 1998, Comput. Vis. Image Underst..

[7]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yoshiaki Shirai,et al.  Person tracking by integrating optical flow and uniform brightness regions , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[9]  Richard S. Stephens Real-time 3D object tracking , 1990, Image Vis. Comput..

[10]  Natan Peterfreund,et al.  Robust Tracking of Position and Velocity With Kalman Snakes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..