A Deformable Object Tracking Algorithm Based on the Boundary Element Method that is Robust to Occlusions and Spurious Edges

Abstract The manipulation of deformable objects is an important problem in robotics and arises in many applications including biomanipulation, microassembly, and robotic surgery. For some applications, the robotic manipulator itself may be deformable. Vision-based deformable object tracking can provide feedback for these applications. Computer vision is a logical sensing choice for tracking deformable objects because the large amount of data that is collected by a vision system allows many points within the deformable object to be tracked simultaneously. This article introduces a template based deformable object tracking algorithm, based on the boundary element method, that is able to track a wide range of deformable objects. The robustness of this algorithm to occlusions and to spurious edges in the source image is also demonstrated. A robust error measure is used to handle the problem of occlusion and an improved edge detector based on the Canny edge operator is used to suppress spurious edges. This article concludes by quantifying the performance increase provided by the robust error measure and the robust edge detector. The performance of the algorithm is also demonstrated through the tracking of a sequence of cardiac MRI images.

[1]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[2]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[3]  Bradley J. Nelson,et al.  Biological Cell Injection Using an Autonomous MicroRobotic System , 2002, Int. J. Robotics Res..

[4]  M. E. Galassi,et al.  GNU SCIENTI C LIBRARY REFERENCE MANUAL , 2005 .

[5]  Dimitris N. Metaxas.  Physics-Based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging , 1996 .

[6]  Demetri Terzopoulos,et al.  A finite element model for 3D shape reconstruction and nonrigid motion tracking , 1993, 1993 (4th) International Conference on Computer Vision.

[7]  Yoshihiko Nakamura,et al.  Heartbeat synchronization for robotic cardiac surgery , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[9]  Dimitris N. Metaxas.  Physics-Based Deformable Models , 1996 .

[10]  W. G. Bickley.  Mathematical Theory Of Elasticity , 1946, Nature.

[11]  Dmitry B. Goldgof,et al.  Efficient Nonlinear Finite Element Modeling of Nonrigid Objects via Optimization of Mesh Models , 1998, Comput. Vis. Image Underst..

[12]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[13]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[14]  M. A. Jaswon,et al.  Integral equation methods in potential theory and elastostatics , 1977 .

[15]  W. Hays.  Applied Regression Analysis. 2nd ed. , 1981 .

[16]  Frank J. Rizzo,et al.  An integral equation approach to boundary value problems of classical elastostatics , 1967 .

[17]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[18]  Gernot Beer,et al.  Programming the Boundary Element Method , 2001 .

[19]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[21]  Bradley J. Nelson,et al.  Vision-based force measurement , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[23]  G. K. Ananthasuresh,et al.  Vision-based sensing of forces in elastic objects , 2001 .