Vision-based force measurement

This paper demonstrates a method to visually measure the force distribution applied to a linearly elastic object using the contour data in an image. The force measurement is accomplished by making use of the result from linear elasticity that the displacement field of the contour of a linearly elastic object is sufficient to completely recover the force distribution applied to the object. This result leads naturally to a deformable template matching approach where the template is deformed according to the governing equations of linear elasticity. An energy minimization method is used to match the template to the contour data in the image. This technique of visually measuring forces we refer to as vision-based force measurement (VBFM). VBFM has the potential to increase the robustness and reliability of micromanipulation and biomanipulation tasks where force sensing is essential for success. The effectiveness of VBFM is demonstrated for both a microcantilever beam and a microgripper. A sensor resolution of less than +/-3 nN for the microcantilever and +/-3 mN for the microgripper was achieved using VBFM. Performance optimizations for the energy minimization problem are also discussed that make this algorithm feasible for real-time applications.

[1]  Gaudenz Danuser,et al.  Observing deformations of 20 nm with a low-numerical-aperture light microscope , 1996, Other Conferences.

[2]  Gaudenz Danuser.  Observing Deformations of 20 Nanometer with a Low Numerical Aperture Light Microscope , 1996 .

[3]  Robert Barrett,et al.  Atomic force microscopy using a piezoresistive cantilever , 1991, TRANSDUCERS '91: 1991 International Conference on Solid-State Sensors and Actuators. Digest of Technical Papers.

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  John Sylvester,et al.  The Dirichlet to Neumann map and applications , 1989 .

[6]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[7]  Dimitris N. Metaxas.  Physics-Based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging , 1996 .

[8]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[9]  Dimitris N. Metaxas.  Physics-Based Deformable Models , 1996 .

[10]  Dmitry B. Goldgof,et al.  Efficient Nonlinear Finite Element Modeling of Nonrigid Objects via Optimization of Mesh Models , 1998, Comput. Vis. Image Underst..

[11]  G. K. Ananthasuresh,et al.  Vision-based sensing of forces in elastic objects , 2001 .

[12]  W. G. Bickley.  Mathematical Theory Of Elasticity , 1946, Nature.

[13]  Yu Zhou,et al.  Sensor-based microassembly of hybrid MEMS devices , 1998 .

[14]  G. Uhlmann,et al.  IDENTIFICATION OF LAME PARAMETERS BY BOUNDARY MEASUREMENTS , 1993 .

[15]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[16]  Lawrence E. Payne,et al.  Uniqueness Theorems in Linear Elasticity , 1971 .

[17]  Bradley J. Nelson,et al.  A flexible experimental workcell for efficient and reliable wafer-level 3D micro-assembly , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[18]  Fumihito Arai,et al.  3D nanorobotic manipulations of multi-walled carbon nanotubes , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[19]  Garret N. Vanderplaats,et al.  Numerical optimization techniques for engineering design , 1999 .

[20]  Makoto Kaneko,et al.  Vision based active sensor using a flexible beam , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).