Vision based 3-D shape sensing of flexible manipulators

Rigid robotic manipulators employ traditional sensors such as encoders or potentiometers to measure joint angles and determine end-effector position. Manipulators that are flexible, however, introduce motions that are much more difficult to measure. This is especially true for continuum manipulators that articulate by means of material compliance. In this paper, we present a vision based system for quantifying the 3-D shape of a flexible manipulator in real-time. The sensor system is validated for accuracy with known point measurements and for precision by estimating a known 3-D shape. We present two applications of the validated system relating to the open-loop control of a tendon driven continuum manipulator. In the first application, we present a new continuum manipulator model and use the sensor to quantify 3-D performance. In the second application, we use the shape sensor system for model parameter estimation in the absence of tendon tension information.

[1]  Takayuki Matsuno,et al.  Flexible rope manipulation by dual manipulator system using vision sensor , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[2]  Ian D. Walker,et al.  Setpoint regulation of continuum robots using a fixed camera , 2007, Proceedings of the 2004 American Control Conference.

[3]  広瀬 茂男,et al.  Biologically inspired robots : snake-like locomotors and manipulators , 1993 .

[4]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[5]  John Kenneth Salisbury,et al.  Mechanics Modeling of Tendon-Driven Continuum Manipulators , 2008, IEEE Transactions on Robotics.

[6]  Takeo Kanade,et al.  A real time system for robust 3D voxel reconstruction of human motions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[8]  Kai Xu,et al.  Actuation compensation for flexible surgical snake-like robots with redundant remote actuation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part I: Theory and Algorithms , 2005, International Journal of Computer Vision.

[10]  Ian D. Walker,et al.  Real-time shape estimation for continuum robots using vision , 2005, Robotica.

[11]  Peter Anderson,et al.  Method for estimating dynamic EM tracking accuracy of surgical navigation tools , 2006, SPIE Medical Imaging.

[12]  Shigeo Hirose,et al.  Biologically Inspired Robots: Snake-Like Locomotors and Manipulators , 1993 .

[13]  Wojciech Matusik,et al.  Polyhedral Visual Hulls for Real-Time Rendering , 2001, Rendering Techniques.

[14]  R. Satava.  Emerging technologies for surgery in the 21st century. , 1999, Archives of surgery.

[15]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[16]  Ian D. Walker,et al.  Kinematics for multisection continuum robots , 2006, IEEE Transactions on Robotics.

[17]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking , 2005, International Journal of Computer Vision.

[18]  Russell H. Taylor,et al.  Robots as Surgical Assistants: Wher We Are, Wither We Are Tending, and How to Get There , 1997, AIME.

[19]  Toby Howard,et al.  Real-time markerless human body tracking with multi-view 3-d voxel reconstruction. , 2004 .

[20]  Hisham Abou-Kandil,et al.  Piezoelectric actuators and sensors location for active control of flexible structures , 2001, IEEE Trans. Instrum. Meas..

[21]  S. E. Lyshevski.  Data-intensive analysis and control of flexible pointing systems with PZT actuators , 2003, IEEE International Frequency Control Symposium and PDA Exhibition Jointly with the 17th European Frequency and Time Forum, 2003. Proceedings of the 2003.