Shape Sensing of Flexible Manipulators With Visual Occlusion Based on Bezier Curve

Flexible manipulators are promising in minimally invasive surgery, because they can work well in complex and confined environment. The size of the manipulator is usually small, which makes it very difficult to install sensors to measure the distal tip position and manipulator shape. However, the shape information is crucial in controlling the instruments. In this paper, the shape of the manipulator is estimated by endoscopic view based on Bezier curve and the Levenberg–Marquardt algorithm. This method works even the view is partially occluded. Compared with existing none-vision based shape sensing method, no additional sensor is needed in the proposed method. The method is evaluated by both simulations and experiments. Meanwhile, the influence of the occlusion on the sensing accuracy is analyzed. The experimental results show that the shape information of the flexible manipulator both with and without payload can be well estimated by the proposed method.

[1]  Ruxu Du,et al.  Statics modeling of an underactuated wire-driven flexible robotic arm , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[2]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..

[3]  Jenny Dankelman,et al.  Accuracy of needle position measurements using fiber Bragg gratings , 2012, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[4]  Emad M Boctor,et al.  Three‐dimensional ultrasound‐guided robotic needle placement: an experimental evaluation , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[5]  Ruxu Du,et al.  Design and Analysis of a Bio-Inspired Wire-Driven Multi-Section Flexible Robot , 2013 .

[6]  Gregory S. Chirikjian,et al.  Equilibrium Conformations of Concentric-tube Continuum Robots , 2010, Int. J. Robotics Res..

[7]  Peter Kazanzides,et al.  Real-Time Image-Guided Telerobotic System Integrating 3D Slicer and the Da Vinci Research Kit , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[8]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Frank Chongwoo Park,et al.  Optimizing curvature sensor placement for fast, accurate shape sensing of continuum robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Pierre E. Dupont,et al.  Design and Control of Concentric-Tube Robots , 2010, IEEE Transactions on Robotics.

[11]  S. Misra,et al.  Mechanics-based model for predicting in-plane needle deflection with multiple bends , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[12]  Shuang Song,et al.  Electromagnetic Positioning for Tip Tracking and Shape Sensing of Flexible Robots , 2015, IEEE Sensors Journal.

[13]  R. J. Black,et al.  Real-Time Estimation of 3-D Needle Shape and Deflection for MRI-Guided Interventions , 2010, IEEE/ASME Transactions on Mechatronics.

[14]  Xiao Li,et al.  Pose Measurement Method and Experiments for High-Speed Rolling Targets in a Wind Tunnel , 2014, Sensors.

[15]  Jean-Pierre Merlet,et al.  Interval-Analysis-Based Determination of the Wrench-Feasible Workspace of Parallel Cable-Driven Robots , 2011, IEEE Transactions on Robotics.

[16]  Christopher D. Rahn,et al.  Geometrically Exact Models for Soft Robotic Manipulators , 2008, IEEE Transactions on Robotics.

[17]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Gianluca Palli,et al.  Friction compensation techniques for tendon-driven robotic hands , 2014 .

[19]  Kai Xu,et al.  Analytic Formulation for Kinematics, Statics, and Shape Restoration of Multibackbone Continuum Robots Via Elliptic Integrals , 2010 .

[20]  Kaspar Althoefer,et al.  Highly dexterous 2‐module soft robot for intra‐organ navigation in minimally invasive surgery , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[21]  P. E. Dupont,et al.  Concentric Tube Robots for Minimally Invasive Surgery , 2012 .

[22]  Shuang Song,et al.  Real-Time Shape Estimation for Wire-Driven Flexible Robots With Multiple Bending Sections Based on Quadratic Bézier Curves , 2015, IEEE Sensors Journal.

[23]  Zheng Li,et al.  Design of a Novel Flexible Endoscope-Cardioscope , 2015 .

[24]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Ruxu Du,et al.  DESIGN AND ANALYSIS OF A BIOMIMETIC WIRE-DRIVEN ROBOT ARM , 2011 .

[26]  K. Kume Flexible robotic endoscopy: current and original devices , 2016, Computer assisted surgery.