Coordinated control of a dual-arm robot for surgical instrument sorting tasks

Abstract Surgical instrument sorting tasks are usually performed by medical staff. Because of the large number and special structure of surgical instruments, the manual processing method has certain drawbacks: it is time-consuming, poses an infection risk and has potential for errors. Moreover, a relatively sharp surgical instrument poses a potential threat to the staff’s health. In this paper, to complete the sorting task accurately and avoid these threats, a coordinated control strategy based on fuzzy hybrid control is proposed for dual-arm coordinated operations. First, sorting information is obtained through identification, location and grasping pose detection of surgical instruments. Second, according to the characteristics of the dual-arm coordinated operation, a kinematics model of three tight coordination tasks is established and a passive compliant structure is applied to simplify the motion of surgical scissor stretching. Then, a hybrid fuzzy control strategy is proposed for dual-arm coordinated operations. Using this strategy, the contact force in the process of unlocking surgical scissors is adaptively adjusted. Finally, the proposed control strategy is validated using comparative analysis and in robotic experiments. The experimental results demonstrate that the proposed control strategy is suitable for a dual-arm robot to efficiently implement instrument sorting tasks.

[1]  Hsu-Chih Huang An Evolutionary Optimal Fuzzy System With Information Fusion of Heterogeneous Distributed Computing and Polar-Space Dynamic Model for Online Motion Control of Swedish Redundant Robots , 2017, IEEE Transactions on Industrial Electronics.

[2]  Yi Xu,et al.  A vision-guided robot manipulator for surgical instrument singulation in a cluttered environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[3]  ChangHwan Kim,et al.  Human-Like Motion Generation and Control for Humanoid's Dual Arm Object Manipulation , 2015, IEEE Transactions on Industrial Electronics.

[4]  Yun Zhang,et al.  Adaptive robust fuzzy control for dual arm robot with unknown input deadzone nonlinearity , 2015, Nonlinear Dynamics.

[5]  Davide Nicolis,et al.  Occlusion-Free Visual Servoing for the Shared Autonomy Teleoperation of Dual-Arm Robots , 2018, IEEE Robotics and Automation Letters.

[6]  Jianwei Zhang,et al.  Fuzzy Force Control and State Detection in Vertebral Lamina Milling , 2016 .

[7]  Ismael Lopez-Juarez,et al.  Towards learning contact states during peg-in-hole assembly with a dual-arm robot , 2017, 2017 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON).

[8]  Guillermo Heredia,et al.  Physical-Virtual Impedance Control in Ultralightweight and Compliant Dual-Arm Aerial Manipulators , 2018, IEEE Robotics and Automation Letters.

[9]  Brahim Bouzouia,et al.  Optimal path planning and execution for mobile robots using genetic algorithm and adaptive fuzzy-logic control , 2017, Robotics Auton. Syst..

[10]  Vincenzo Lippiello,et al.  Image-Based Visual-Impedance Control of a Dual-Arm Aerial Manipulator , 2018, IEEE Robotics and Automation Letters.

[11]  Alessandro Freddi,et al.  Dual-arm cooperative manipulation under joint limit constraints , 2018, Robotics Auton. Syst..

[12]  Rong-Jong Wai,et al.  Robust Neural-Fuzzy-Network Control for Robot Manipulator Including Actuator Dynamics , 2006, IEEE Transactions on Industrial Electronics.

[13]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jan Rosell,et al.  Task-Dependent Synergies for Motion Planning of an Anthropomorphic Dual-Arm System , 2017, IEEE Transactions on Robotics.

[15]  K. Madhava Krishna,et al.  Reactionless visual servoing of a multi-arm space robot combined with other manipulation tasks , 2017, Robotics Auton. Syst..

[16]  P. R. McAree,et al.  How do ICP variants perform when used for scan matching terrain point clouds? , 2017, Robotics Auton. Syst..

[17]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[18]  Yi Xu,et al.  Robotic Handling of Surgical Instruments in a Cluttered Tray , 2015, IEEE Transactions on Automation Science and Engineering.

[19]  Rajnikant V. Patel,et al.  The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System , 2017, IEEE Transactions on Haptics.

[20]  Antonio Bicchi,et al.  Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations , 2018, IEEE Transactions on Robotics.

[21]  Yumi Iwakami,et al.  Validation of cleaning evaluation of surgical instruments with RFID tags attached based on cleaning appraisal judgment guidelines , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Ying Hu,et al.  A surgical instruments sorting system based on stereo vision and impedance control , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).

[23]  C. L. Philip Chen,et al.  Adaptive Neural Control for Dual-Arm Coordination of Humanoid Robot With Unknown Nonlinearities in Output Mechanism , 2015, IEEE Transactions on Cybernetics.

[24]  Yi Xu,et al.  An integrated vision-based robotic manipulation system for sorting surgical tools , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[25]  Amit Konar,et al.  Interval type-2 fuzzy logic based multiclass ANFIS algorithm for real-time EEG based movement control of a robot arm , 2015, Robotics Auton. Syst..

[26]  Paulo Dias,et al.  Automatic registration of laser reflectance and colour intensity images for 3D reconstruction , 2002, Robotics Auton. Syst..

[27]  Jan Rosell,et al.  Motion Planning by Demonstration With Human-Likeness Evaluation for Dual-Arm Robots , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Xian Zhou,et al.  Closed-Chain Manipulation of Large Objects by Multi-Arm Robotic Systems , 2016, IEEE Robotics and Automation Letters.

[29]  Dong Il Park,et al.  Design and analysis of the dual arm manipulator for rescue robot , 2017, 2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[30]  Yong Tang,et al.  Decentralised adaptive fuzzy control of coordinated multiple mobile manipulators interacting with non-rigid environments , 2013 .

[31]  Zdenko Kovacic,et al.  Cartesian robot operation with fuzzy adaptive force control , 2017, 2017 25th Mediterranean Conference on Control and Automation (MED).

[32]  Juan Pablo Wachs,et al.  Needle in a haystack: Interactive surgical instrument recognition through perception and manipulation , 2017, Robotics Auton. Syst..