A surgical instruments sorting system based on stereo vision and impedance control

Surgical instrument sorting is a repetitive work with a high risk of infection, which requires medical staffs to classify them after cleaning. Currently, the surgical instrument sorting is usually accomplished by medical staffs' manual operation. It is a time costing work, which may cause operators' fatigue even classification errors. Meanwhile, surgical instruments are relatively sharp and often stick with infectious substances like bloodstain, which brings a potential threat to the health of medical staffs. The sorting robot system can better avoid these threats when it replaces the medical staffs to complete the tasks accurately. This paper proposes a surgical instrument recognition and location method for sorting robot system based on stereo vision. The Voting Scheme for S2S Features will be applied for surgical instrument recognition, in which hash table searching will be used to boost searching speed. The impedance control and artificial potential field will be applied on robot to grab and place the classified surgical instruments. The experiments are conducted with binocular stereo vision and universal robot, and the results show that the system has a good sorting accuracy.

[1]  Darius Burschka,et al.  Rigid 3D geometry matching for grasping of known objects in cluttered scenes , 2012, Int. J. Robotics Res..

[2]  Cheng-yueh Tsai,et al.  Multiple-Camera-Based Gesture Recognition by MDA Method , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[3]  Yi Xu,et al.  An integrated vision-based robotic manipulation system for sorting surgical tools , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[4]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[5]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[6]  Albert H. C. Tsang,et al.  Development of an RFID-based Surgery Management System: Lesson Learnt from a Hong Kong Public Hospital , 2012 .

[7]  Jitendra Malik,et al.  Object Detection in RGB-D Indoor Scenes 1 , 2013 .

[8]  Eisuke Hanada,et al.  Improving efficiency through analysis of data obtained from an RFID tag system for surgical instruments , 2015, 2015 IEEE 5th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[9]  Bülent Sankur,et al.  Shape-based hand recognition , 2006, IEEE Transactions on Image Processing.

[10]  Yi Xu,et al.  Robotic Handling of Surgical Instruments in a Cluttered Tray , 2015, IEEE Transactions on Automation Science and Engineering.

[11]  Rama Chellappa,et al.  Fast object localization and pose estimation in heavy clutter for robotic bin picking , 2012, Int. J. Robotics Res..

[12]  Ming-Yu Liu,et al.  Voting-based pose estimation for robotic assembly using a 3D sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Tsutomu Sawa,et al.  Shimane university hospital implements RFID technology to manage surgical instruments , 2013, 2013 7th International Symposium on Medical Information and Communication Technology (ISMICT).

[14]  Shahin Sirouspour,et al.  Adaptive Control for Improved Transparency in Haptic Simulations , 2009, IEEE Transactions on Haptics.

[15]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[16]  Jun Li,et al.  Mobile bin picking with an anthropomorphic service robot , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[18]  Yi Xu,et al.  A vision-guided robot manipulator for surgical instrument singulation in a cluttered environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Bingbing Ni,et al.  RGBD-HuDaAct: A color-depth video database for human daily activity recognition , 2011, ICCV Workshops.