Robotic Handling of Surgical Instruments in a Cluttered Tray

We developed a unique robotic manipulation system that accurately singulates surgical instruments in a cluttered environment. A novel single-view computer vision algorithm identifies the next instrument to grip from a cluttered pile and a compliant electromagnetic gripper picks up the identified instrument. System is validated through extensive experiments. This research was motivated by the challenges of perioperative process in hospitals today. Current process of instrument counting, sorting, and sterilization is highly labor intensive. Improperly sterilized instruments have resulted in many cases of infections. To address these challenges, an integrated robotic system for sorting instruments in a cluttered tray is designed and implemented. A digital camera is used to capture an image of a cluttered tray. A novel single-view vision algorithm is used to detect the instruments and determine the top instrument. Position and orientation of the top instrument is transferred to a robot. A compliant electromagnetic gripper is developed to complete the gripping. Experiments have demonstrated high success rate of both instrument recognition and manipulation. In the future, error handling needs to be further reinforced under various exceptions for better robustness.

[1]  Ashok Veeraraghavan,et al.  Finding a needle in a specular haystack , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Emanuele Menegatti,et al.  Flexible 3D localization of planar objects for industrial bin-picking with monocamera vision system , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[3]  Bohyung Han,et al.  Learning occlusion with likelihoods for visual tracking , 2011, 2011 International Conference on Computer Vision.

[4]  Jun Li,et al.  Mobile bin picking with an anthropomorphic service robot , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Yi Xu,et al.  A vision-guided robot manipulator for surgical instrument singulation in a cluttered environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Martial Hebert,et al.  Occlusion reasoning for object detection under arbitrary viewpoint , 2012, CVPR.

[7]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[8]  Matei T. Ciocarlie,et al.  Mobile Manipulation in Unstructured Environments: Perception, Planning, and Execution , 2012, IEEE Robotics & Automation Magazine.

[9]  Akio Kosaka,et al.  Vision-based bin-picking: recognition and localization of multiple complex objects using simple visual cues , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[10]  ColletAlvaro,et al.  The MOPED framework , 2011 .

[11]  Darius Burschka,et al.  Rigid 3D geometry matching for grasping of known objects in cluttered scenes , 2012, Int. J. Robotics Res..

[12]  Siddhartha S. Srinivasa,et al.  The MOPED framework: Object recognition and pose estimation for manipulation , 2011, Int. J. Robotics Res..

[13]  Rama Chellappa,et al.  Fast object localization and pose estimation in heavy clutter for robotic bin picking , 2012, Int. J. Robotics Res..

[14]  Ming-Yu Liu,et al.  Voting-based pose estimation for robotic assembly using a 3D sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Takeo Kanade,et al.  6D pose estimation of textureless shiny objects using random ferns for bin-picking , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  C. Beleznai,et al.  Road Sign Detection from Edge Orientation Histograms , 2007, 2007 IEEE Intelligent Vehicles Symposium.