Selective automation and skill transfer in medical robotics: a demonstration on surgical knot‐tying

Transferring non‐trivial human manipulation skills to robot systems is a challenging task. There have been a number of attempts to design research systems for skill transfer, but the level of the complexity of the actual skills transferable to the robot was rather limited, and delicate operations requiring a high dexterity and long action sequences with many sub‐operations were impossible to transfer.

[1]  Aude Billard,et al.  Special Issue on Robot Learning by Observation, Demonstration, and Imitation , 2007, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Nassir Navab,et al.  Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[3]  Rüdiger Dillmann,et al.  Towards Cognitive Robots: Building Hierarchical Task Representations of Manipulations from Human Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  J. Bruner,et al.  The role of tutoring in problem solving. , 1976, Journal of child psychology and psychiatry, and allied disciplines.

[5]  Gregory D. Hager,et al.  Automatic Recognition of Surgical Motions Using Statistical Modeling for Capturing Variability , 2008, MMVR.

[6]  Alan F. Blackwell,et al.  Restricted Focus Viewer: A Tool for Tracking Visual Attention , 2000, Diagrams.

[7]  Yoshihiko Nakamura,et al.  Motion Emergency of Humanoid Robots by an Attractor Design of a Nonlinear Dynamics , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Gero Strauß,et al.  Research Paper: Validation of Knowledge Acquisition for Surgical Process Models , 2009, J. Am. Medical Informatics Assoc..

[10]  D. Birchall,et al.  Computational Fluid Dynamics , 2020, Radial Flow Turbocompressors.

[11]  P. Hynes,et al.  Uncalibrated Visual-Servoing of a Dual-Arm Robot for MIS Suturing , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[12]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[13]  Alois Knoll,et al.  Inverse Kinematics and Modelling of a System for Robotic Surgery , 2004 .

[14]  L. Swanstrom,et al.  Developing essential tools to enable transgastric surgery , 2008, Surgical Endoscopy.

[15]  Hyosig Kang,et al.  ROBOTIC ASSISTED SUTURING IN MINIMALLY INVASIVE SURGERY , 2002 .

[16]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Darius Burschka,et al.  Human-machine skill transfer extended by a scaffolding framework , 2008, 2008 IEEE International Conference on Robotics and Automation.

[18]  A. Georgopoulos,et al.  Modular organization of directionally tuned cells in the motor cortex: Is there a short-range order? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Auke Jan Ijspeert,et al.  Simulation and Robotics Studies of Salamander Locomotion Applying Neurobiological Principles to the Control of Locomotion in Robots , 2005 .

[20]  Jianwei Zhang,et al.  Control architecture and experiment of a situated robot system for interactive assembly , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[21]  Jun Nakanishi,et al.  Learning Movement Primitives , 2005, ISRR.

[22]  Shahram Payandeh,et al.  Task and Motion Analyses in Endoscopic Surgery , 1996, Dynamic Systems and Control.

[23]  Rüdiger Dillmann,et al.  Building elementary robot skills from human demonstration , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[24]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[25]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[26]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[27]  J. Giedt,et al.  Rensselaer Polytechnic Institute , 1960, Nature.

[28]  Masakatsu G. Fujie,et al.  Micro Manipulators for Intrauterine Fetal Surgery in an Open MRI , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[29]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[30]  Hidefumi Wakamatsu,et al.  Manipulation Planning for Knotting/Unknotting and Tightly Tying of Deformable Linear Objects , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[31]  Thomas B. Moeslund,et al.  Finding Motion Primitives in Human Body Gestures , 2005, Gesture Workshop.

[32]  T. Chung.  Computational Fluid Dynamics: FOUR. AUTOMATIC GRID GENERATION, ADAPTIVE METHODS, AND COMPUTING TECHNIQUES , 2002 .

[33]  Michael Griebel,et al.  Numerical Simulation in Fluid Dynamics: A Practical Introduction , 1997 .

[34]  Henrik I. Christensen,et al.  Situated dialogue and understanding spatial organization: Knowing what is where and what you can do there , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[35]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[36]  Pradeep K. Khosla,et al.  Trajectory representation using sequenced linear dynamical systems , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[37]  T. Aflalo,et al.  Possible Origins of the Complex Topographic Organization of Motor Cortex: Reduction of a Multidimensional Space onto a Two-Dimensional Array , 2006, The Journal of Neuroscience.

[38]  Alois Knoll,et al.  Haptic Feedback in a Telepresence System for Endoscopic Heart Surgery , 2007, PRESENCE: Teleoperators and Virtual Environments.