Deep-LfD: Deep robot learning from demonstrations

Abstract Like other robot learning from demonstration (LfD) approaches, deep-LfD builds a task model from sample demonstrations. However, unlike conventional LfD, the deep-LfD model learns the relation between high dimensional visual sensory information and robot trajectory/path. This paper presents a dataset of successful needle insertion by da Vinci Research Kit into deformable objects based on which several deep-LfD models are built as a benchmark of models learning robot controller for the needle insertion task.

[1]  Mario Fritz,et al.  Visual stability prediction for robotic manipulation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[2]  D. Jacofsky,et al.  Robotics in Arthroplasty: A Comprehensive Review. , 2016, The Journal of arthroplasty.

[3]  Kok Kiong Tan,et al.  Precision Motion Control using Nonlinear Contact Force Model in a Surgical Device , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Alireza Mirbagheri,et al.  The Sina Robotic Telesurgery System , 2020 .

[5]  Kyle B. Reed,et al.  Robot-Assisted Needle Steering , 2011, IEEE Robotics & Automation Magazine.

[6]  Priya Sundaresan,et al.  Automated Extraction of Surgical Needles from Tissue Phantoms , 2019, 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE).

[7]  Allison M. Okamura,et al.  Planning for Steerable Bevel-tip Needle Insertion Through 2D Soft Tissue with Obstacles , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Hamidreza Hashempour,et al.  A data-set of piercing needle through deformable objects for Deep Learning from Demonstrations , 2020, ArXiv.

[9]  Amir Ghalamzan-E.  Learning needle insertion from sample task executions , 2021 .

[10]  Allison M. Okamura,et al.  Feedback control for steering needles through 3D deformable tissue using helical paths , 2009, Robotics: Science and Systems.

[11]  Yun-Hui Liu,et al.  Dual-Arm Robotic Needle Insertion With Active Tissue Deformation for Autonomous Suturing , 2019, IEEE Robotics and Automation Letters.

[12]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[13]  Alberto Cavallo,et al.  Slipping detection and avoidance based on Kalman filter , 2014 .