Survey on multi-robot manipulation of deformable objects

Autonomous manipulation of deformable objects is a research topic of increasing interest due to the variety of current processes and applications that include this type of tasks. It is a complex problem that involves aspects such as modeling, control, perception, planning, grasping, estimation, etc. A single robot may be unable to perform the manipulation when the deformable object is too big, too heavy or difficult to grasp. Then, using multiple robots working together naturally arises as a solution to perform coordinately the manipulation task. In this paper, we contribute a survey of relevant state-of-the-art approaches concerning manipulation of deformable objects by multiple robots, which includes a specific classification with different criteria and a subsequent analysis of the leading methods, the main challenges and the future research directions.

[1]  Olac Fuentes,et al.  Experimental evaluation of uncalibrated visual servoing for precision manipulation , 1997, Proceedings of International Conference on Robotics and Automation.

[2]  Dmitry Berenson,et al.  Manipulation of deformable objects without modeling and simulating deformation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Peter I. Corke,et al.  Towards vision-based manipulation of plastic materials , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Timothy Bretl,et al.  Quasi-static manipulation of a planar elastic rod using multiple robotic grippers , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Kayo Yoshimoto,et al.  Active shaping of an unknown rheological object based on deformation decomposition into elasticity and plasticity , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Ross A. Knepper,et al.  Local motion planning for collaborative multi-robot manipulation of deformable objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Shinichi Hirai,et al.  Robust manipulation of deformable objects by a simple PID feedback , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  Yunhui Liu,et al.  Automatic 3-D Manipulation of Soft Objects by Robotic Arms With an Adaptive Deformation Model , 2016, IEEE Transactions on Robotics.

[9]  Philippe Martinet,et al.  Dynamic modeling of cooperative robots holding flexible objects , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[10]  Philippe Martinet,et al.  Robotic cutting of soft materials using force control & image moments , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[11]  Vijay Kumar,et al.  Dynamics, Control and Planning for Cooperative Manipulation of Payloads Suspended by Cables from Multiple Quadrotor Robots , 2013, Robotics: Science and Systems.

[12]  Masayoshi Tomizuka,et al.  A Framework for Manipulating Deformable Linear Objects by Coherent Point Drift , 2018, IEEE Robotics and Automation Letters.

[13]  Hidefumi Wakamatsu,et al.  Deformation path planning for manipulation of flexible circuit boards , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Vincenzo Lippiello,et al.  Nonprehensile Manipulation of Deformable Objects: Achievements and Perspectives from the Robotic Dynamic Manipulation Project , 2018, IEEE Robotics & Automation Magazine.

[15]  Zerui Wang,et al.  A Robust Data-Driven Approach for Online Learning and Manipulation of Unmodeled 3-D Heterogeneous Compliant Objects , 2018, IEEE Robotics and Automation Letters.

[16]  Pierre Payeur,et al.  Dexterous Robotic Manipulation of Deformable Objects with Multi-Sensory Feedback - a Review , 2010 .

[17]  Takashi Suehiro,et al.  In-air Knotting of Rope by a Dual-arm Multi-finger Robot , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Krishnanand N. Kaipa,et al.  Integration of Planning and Deformation Model Estimation for Robotic Cleaning of Elastically Deformable Objects , 2018, IEEE Robotics and Automation Letters.

[19]  Roi Poranne,et al.  Interactive Robotic Manipulation of Elastic Objects , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Dinesh Manocha,et al.  Manipulating Highly Deformable Materials Using a Visual Feedback Dictionary , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Dmitry Berenson,et al.  Estimating Model Utility for Deformable Object Manipulation Using Multiarmed Bandit Methods , 2018, IEEE Transactions on Automation Science and Engineering.

[22]  André Crosnier,et al.  Dual-arm robotic manipulation of flexible cables , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  P. Jiménez,et al.  Survey on model-based manipulation planning of deformable objects , 2012 .

[24]  Ronen Basri,et al.  Elasticity-based Matching by Minimizing the Symmetric Difference of Shapes , 2015, IET Comput. Vis..

[25]  John T. Wen,et al.  Collaborative human-robot manipulation of highly deformable materials , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Yunhui Liu,et al.  Position Control of Robot Manipulators Manipulating a Flexible Payload , 1999, Int. J. Robotics Res..

[27]  Fernando Torres Medina,et al.  Tactile control based on Gaussian images and its application in bi-manual manipulation of deformable objects , 2017, Robotics Auton. Syst..

[28]  Frank L. Lewis,et al.  Shape control of flexible structure using potential field method , 2008, 2008 IEEE International Conference on Control Applications.

[29]  Jadav Das,et al.  Autonomous Shape Control of a Deformable Object by Multiple Manipulators , 2011, J. Intell. Robotic Syst..

[30]  Masayoshi Tomizuka,et al.  Robotic manipulation of deformable objects by tangent space mapping and non-rigid registration , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Yunhui Liu,et al.  Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators , 2013, IEEE Transactions on Robotics.

[32]  Yun-Hui Liu,et al.  Fourier-Based Shape Servoing: A New Feedback Method to Actively Deform Soft Objects into Desired 2-D Image Contours , 2018, IEEE Transactions on Robotics.

[33]  Yoshiaki Fujita,et al.  Deformation modeling of viscoelastic objects for their shape control , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[34]  Shih-Fu Chang,et al.  Model-Driven Feedforward Prediction for Manipulation of Deformable Objects , 2016, IEEE Transactions on Automation Science and Engineering.

[35]  Yan-Ru Hu,et al.  Active robust shape control of flexible structures , 2003 .

[36]  Jia Pan,et al.  Three-Dimensional Deformable Object Manipulation Using Fast Online Gaussian Process Regression , 2017, IEEE Robotics and Automation Letters.

[37]  Belhassen-Chedli Bouzgarrou,et al.  Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a survey , 2018, Int. J. Robotics Res..