Learning Deformable Object Models for Mobile Robot Navigation using Depth Cameras and a Manipulation Robot

In this paper, we present our recently developed robotic system that can navigate in environments with deformable objects. To achieve this, we propose techniques to learn models of deformable objects by physical interaction between the robot and the objects. We determine the model parameters by establishing a relation between the applied forces and the corresponding surface deformations as observed with a depth camera. After modeling the objects in a scene, the robot can perform its navigation tasks more efficiently by considering the cost of deformations during path planning. As we demonstrate in real-world experiments, our system is able to estimate appropriate physical parameters that can be used to predict future deformations and exploits this information during path planning.

[1]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[2]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[3]  Dinesh Manocha,et al.  Path Planning for Deformable Robots in Complex Environments , 2005, Robotics: Science and Systems.

[4]  Wolfram Burgard,et al.  Learning the elasticity parameters of deformable objects with a manipulation robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Nancy M. Amato,et al.  Planning motion in completely deformable environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[6]  Gábor Székely,et al.  Simultaneous Topology and Stiffness Identification for Mass-Spring Models Based on FEM Reference Deformations , 2004, MICCAI.

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[9]  Wolfram Burgard,et al.  Efficient path planning for mobile robots in environments with deformable objects , 2008, 2008 IEEE International Conference on Robotics and Automation.

[10]  J. Spillmann,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Robust Tetrahedral Meshing of Triangle Soups , 2022 .

[11]  Wolfram Burgard,et al.  Real-world robot navigation amongst deformable obstacles , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  Hervé Delingette,et al.  Nonlinear and anisotropic elastic soft tissue models for medical simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Lydia E. Kavraki,et al.  Towards planning for elastic objects , 1998 .

[14]  K. Bathe.  Finite Element Procedures , 1995 .

[15]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[16]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[17]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[18]  Oussama Khatib,et al.  Interactive rendering of deformable objects based on a filling sphere modeling approach , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Wolfgang Straßer,et al.  Corotational Simulation of Deformable Solids , 2004, WSCG.

[20]  Dinesh K. Pai,et al.  Robotic acquisition of deformable models , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[21]  G. Swaminathan.  Robot Motion Planning , 2006 .

[22]  Oussama Khatib,et al.  Identifying physical properties of deformable objects by using particle filters , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[24]  Matthias Teschner,et al.  Simultaneous cutting of coupled tetrahedral and triangulated meshes and its application in orbital reconstruction , 2009, International Journal of Computer Assisted Radiology and Surgery.