Active perception and modeling of deformable surfaces using Gaussian processes and position-based dynamics

Exploring and modeling heterogeneous elastic surfaces requires multiple interactions with the environment and a complex selection of physical material parameters. The most common approaches model deformable properties from sets of offline observations using computationally expensive force-based simulators. In this work we present an online probabilistic framework for autonomous estimation of a deformability distribution map of heterogeneous elastic surfaces from few physical interactions. The method takes advantage of Gaussian Processes for constructing a model of the environment geometry surrounding a robot. A fast Position-based Dynamics simulator uses focused environmental observations in order to model the elastic behavior of portions of the environment. Gaussian Process Regression maps the local deformability on the whole environment in order to generate a deformability distribution map. We show experimental results using a PrimeSense camera, a Kinova Jaco2 robotic arm and an Optoforce sensor on different deformable surfaces.

[1]  Gábor Székely,et al.  Simultaneous Topology and Stiffness Identification for Mass-Spring Models Based on FEM Reference Deformations , 2004, MICCAI.

[2]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[3]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Lixu Gu,et al.  Simulation of organ deformation using boundary element method and meshless shape matching , 2008, EMBC 2008.

[5]  Danica Kragic,et al.  Estimating the deformability of elastic materials using optical flow and position-based dynamics , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[6]  M. Otaduy,et al.  Capture and modeling of non-linear heterogeneous soft tissue , 2009, ACM Trans. Graph..

[7]  Marcos P. Gerardo-Castro,et al.  Laser-Radar Data Fusion with Gaussian Process Implicit Surfaces , 2013, FSR.

[8]  Lieven Eeckhout,et al.  Deformable Surface 3D Reconstruction from Monocular Images , 2010 .

[9]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[10]  Nico Blodow,et al.  Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  R. Peckham,et al.  Digital Terrain Modelling , 2007 .

[12]  Bo Zhu,et al.  Simulation of organ deformation using boundary element method and meshless shape matching , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  W. Fisher,et al.  Hybrid Position/Force Control: A Correct Formulation , 1992 .

[14]  Michael I. Jordan Learning in Graphical Models , 1999, NATO ASI Series.

[15]  Yin Yang,et al.  Haptic-enabled interactive rendering of deformable objects based on shape matching , 2013, 2013 IEEE International Symposium on Haptic Audio Visual Environments and Games (HAVE).

[16]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[17]  Danica Kragic,et al.  Active exploration using Gaussian Random Fields and Gaussian Process Implicit Surfaces , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[19]  Hugh F. Durrant-Whyte,et al.  Contextual occupancy maps using Gaussian processes , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Nancy M. Amato,et al.  Planning motion in completely deformable environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[21]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Robert J. Peckham,et al.  Digital Terrain Modelling: Development and Applications in a Policy Support Environment (Lecture Notes in Geoinformation and Cartography) , 2007 .

[23]  Guangda Su,et al.  Multi-scale Method for Adaptive Mesh Editing Based on Rigidity Estimation , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[24]  W. Kabsch A solution for the best rotation to relate two sets of vectors , 1976 .

[25]  Christopher K. I. Williams Prediction with Gaussian Processes: From Linear Regression to Linear Prediction and Beyond , 1999, Learning in Graphical Models.

[26]  Markus H. Gross,et al.  Meshless deformations based on shape matching , 2005, ACM Trans. Graph..

[27]  Wolfram Burgard,et al.  Learning object deformation models for robot motion planning , 2014, Robotics Auton. Syst..

[28]  Pascal Fua,et al.  Deformable Surface 3D Reconstruction from Monocular Images , 2010, Synthesis Lectures on Computer Vision.

[29]  Murat Cenk Cavusoglu,et al.  Estimation of soft tissue mechanical parameters from robotic manipulation data , 2012, 2012 IEEE International Conference on Robotics and Automation.