Nonprehensile Manipulation Control and Task Planning for Deformable Object Manipulation: Results from the RoDyMan Project

This chapter aims the broadcasting of the results achieved by the RoDyMan project about the task planning manipulation of deformable objects, and the nonprehensile manipulation control. The final demonstrator of the project is a pizza-making process. After an introduction to the general topic of nonprehensile manipulation, the mechatronic design and the high-level software architecture are described. Then, the smoothed particle hydrodynamic formulation is briefly introduced, along with the description of a detection method for a deformable object. The task planning for stretching a modelling clay, emulating the pizza dough, is sketched. After, the problematic control objective is split into several nonprehensile motion primitives: holonomic and nonholonomic rolling, friction-induced manipulation, and tossing are the described primitives. This chapter highlights the achievements reached so far by the project, and pave the way towards future research directions.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Kevin M. Lynch,et al.  Dynamic Nonprehensile Manipulation: Controllability, Planning, and Experiments , 1999, Int. J. Robotics Res..

[3]  Vincenzo Lippiello,et al.  Modelling and Control of a Robotic Hula–hoop System without Velocity Measurements , 2017 .

[4]  A. Bloch,et al.  Nonholonomic Control Systems on Riemannian Manifolds , 1995 .

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Sachin Chitta,et al.  MoveIt! [ROS Topics] , 2012, IEEE Robotics Autom. Mag..

[7]  Lydia E. Kavraki,et al.  Deformable volumes in path planning applications , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Paul Umbanhowar,et al.  Friction-Induced Lines of Attraction and Repulsion for Parts Sliding on an Oscillated Plate , 2009, IEEE Transactions on Automation Science and Engineering.

[9]  Evan Mitsoulis,et al.  Numerical simulation of calendering viscoplastic fluids , 2008 .

[10]  Kayo Yoshimoto,et al.  Active shaping of an unknown rheological object based on deformation decomposition into elasticity and plasticity , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[12]  G. Y. Li,et al.  A gradient smoothing method (GSM) with directional correction for solid mechanics problems , 2007 .

[13]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[14]  Dan Reznik,et al.  C'mon part, do the local motion! , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[15]  Shinichi Hirai,et al.  Robust manipulation of deformable objects by a simple PID feedback , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[16]  Vincenzo Lippiello,et al.  Aerial service vehicles for industrial inspection: task decomposition and plan execution , 2013, Applied Intelligence.

[17]  Vincenzo Lippiello,et al.  The Effect of Shapes in Input-State Linearization for Stabilization of Nonprehensile Planar Rolling Dynamic Manipulation , 2016, IEEE Robotics and Automation Letters.

[18]  Evan Mitsoulis,et al.  Rolling of bread dough: Experiments and simulations , 2009 .

[19]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[20]  Paul Umbanhowar,et al.  Sliding manipulation of rigid bodies on a controlled 6-DoF plate , 2012, Int. J. Robotics Res..

[21]  Wolfram Burgard,et al.  Learning the elasticity parameters of deformable objects with a manipulation robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Dirk Wollherr,et al.  Ball dribbling with an underactuated continuous-time control phase: Theory & experiments , 2010, IROS.

[23]  Carlos Canudas-de-Wit,et al.  Constructive tool for orbital stabilization of underactuated nonlinear systems: virtual constraints approach , 2005, IEEE Transactions on Automatic Control.

[24]  Ronald Fedkiw,et al.  Invertible finite elements for robust simulation of large deformation , 2004, SCA '04.

[25]  Rui Pedro Duarte Cortesão,et al.  Physical feasibility of robot base inertial parameter identification: A linear matrix inequality approach , 2014, Int. J. Robotics Res..

[26]  Evan Mitsoulis,et al.  Rheological characterization and constitutive modeling of bread dough , 2008 .

[27]  T. J. Chung,et al.  Computational Fluid Dynamics: Contents , 2010 .

[28]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[29]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[30]  Vincenzo Lippiello,et al.  Real-time tracking of 3D elastic objects with an RGB-D sensor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Jan Bender,et al.  Divergence-free smoothed particle hydrodynamics , 2015, Symposium on Computer Animation.

[32]  Shinichi Hirai,et al.  Deformation control of rheological food dough using a forming process model , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[33]  Haiyan Wu,et al.  Dynamic manipulation: Nonprehensile ball catching , 2010, 18th Mediterranean Conference on Control and Automation, MED'10.

[34]  Afonso Paiva,et al.  SPH Fluids for Viscous Jet Buckling , 2014, 2014 27th SIBGRAPI Conference on Graphics, Patterns and Images.

[35]  Kevin M. Lynch,et al.  Control of Nonprehensile Manipulation , 2003, Control Problems in Robotics.

[36]  Matthias Teschner,et al.  An implicit viscosity formulation for SPH fluids , 2015, ACM Trans. Graph..

[37]  Makoto Kaneko,et al.  Dexterous hyper plate inspired by pizza manipulation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[38]  Vincenzo Lippiello,et al.  On the Experiments About the Nonprehensile Reconfiguration of a Rolling Sphere on a Plate , 2018, 2018 26th Mediterranean Conference on Control and Automation (MED).

[39]  Ana-Maria Cretu,et al.  Neural Network Mapping and Clustering of Elastic Behavior From Tactile and Range Imaging for Virtualized Reality Applications , 2008, IEEE Transactions on Instrumentation and Measurement.

[40]  H. Wieser.  Chemistry of gluten proteins. , 2007, Food microbiology.

[41]  Dmitry Berenson,et al.  A representation of deformable objects for motion planning with no physical simulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[42]  J. Monaghan.  Smoothed particle hydrodynamics , 2005 .

[43]  Wolfram Burgard,et al.  Efficient motion planning for manipulation robots in environments with deformable objects , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  W. Boothby.  An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[45]  Muhammad Shoaib,et al.  A comprehensive review on wheat flour dough rheology , 2013 .

[46]  Vincenzo Lippiello,et al.  Control of Nonprehensile Planar Rolling Manipulation: A Passivity-Based Approach , 2019, IEEE Transactions on Robotics.

[47]  J. Lang,et al.  An acquisition method for interactive deformable models , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[48]  Mia Eeckhout,et al.  Rheological Properties of Wheat Flour Dough and the Relationship with Bread Volume. I. Creep-Recovery Measurements , 2008 .

[49]  Guirong Liu,et al.  Smoothed Particle Hydrodynamics (SPH): an Overview and Recent Developments , 2010 .

[50]  S. Shao,et al.  INCOMPRESSIBLE SPH METHOD FOR SIMULATING NEWTONIAN AND NON-NEWTONIAN FLOWS WITH A FREE SURFACE , 2003 .

[51]  Vincenzo Lippiello,et al.  An Optimal Trajectory Planner for a Robotic Batting Task: The Table Tennis Example , 2016, ICINCO.

[52]  Sehoon Ha,et al.  Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques , 2014, ACM Trans. Graph..

[53]  Vincenzo Lippiello,et al.  Nonprehensile Manipulation of an Underactuated Mechanical System With Second-Order Nonholonomic Constraints: The Robotic Hula-Hoop , 2018, IEEE Robotics and Automation Letters.

[54]  Jan Bender,et al.  Divergence-Free SPH for Incompressible and Viscous Fluids , 2017, IEEE Transactions on Visualization and Computer Graphics.

[55]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[56]  Makoto Kaneko,et al.  Dynamic Manipulation Inspired by the Handling of a Pizza Peel , 2009, IEEE Transactions on Robotics.

[57]  Kevin M. Lynch,et al.  Planning and control for dynamic, nonprehensile, and hybrid manipulation tasks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[58]  Vincenzo Lippiello,et al.  A coordinate-free framework for robotic pizza tossing and catching , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[59]  J. Monaghan.  Simulating Free Surface Flows with SPH , 1994 .

[60]  Ming C. Lin,et al.  Implicit Formulation for SPH‐based Viscous Fluids , 2015, Comput. Graph. Forum.

[61]  Mark W. Spong,et al.  Partial feedback linearization of underactuated mechanical systems , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[62]  Raffaello D'Andrea,et al.  Design and Analysis of a Blind Juggling Robot , 2012, IEEE Transactions on Robotics.

[63]  Thomas H. Vose,et al.  Friction-Induced Velocity Fields for Point Parts Sliding on a Rigid Oscillated Plate , 2009, Int. J. Robotics Res..

[64]  Vincenzo Lippiello,et al.  Passivity-Based Control for a Rolling-Balancing System: The Nonprehensile Disk-on-Disk , 2017, IEEE Transactions on Control Systems Technology.

[65]  S. Bittanti,et al.  The Riccati equation , 1991 .

[66]  Vincenzo Lippiello,et al.  Nonprehensile Dynamic Manipulation: A Survey , 2018, IEEE Robotics and Automation Letters.

[67]  Afonso Paiva,et al.  Particle-based fluids for viscous jet buckling , 2015, Comput. Graph..