Nonprehensile Dynamic Manipulation: A Survey

Nonprehensile dynamic manipulation can be reasonably considered as the most complex manipulation task. It might be argued that such a task is still rather far from being fully solved and applied in robotics. This survey tries to collect the results reached so far by the research community about planning and control in the nonprehensile dynamic manipulation domain. A discussion about current open issues is addressed as well.

[1]  David J. Montana,et al.  The Kinematics of Contact and Grasp , 1988, Int. J. Robotics Res..

[2]  Christopher G. Atkeson,et al.  Task-level robot learning: juggling a tennis ball more accurately , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[3]  Daniel E. Koditschek,et al.  A family of robot control strategies for intermittent dynamical environments , 1990, IEEE Control Systems Magazine.

[4]  Yasuhiro Masutani,et al.  A study on juggling tasks , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[5]  P. Kokotovic,et al.  Nonlinear control via approximate input-output linearization: the ball and beam example , 1992 .

[6]  Christopher G. Atkeson,et al.  What should be learned , 1992 .

[7]  M.T. Mason,et al.  Dynamic manipulation , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[8]  Stefan Schaal,et al.  Open loop stable control strategies for robot juggling , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[9]  Jeff G. Schneider,et al.  Robot skill learning, basis functions, and control regimes , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[10]  Masayuki Inaba,et al.  Pivoting: A new method of graspless manipulation of object by robot fingers , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[11]  S. Schaal,et al.  Robot juggling: implementation of memory-based learning , 1994, IEEE Control Systems.

[12]  Daniel E. Koditschek,et al.  Planning and Control of Robotic Juggling and Catching Tasks , 1994, Int. J. Robotics Res..

[13]  Stefan Schaal,et al.  Memory-based robot learning , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[14]  Daniel E. Koditschek,et al.  Toward a dynamical pick and place , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[15]  A. Teel,et al.  Tools for Semiglobal Stabilization by Partial State and Output Feedback , 1995 .

[16]  Eric Krotkov,et al.  Impulsive manipulation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[17]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[18]  Chi Zhu,et al.  Releasing manipulation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[19]  Dan Reznik,et al.  A flat rigid plate is a universal planar manipulator , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[20]  Naoji Shiroma,et al.  The roles of shape and motion in dynamic manipulation: the butterfly example , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[21]  Kevin M. Lynch,et al.  Dynamic Nonprehensile Manipulation: Controllability, Planning, and Experiments , 1999, Int. J. Robotics Res..

[22]  Bruce Randall Donald,et al.  Programmable Force Fields for Distributed Manipulation, with Applications to MEMS Actuator Arrays and Vibratory Parts Feeders , 1999, Int. J. Robotics Res..

[23]  Kevin M. Lynch,et al.  Locally controllable manipulation by stable pushing , 1999, IEEE Trans. Robotics Autom..

[24]  Matthew T. Mason,et al.  Progress in Nonprehensile Manipulation , 1999, Int. J. Robotics Res..

[25]  Bruce Randall Donald,et al.  Part orientation with one or two stable equilibria using programmable force fields , 2000, IEEE Trans. Robotics Autom..

[26]  Antonio Bicchi,et al.  Rolling bodies with regular surface: controllability theory and applications , 2000, IEEE Trans. Autom. Control..

[27]  Kevin M. Lynch,et al.  Recurrence, controllability, and stabilization of juggling , 2001, IEEE Trans. Robotics Autom..

[28]  Yasumichi Aiyama,et al.  Planning of graspless manipulation by multiple robot fingers , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[29]  Dan Reznik,et al.  C'mon part, do the local motion! , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[30]  Dimitrios Hristu-Varsakelis,et al.  The dynamics of a forced sphere-plate mechanical system , 2001, IEEE Trans. Autom. Control..

[31]  Howie Choset,et al.  Distributed Manipulation Using Discrete Actuator Arrays , 2001, Int. J. Robotics Res..

[32]  Romeo Ortega,et al.  Stabilization of a class of underactuated mechanical systems via interconnection and damping assignment , 2002, IEEE Trans. Autom. Control..

[33]  Jean Lévine,et al.  On Motion Planning for Robotic Manipulation with Permanent Rolling Contacts , 2002, Int. J. Robotics Res..

[34]  Kevin M. Lynch,et al.  Rolling Manipulation with a Single Control , 2002, Int. J. Robotics Res..

[35]  J. Aracil,et al.  Stabilization of autonomous oscillations and the Hopf bifurcation in the ball and beam , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[36]  K. Harada,et al.  Whole body manipulation , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[37]  Kevin M. Lynch,et al.  Control of Nonprehensile Manipulation , 2003, Control Problems in Robotics.

[38]  Yasumichi Aiyama,et al.  Passing manipulation by 1 degree-of-freedom manipulator - catching manipulation of tossed object without impact , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[39]  Juan A. Méndez,et al.  Ping-pong player prototype , 2003, IEEE Robotics Autom. Mag..

[40]  Mitsuji Sampei,et al.  Simultaneous control of position and orientation for ball-plate manipulation problem based on time-State control form , 2004, IEEE Transactions on Robotics and Automation.

[41]  Tamio Arai,et al.  Motion planning of robot fingertips for graspless manipulation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[42]  M. Zeitz,et al.  Flatness-Based Feedforward and Feedback Linearisation of the Ball & Plate Lab Experiment , 2004 .

[43]  Ranjan Mukherjee,et al.  Exponential stabilization of the rolling sphere , 2004, Autom..

[44]  Marilena Vendittelli,et al.  A framework for the stabilization of general nonholonomic systems with an application to the plate-ball mechanism , 2005, IEEE Transactions on Robotics.

[45]  Giuseppe Oriolo,et al.  ENERGY-BASED CONTROL OF THE BUTTERFLY ROBOT , 2006 .

[46]  Masatoshi Ishikawa,et al.  Ball control in high-speed batting motion using hybrid trajectory generator , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[47]  Y. Aoustin,et al.  An original circular ball-and-beam system: Stabilization strategy under saturating control with large basin of attraction , 2007, 2007 European Control Conference (ECC).

[48]  Mark H. Overmars,et al.  Pushing a Disk Using Compliance , 2007, IEEE Transactions on Robotics.

[49]  Philippe Lefèvre,et al.  Rhythmic Feedback Control of a Blind Planar Juggler , 2007, IEEE Transactions on Robotics.

[50]  Ricardo G. Sanfelice,et al.  A hybrid systems approach to trajectory tracking control for juggling systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[51]  M.N. Ahmadabadi,et al.  Manipulation by juggling of planar polygonal objects using two 3-DOF manipulators , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[52]  Paul Umbanhowar,et al.  Vibration-Induced Frictional Force Fields on a Rigid Plate , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[53]  Dirk Wollherr,et al.  Basketball robot: Ball-On-Plate with pure haptic information , 2008, 2008 IEEE International Conference on Robotics and Automation.

[54]  Martin Buss,et al.  Robot basketball: A comparison of ball dribbling with visual and force/torque feedback , 2009, 2009 IEEE International Conference on Robotics and Automation.

[55]  Mitsuji Sampei,et al.  Modeling and control of hula-hoop system , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[56]  Jian S. Dai,et al.  A coordinate-free approach to instantaneous kinematics of two rigid objects with rolling contact and its implications for trajectory planning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[57]  Makoto Kaneko,et al.  Non-grasp manipulation of deformable object by using pizza handling mechanism , 2009, 2009 IEEE International Conference on Robotics and Automation.

[58]  Paul Umbanhowar,et al.  Friction-Induced Lines of Attraction and Repulsion for Parts Sliding on an Oscillated Plate , 2009, IEEE Transactions on Automation Science and Engineering.

[59]  Makoto Kaneko,et al.  Dynamic Manipulation Inspired by the Handling of a Pizza Peel , 2009, IEEE Transactions on Robotics.

[60]  Dirk Wollherr,et al.  Ball dribbling with an underactuated continuous-time control phase: Theory & experiments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Mike Stilman,et al.  Dynamic pushing strategies for dynamically stable mobile manipulators , 2010, 2010 IEEE International Conference on Robotics and Automation.

[62]  Haiyan Wu,et al.  Dynamic manipulation: Nonprehensile ball catching , 2010, 18th Mediterranean Conference on Control and Automation, MED'10.

[63]  Paul Umbanhowar,et al.  Toward the set of frictional velocity fields generable by 6-degree-of-freedom oscillatory motion of a rigid plate , 2010, 2010 IEEE International Conference on Robotics and Automation.

[64]  T. I. James Tsay,et al.  Self-Learning for a Humanoid Robotic Ping-Pong Player , 2011, Adv. Robotics.

[65]  Yusie Rizal,et al.  Stabilization of a ball and sphere system using feedback linearization and sliding mode control , 2011, 2011 8th Asian Control Conference (ASCC).

[66]  Kenjiro Tadakuma,et al.  Dynamic nonprehensile shaping of a thin rheological object , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  Raffaello D'Andrea,et al.  Quadrocopter ball juggling , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[68]  Yonghwan Oh,et al.  Balance control of ball-beam system using redundant manipulator , 2011, 2011 IEEE International Conference on Mechatronics.

[69]  Rong Xiong,et al.  Balance motion generation for a humanoid robot playing table tennis , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[70]  Imin Kao,et al.  Nonprehensile dynamic manipulation of a sheet-like viscoelastic object , 2011, 2011 IEEE International Conference on Robotics and Automation.

[71]  Alin Albu-Schäffer,et al.  Exploiting potential energy storage for cyclic manipulation: An analysis for elastic dribbling with an anthropomorphic robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[72]  Paul Umbanhowar,et al.  The effect of anisotropic friction on vibratory velocity fields , 2012, 2012 IEEE International Conference on Robotics and Automation.

[73]  Kevin M. Lynch,et al.  Control of nonprehensile rolling manipulation: Balancing a disk on a disk , 2012, 2012 IEEE International Conference on Robotics and Automation.

[74]  Oliver Kroemer,et al.  Learning to select and generalize striking movements in robot table tennis , 2012, AAAI Fall Symposium: Robots Learning Interactively from Human Teachers.

[75]  Siddhartha S. Srinivasa,et al.  A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty , 2012, Autonomous Robots.

[76]  Raffaello D'Andrea,et al.  Design and Analysis of a Blind Juggling Robot , 2012, IEEE Transactions on Robotics.

[77]  Claudio Zito,et al.  Two-level RRT planning for robotic push manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[78]  Chunfang Liu,et al.  Racket control and its experiments for robot playing table tennis , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[79]  De Xu,et al.  Adding Active Learning to LWR for Ping-Pong Playing Robot , 2013, IEEE Transactions on Control Systems Technology.

[80]  Ricardo G. Sanfelice,et al.  Juggling on a bouncing ball apparatus via hybrid control , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Xiangyang Zhu,et al.  Ball juggling with an under-actuated flying robot , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[82]  Martin Buss,et al.  Quasi-direct nonprehensile catching with uncertain object states , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[83]  Vincenzo Lippiello,et al.  Robotic Ball Catching with an Eye-in-Hand Single-Camera System , 2015, IEEE Transactions on Control Systems Technology.

[84]  Bernhard Schölkopf,et al.  Learning optimal striking points for a ping-pong playing robot , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[85]  Reinhard Gahleitner.  Ball on Ball: Modeling and control of a novel experiment set-up , 2015 .

[86]  Manuela M. Veloso,et al.  Towards table tennis with a quadrotor autonomous learning robot and onboard vision , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[87]  Siddhartha S. Srinivasa,et al.  Kinodynamic randomized rearrangement planning via dynamic transitions between statically stable states , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[88]  Siddhartha S. Srinivasa,et al.  Nonprehensile whole arm rearrangement planning on physics manifolds , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[89]  Leonid B. Freidovich,et al.  Case study in non-prehensile manipulation: planning and orbital stabilization of one-directional rollings for the “Butterfly” robot , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[90]  Hyungpil Moon,et al.  A survey of non-prehensile pneumatic manipulation surfaces: principles, models and control , 2015, Intell. Serv. Robotics.

[91]  Bernhard Schölkopf,et al.  Jointly learning trajectory generation and hitting point prediction in robot table tennis , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[92]  Marina Bosch,et al.  A Robot Ping Pong Player Experiment In Real Time Intelligent Control , 2016 .

[93]  Vincenzo Lippiello,et al.  Design, Implementation and Experiments of a Robust Passivity-based Controller for a Rolling-balancing System , 2016, ICINCO.

[94]  Bernhard Schölkopf,et al.  Using probabilistic movement primitives for striking movements , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[95]  Vincenzo Lippiello,et al.  The Effect of Shapes in Input-State Linearization for Stabilization of Nonprehensile Planar Rolling Dynamic Manipulation , 2016, IEEE Robotics and Automation Letters.

[96]  Vincenzo Lippiello,et al.  An Optimal Trajectory Planner for a Robotic Batting Task: The Table Tennis Example , 2016, ICINCO.

[97]  Vincenzo Lippiello,et al.  A coordinate-free framework for robotic pizza tossing and catching , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[98]  Kevin M. Lynch,et al.  Planning and control for dynamic, nonprehensile, and hybrid manipulation tasks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[99]  Vincenzo Lippiello,et al.  Passivity-Based Control for a Rolling-Balancing System: The Nonprehensile Disk-on-Disk , 2017, IEEE Transactions on Control Systems Technology.

[100]  Alberto Rodriguez,et al.  Optimal Shape and Motion Planning for Dynamic Planar Manipulation , 2017, Robotics: Science and Systems.

[101]  B. Siciliano,et al.  A Nonlinear Least Squares Approach for Nonprehensile Dual-Hand Robotic Ball Juggling , 2017 .

[102]  Vincenzo Lippiello,et al.  Nonprehensile Manipulation of an Underactuated Mechanical System With Second-Order Nonholonomic Constraints: The Robotic Hula-Hoop , 2018, IEEE Robotics and Automation Letters.

[103]  Marco Santochi,et al.  Grasping , 2019, CIRP Encyclopedia of Production Engineering.