Navigation among movable obstacles

Robots would be much more useful if they could move obstacles out of the way. Traditional motion planning searches for collision free paths from a start to a goal. However, real world search and rescue, construction, home and nursing home domains contain debris, materials clutter, doors and objects that need to be moved by the robot. Theoretically, one can represent all possible interactions between the robot and movable objects as a huge search. We present methods that simplify the problem and make Navigation Among Movable Obstacles (NAMO) a practical challenge that can be addressed with current computers. This thesis gives a full development cycle from motion planning to implementation on a humanoid robot. First, we devise a state space decomposition strategy that reasons about free space connectivity to select objects and identify helpful displacements. Second, we present controls for balance and manipulation that allow the robot to move objects with previously unknown dynamics. Finally, we combine these results in a complete system that recognizes environment objects and executes Navigation Among Movable Obstacles. Our continued work in NAMO planning has focused on three topics: reasoning about object interaction, three dimensional manipulation and interaction with constrained objects. This thesis presents the computational and theoretical challenges that arise from these elaborations of the NAMO domain. In each case we introduce extensions to our algorithms that respond to the challenge and evaluate their performance in simulation. All the methods presented in this thesis not only solve previously unsolved problems but also operate efficiently, giving real-time results that can be used during online operation.

[1]  Rachid Alami,et al.  Two manipulation planning algorithms , 1995 .

[2]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[3]  Thierry Siméon,et al.  A random loop generator for planning the motions of closed kinematic chains using PRM methods , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  H. Hok Kwee Integrated control of MANUS manipulator and wheelchair enhanced by environmental docking , 1998, Robotica.

[5]  Michael A. Erdmann,et al.  On Motion Planning with Uncertainty , 1984 .

[6]  Kamal K. Gupta,et al.  Path planning with general end-effector constraints: using task space to guide configuration space search , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[8]  Steven M. LaValle,et al.  Rapidly-Exploring Random Trees: Progress and Prospects , 2000 .

[9]  Tamim Asfour,et al.  Manipulation Planning Among Movable Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Lydia E. Kavraki,et al.  Randomized path planning for linkages with closed kinematic chains , 2001, IEEE Trans. Robotics Autom..

[11]  Nancy M. Amato,et al.  A Kinematics-Based Probabilistic Roadmap Method for Closed Chain Systems , 2001 .

[12]  Tomás Lozano-Pérez,et al.  LAMA: A Language for Automatic Mechanical Assembly , 1977, IJCAI.

[13]  Masayoshi Tomizuka,et al.  On the Optimal Digital State Vector Feedback Controller With Integral and Preview Actions , 1979 .

[14]  Giuseppe Oriolo,et al.  Motion Planning for Mobile Manipulators along Given End-effector Paths , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[15]  Kikuo Fujimura,et al.  The intelligent ASIMO: system overview and integration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Rajeev Motwani,et al.  Complexity measures for assembly sequences , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[17]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[18]  Klaus Dorfmüller,et al.  Robust tracking for augmented reality using retroreflective markers , 1999, Comput. Graph..

[19]  J. Chestnutt,et al.  Planning Biped Navigation Strategies in Complex Environments , 2003 .

[20]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[21]  H. Inoue,et al.  Dynamic walking pattern generation for a humanoid robot based on optimal gradient method , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[22]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[23]  Gordon T. Wilfong Motion planning in the presence of movable obstacles , 1988, SCG '88.

[24]  Tomás Lozano-Pérez,et al.  On multiple moving objects , 2005, Algorithmica.

[25]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[26]  Marilena Vendittelli,et al.  Probabilistic motion planning for redundant robots along given end-effector paths , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Masayuki Inaba,et al.  Motion planning for humanoid robots under obstacle and dynamic balance constraints , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[28]  Masahiro Fujita,et al.  Real-Time Path Planning for Humanoid Robot Navigation , 2005, IJCAI.

[29]  Tsuneo Yoshikawa,et al.  Analysis and Control of Articulated Robot Arms with Redundancy , 1981 .

[30]  Miomir Vukobratović,et al.  Biped Locomotion: Dynamics, Stability, Control and Application , 1990 .

[31]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[32]  Mark H. Overmars,et al.  An Effective Framework for Path Planning Amidst Movable Obstacles , 2006, WAFR.

[33]  Franco P. Preparata,et al.  Approximation algorithms for convex hulls , 1982, CACM.

[34]  井上 博允,et al.  Force Feedback in Precise Assembly Tasks , 1975 .

[35]  Larry S. Davis,et al.  Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[36]  Stephen Cameron,et al.  The Virtual Springs Method: Path Planning and Collision Avoidance for Redundant Manipulators , 1996, Int. J. Robotics Res..

[37]  Satoshi Kagami,et al.  Augmented Reality for Robot Development and Experimentation , 2005 .

[38]  T. Greville,et al.  Some Applications of the Pseudoinverse of a Matrix , 1960 .

[39]  Tatsuo Arai,et al.  Mobile manipulation of humanoids-real-time control based on manipulability and stability , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[40]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[41]  Matthew T. Mason,et al.  Mechanics of Robotic Manipulation , 2001 .

[42]  Thierry Siméon,et al.  A manipulation planner for pick and place operations under continuous grasps and placements , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[43]  O. Brock,et al.  Robots in Human Environments: Basic Autonomous Capabilities , 1999, Int. J. Robotics Res..

[44]  Kazuhito Yokoi,et al.  Smooth Collision Avoidance: Practical Issues in Dynamic Humanoid Motion , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[46]  James J. Kuffner,et al.  Navigation among movable obstacles: real-time reasoning in complex environments , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[47]  Kazuhito Yokoi,et al.  The 3D linear inverted pendulum mode: a simple modeling for a biped walking pattern generation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[48]  Pradeep K. Khosla,et al.  Manipulation task primitives for composing robot skills , 1997, Proceedings of International Conference on Robotics and Automation.

[49]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[50]  Kamal K. Gupta,et al.  Manipulation Planning for Redundant Robots: A Practical Approach , 1998, Int. J. Robotics Res..

[51]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[52]  Elmar Schömer,et al.  Heuristic Motion Planning with Many Degrees of Freedom , 1996, CCCG.

[53]  Yutaka Hirano,et al.  Image-based object recognition and dexterous hand/arm motion planning using RRTs for grasping in cluttered scene , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[55]  Eric Krotkov,et al.  Robotic Perception of Material , 1995, IJCAI.

[56]  Miomir Vukobratovic,et al.  Zero-Moment Point - Thirty Five Years of its Life , 2004, Int. J. Humanoid Robotics.

[57]  Henry A. Kautz,et al.  BLACKBOX: A New Approach to the Application of Theorem Proving to Problem Solving , 1998 .

[58]  Lydia E. Kavraki,et al.  A probabilistic roadmap approach for systems with closed kinematic chains , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[59]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[60]  Alan D. Christiansen,et al.  Learning reliable manipulation strategies without initial physical models , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[61]  Yong K. Hwang,et al.  Practical path planning among movable obstacles , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[62]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[63]  Karen Donelan,et al.  State of the registered nurse workfore in the United States. , 2006, Nursing economic$.

[64]  Eiichi Yoshida,et al.  Humanoid motion planning for dynamic tasks , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[65]  Michael A. Erdmann,et al.  An Exploration of Nonprehensile Two-Palm Manipulation , 1998, Int. J. Robotics Res..

[66]  Masayuki Inaba,et al.  Environment manipulation planner for humanoid robots using task graph that generates action sequence , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[67]  Jonathan Schaeffer,et al.  Sokoban: A Challenging Single-Agent Search Problem , 1997, IJCAI 1997.

[68]  Oliver Brock,et al.  Task-consistent obstacle avoidance and motion behavior for mobile manipulation , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[69]  Atsuo Takanishi,et al.  Physical interaction between human and a bipedal humanoid robot-realization of human-follow walking , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[70]  Andrew W. Moore,et al.  Locally Weighted Learning for Control , 1997, Artificial Intelligence Review.

[71]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[72]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[73]  Steven M. LaValle,et al.  Efficient nearest neighbor searching for motion planning , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[74]  Jonathan Schaeffer,et al.  Sokoban: Enhancing general single-agent search methods using domain knowledge , 2001, Artif. Intell..

[75]  Tien C. Hsia,et al.  Joint trajectory generation for redundant robots in an environment with obstacles , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[76]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[77]  Tatsuo Arai,et al.  Pushing an Object Considering the Hand Reflect Forces by Humanoid Robot in Dynamic Walking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[78]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[79]  Rajeev Motwani,et al.  Path Planning in Expansive Configuration Spaces , 1999, Int. J. Comput. Geom. Appl..

[80]  Satoshi Kagami,et al.  High frequency walking pattern generation based on preview control of ZMP , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[81]  Masayuki Inaba,et al.  Footstep planning among obstacles for biped robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[82]  Bruce Randall Donald,et al.  Real-time robot motion planning using rasterizing computer graphics hardware , 1990, SIGGRAPH.

[83]  Bruno Siciliano,et al.  Kinematic control of redundant robot manipulators: A tutorial , 1990, J. Intell. Robotic Syst..

[84]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[85]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[86]  Satoshi Kagami,et al.  Motion Control System that Realizes Physical Interaction between Robot's Hands and Environment during Walk , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[87]  Kamal K. Gupta,et al.  The kinematic roadmap: a motion planning based global approach for inverse kinematics of redundant robots , 1999, IEEE Trans. Robotics Autom..

[88]  Eiichi Yoshida,et al.  Pivoting Manipulation of a Large Object: A Study of Application using Humanoid Platform , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[89]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[90]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[91]  Richard E. Korf,et al.  Finding Optimal Solutions to Rubik's Cube Using Pattern Databases , 1997, AAAI/IAAI.

[92]  John T. Wen,et al.  A global approach to path planning for redundant manipulators , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[93]  Ehud Rivlin,et al.  Practical pushing planning for rearrangement tasks , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[94]  Gerald Jay Sussman The FINDSPACE Problem , 1971 .

[95]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[96]  Kazuhito Yokoi,et al.  Real-Time Planning of Humanoid Robot's Gait for Force-Controlled Manipulation , 2007 .

[97]  Masayuki Inaba,et al.  Online mixture and connection of basic motions for humanoid walking control by footprint specification , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[98]  Scott E. Fahlman,et al.  A Planning System for Robot Construction Tasks , 1973, Artif. Intell..

[99]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[100]  Randall H. Wilson,et al.  On geometric assembly planning , 1992 .

[101]  Oussama Khatib,et al.  Whole-Body Dynamic Behavior and Control of Human-like Robots , 2004, Int. J. Humanoid Robotics.

[102]  T. Katayama,et al.  Design of an optimal controller for a discrete-time system subject to previewable demand , 1985 .

[103]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[104]  Masayuki Inaba,et al.  Dynamically-Stable Motion Planning for Humanoid Robots , 2002, Auton. Robots.

[105]  Kenji KANEKO,et al.  Humanoid robot HRP-3 , 2004, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[106]  Leonard S. Haynes,et al.  Robotic assembly by constraints , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[107]  Rodney A. Brooks,et al.  Sensing and Manipulating Built-for-Human Environments , 2004, Int. J. Humanoid Robotics.

[108]  Tomás Lozano-Pérez,et al.  Spatial Planning: A Configuration Space Approach , 1983, IEEE Transactions on Computers.

[109]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[110]  Shuuji Kajita,et al.  Pushing manipulation by humanoid considering two-kinds of ZMPs , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[111]  James S. Tulenko,et al.  Real-time control of the ANDROS mobile robot , 1994 .

[112]  Jonathan Schaeffer,et al.  Searching with Pattern Databases , 1996, Canadian Conference on AI.

[113]  Carlos Canudas de Wit,et al.  Adaptive Friction Compensation in Robot Manipulators: Low Velocities , 1991, Int. J. Robotics Res..

[114]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .