Randomization for robot tasks: Using dynamic programming in the space of knowledge states

This paper explores the use of randomization as a primitive action in the solution of robot tasks. An example of randomization is the strategy of shaking a bin containing a part in order to orient the part in a desired stable state with some high probability. Further examples include tapping, vibrating, twirling, and random search. For instance, it is sometimes beneficial for a system to execute random motions purposefully when the precise motions required to perform an operation are unknown, as when they lie below the available sensor resolution.The purpose of this paper is to provide a theoretical framework for the planning and execution of randomized strategies for robot tasks. This framework is built on the standard backchaining approach of dynamic programming. Specifically, a randomizing planner backchains from the goal in a state space whose states describe the knowledge available to the system at run-time. By choosing random actions in a principled manner at run-time, a system can sometimes obtain a probabilistic strategy for accomplishing a task even when no guaranteed strategy exists for accomplishing that task. In other cases, the system may be able to obtain a speedup over an existing guaranteed strategy.The main result of this paper consists of two examples. One example shows that randomization can sometimes speed up task completion from exponential time to polynomial time. The other example shows that such a speedup is not always possible.

[1]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[2]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[3]  SimunoviÄ SimunoviÄ,et al.  An information approach to parts mating , 1979 .

[4]  Matthew T. Mason,et al.  An exploration of sensorless manipulation , 1986, IEEE J. Robotics Autom..

[5]  Daniel E. Whitney,et al.  Quasi-Static Assembly of Compliantly Supported Rigid Parts , 1982 .

[6]  Stephen J. Buckley,et al.  Planning Compliant Motion Strategies , 1988, Proceedings IEEE International Symposium on Intelligent Control 1988.

[7]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[8]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[9]  Russell H. Taylor,et al.  Sensor-based manipulation planning as a game with nature , 1988 .

[10]  Daniel E. Whitney,et al.  Force Feedback Control of Manipulator Fine Motions , 1977 .

[11]  Balas K. Natarajan An algorithmic approach to the automated design of parts orienters , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[12]  Jean-Claude Latombe,et al.  An Approach to Automatic Robot Programming Based on Inductive Learning , 1984 .

[13]  Rodney A. Brooks,et al.  An approach to automatic robot programming , 1986, CSC '86.

[14]  Arthur C. Sanderson,et al.  Planning robotic manipulation strategies for sliding objects , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[15]  Samuel Hunt Drake,et al.  Using compliance in lieu of sensory feedback for automatic assembly. , 1978 .

[16]  Robert H. Sturges,et al.  A Three-Dimensional Assembly Task Quantification with Application to Machine Dexterity , 1988, Int. J. Robotics Res..

[17]  Michael A. Erdmann,et al.  On probabilistic strategies for robot tasks , 1989 .

[18]  John F. Canny,et al.  New lower bound techniques for robot motion planning problems , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[19]  John Canny,et al.  The complexity of robot motion planning , 1988 .

[20]  Jean-Claude Latombe,et al.  Robot Motion Planning: A Distributed Representation Approach , 1991, Int. J. Robotics Res..

[21]  Bruce Randall Donald,et al.  Error Detection and Recovery in Robotics , 1989, Lecture Notes in Computer Science.

[22]  Hirochika Inoue,et al.  Force Feedback in Precise Assembly Tasks , 1974 .

[23]  Ken Goldberg,et al.  Stochastic plans for robotic manipulation , 1991 .

[24]  Christos H. Papadimitriou,et al.  Games against nature , 1985, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[25]  Kenneth Y. Goldberg,et al.  Bayesian grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[26]  Bruce Randall Donald Planning Multi-Step Error Detection and Recovery Strategies , 1990, Int. J. Robotics Res..

[27]  M. K rn,et al.  Stochastic Optimal Control , 1988 .

[28]  Michael A. Erdmann,et al.  Using Backprojections for Fine Motion Planning with Uncertainty , 1986 .

[29]  A. H. Redford,et al.  Statistical distributions of natural resting aspects of parts for automatic handling , 1977 .

[30]  Frank L. Lewis,et al.  Optimal Control , 1986 .

[31]  R. Stengel Stochastic Optimal Control: Theory and Application , 1986 .

[32]  Rodney A. Brooks,et al.  Symbolic Error Analysis and Robot Planning , 1982 .

[33]  Balas K. Natarajan The Complexity of Fine Motion Planning , 1988, Int. J. Robotics Res..

[34]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[35]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[36]  Matthew T. Mason,et al.  The mechanics of manipulation , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[37]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[38]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[39]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[40]  Kenneth Y. Goldberg,et al.  Generating stochastic plans for a programmable parts feeder , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[41]  Michael E. Caine,et al.  Chamferless assembly of rectangular parts in two and three dimensions , 1985 .

[42]  Y. M. El-Fattah,et al.  Simulation of Market Price Formation as a Game Between Stochastic Automata , 1976 .

[43]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[44]  John Gill,et al.  Computational Complexity of Probabilistic Turing Machines , 1977, SIAM J. Comput..

[45]  John F. Canny,et al.  On computability of fine motion plans , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[46]  Bruce Randall Donald,et al.  A Geometric Approach to Error Detection and Recovery for Robot Motion Planning with Uncertainty , 1987, Artif. Intell..

[47]  Matthew T. Mason,et al.  Automatic planning of fine motions: Correctness and completeness , 1984, ICRA.

[48]  Michael A. Erdmann Randomization in Robot Tasks , 1992 .

[49]  R. Brost Planning robot grasping motions in the presence of uncertainty , 1985 .

[50]  Tomas Lozano-Perez,et al.  The Design of a Mechanical Assembly System , 1976 .

[51]  Russell H. Taylor,et al.  The synthesis of manipulator control programs from task-level specifications , 1976 .

[52]  Randy C. Brost,et al.  Automatic Grasp Planning in the Presence of Uncertainty , 1988, Int. J. Robotics Res..