Constructive recognizability for task-directed robot programming

Abstract The primary goal of our research is task-level planning. We approach this goal by utilizing a blend of theory, implementation, and experimentation. We investigate task-level planning for autonomous agents, such as mobile robots, that function in an uncertain environment. These robots typically have very approximate, inaccurate, or minimal models of the environment. For example, although the geometry of its environment is crucial to determining its performance, 1 a mobile robot might only have a partial, or local ‘map” of the world. Similarly, the expected effects of a robot's actuators critically influence its selection of actions to accomplish a goal, but a robot may have only a very approximate, or local predictive ability with regard to forward-simulation of a control strategy. While mobile robots are typically equipped with sensors in order to gain information about the world, and to compensate for errors in actuation and prediction, these sensors are noisy, and in turn provide inaccurate information. We investigate an approach whereby the robot attempts to acquire the necessary information about the world by planning a series of experiments using the robot's sensors and actuators, and building data-structures based on the robot's observations of these experiments. A key feature of this approach is that the experiments the robot performs should be driven by the information demands of the task. That is, in performing some task, the robot may enter a state in which making progress towards a goal requires more information about the world (or its own state). In this case, the robot should plan experiments which can disambiguate the situation. When this process is driven by the information demands of the task, we believe it is an important algorithmic technique to effect task-directed sensing. This introductory survey article discusses: 1. (1) A theory of sensor interpretation and task-directed planning using perceptual equivalence classes , intended to be applicable in highly uncertain or unmodeled environments, such as for a mobile robot. 2. (2) Algorithmic techniques for modeling geometric constraints on recognizability, and the building of internal representations (such as maps) using these constraints. 3. (3) Explicit encoding of the information requirements of a task using a lattice (information hierarchy) of recognizable sets , which allows the robot to perform experiments to recognize a situation or a landmark. 4. (4) The synthesis of robust mobot programs using the geometric constraints, constructive recognizability experiments, and uncertainty models imposed by the task. We discuss how to extend our theory and the geometric theory of planning to overcome challenges of the autonomous mobile robot domain. One of our most important goals is to show how our theory can be made constructive and algorithmic. We propose a framework for mobot programming based on constructive recognizability , and discuss why it should be robust in uncertain environments. Our objective is to demonstrate the following: When recognizability is thusly constructive, we naturally obtain task-directed sensing strategies, driven by the information demands encoded in the structure of the recognizable sets. A principled theory of sensing and action is crucial in developing task-level programming for autonomous mobile robots. We propose a framework for such a theory, providing both a precise vocabulary and also appropriate computational machinery for workingwith issuea of information flow in and through a robot system equipped with various types of sensors and operating in a dynamic, unstructured environment. We are implementing the teory and testing it on mobile robots in our laboratory.

[1]  Balas K. Natarajan An algorithmic approach to the automated design of parts orienters , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[2]  Gregory D. Hager,et al.  Computational Methods for Task-directed Sensor Data Fusion and Sensor Planning , 1991, Int. J. Robotics Res..

[3]  Jean-Claude Latombe,et al.  An Approach to Automatic Robot Programming Based on Inductive Learning , 1984 .

[4]  Michael A. Erdmann,et al.  Using Backprojections for Fine Motion Planning with Uncertainty , 1986 .

[5]  Bruce Randall Donald,et al.  Program mobile robots in Scheme , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[6]  Hans P. Moravec Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[7]  Richard S. Sutton,et al.  Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming , 1990, ML.

[8]  Tomás Lozano-Pérez,et al.  Spatial Planning: A Configuration Space Approach , 1983, IEEE Transactions on Computers.

[9]  Matthew T. Mason,et al.  Mechanical parts orienting: The case of a polyhedron on a table , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Michael E. Caine,et al.  Chamferless assembly of rectangular parts in two and three dimensions , 1985 .

[11]  Chee Yap,et al.  Algorithmic motion planning , 1987 .

[12]  Ingemar J. Cox,et al.  Temporal Integration of Multiple Sensor Observations for Dynamic World Modeling: A Multiple Hypothesis Approach , 1991 .

[13]  Stephen J. Buckley Planning and teaching compliant motion strategies , 1987 .

[14]  Dana H. Ballard,et al.  Active Perception and Reinforcement Learning , 1990, Neural Computation.

[15]  Maja J Matarić A model for distributed mobile robot environment learning and navigation , 1990 .

[16]  Rodney A. Brooks,et al.  Symbolic Error Analysis and Robot Planning , 1982 .

[17]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[18]  Tomas Lozano-Perez,et al.  The Design of a Mechanical Assembly System , 1976 .

[19]  D.J. Kriegman,et al.  Stereo vision and navigation in buildings for mobile robots , 1989, IEEE Trans. Robotics Autom..

[20]  A. Tarski A Decision Method for Elementary Algebra and Geometry , 2023 .

[21]  Billur Barshan,et al.  Differentiating Sonar Reflections from Corners and Planes by Employing an Intelligent Sensor , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Michael O'Donnell,et al.  On Large Scale Planar Manipulation , 1990 .

[23]  Alan D. Christiansen Manipulation planning for empirical backprojections , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[24]  Alan D. Christiansen,et al.  Learning reliable manipulation strategies without initial physical models , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[25]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[26]  Amy J. Briggs An efficient algorithm for one-step planar complaint motion planning with uncertainty , 1989, SCG '89.

[27]  Kenneth Y. Goldberg,et al.  Bayesian grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[28]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[29]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[30]  Jean-Claude Latombe,et al.  Motion Planning with Uncertainty: Practical Computation of Non-Maximal Preimages , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[31]  Randy C. Brost Automatic grasp planning in the presence of uncertainty , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[32]  Bruce Randall Donald,et al.  Constructive recognizability for task-directed robot programming , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[33]  W. Eric L. Grimson,et al.  Handey: A robot system that recognizes, plans, and manipulates , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[34]  Russell H. Taylor,et al.  The synthesis of manipulator control programs from task-level specifications , 1976 .

[35]  Stanley J. Rosenschein,et al.  Synthesizing Information-Tracking Automata from Environment Descriptions , 1989, KR.

[36]  Gordon I. McCalla,et al.  Error Detection and Recovery in a Dynamic Planning Environment , 1982, AAAI.

[37]  Ingemar J. Cox,et al.  Dynamic Map Building for an Autonomous Mobile Robot , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[38]  Bruce Randall Donald Planning Multi-Step Error Detection and Recovery Strategies , 1990, Int. J. Robotics Res..

[39]  SimunoviÄ SimunoviÄ,et al.  An information approach to parts mating , 1979 .

[40]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[41]  John Hershberger Compliant motion in a simple polygon , 1993, SCG '93.

[42]  Seth Hutchinson Exploiting visual constraints in robot motion planning , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[43]  Bruce Randall Donald,et al.  Error Detection and Recovery in Robotics , 1989, Lecture Notes in Computer Science.

[44]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[45]  Russell H. Taylor,et al.  Sensor-based manipulation planning as a game with nature , 1988 .

[46]  Bruce Randall Donald,et al.  Sensor interpretation and task-directed planning using perceptual equivalence classes , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[47]  Roman Kuc,et al.  Physically Based Simulation Model for Acoustic Sensor Robot Navigation , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Michael A. Erdmann,et al.  On probabilistic strategies for robot tasks , 1989 .

[49]  John F. Canny,et al.  New lower bound techniques for robot motion planning problems , 1987, 28th Annual Symposium on Foundations of Computer Science (sfcs 1987).

[50]  Robert Blondell,et al.  Design of a Microprocessor Driven Generic Controller for a Mobile Robot Base , 1990 .

[51]  Bruce Randall Donald,et al.  A Geometric Approach to Error Detection and Recovery for Robot Motion Planning with Uncertainty , 1987, Artif. Intell..

[52]  Matthew T. Mason,et al.  Automatic planning of fine motions: Correctness and completeness , 1984, ICRA.

[53]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[54]  Bruce Randall Donald,et al.  Towards experimental verification of an automated compliant motion planner based on a geometric theory of error detection and recovery , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[55]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[56]  Kenneth Y. Goldberg,et al.  Generating stochastic plans for a programmable parts feeder , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[57]  Vladimir J. Lumelsky,et al.  Continuous motion planning in unknown environment for a 3D cartesian robot arm , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[58]  D. Grigor'ev Complexity of deciding Tarski algebra , 1988 .

[59]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.