Constraint-directed improvisation for everyday activities

Existing approaches to planning in Artificial Intelligence (such as Universal and Classical Planning) are designed for very specific types of activities, and are largely inapplicable to areas outside their narrow ranges. In particular, everyday activities that are simple for humans, such as making a meal or getting from place to place, require long-term goal-directed and timely responses that are far beyond the bounds of these traditional approaches. This dissertation examines the nature of the everyday activities and develops a computational architecture for an agent able to participate in such activities. An analysis of everyday activities shows them to be difficult tasks made artificially simple through extensive activity-specific knowledge possessed by the agent performing them. I argue that existing approaches are unsuitable to everyday activity because they rely too heavily on compiled knowledge and fail to adequately apply the background knowledge from which these compilations were originally made. To address everyday activities, I present a theory of improvisation, a new approach that views the problem as satisficing intelligent control: providing resource-bounded responses to the environment in light of the agent's previous experience and its current and future intentions for activity. This process is based on the use of both heavily compiled routines the agent is accustomed to following, and an extensive collection of background knowledge used to apply those routines flexibly. The agent can rely on its routines in normative situations or when time is too scarce to spend examining the reasons behind its routines, and can conversely rely more heavily on background knowledge as situations become less normative. This allows the agent to take advantage of regularities in its environment and respond flexibly in less familiar situations. I then present an architecture embodying the improvisational approach based on the use of constraint-directed reasoning. This methodology provides a flexible control mechanism that allows the agent to respond as dynamically as necessary for the circumstances in which it finds itself. Implemented examples of improvised behaviour are also shown, using a simulation tool developed in conjunction with this research.

[1]  Kenneth D. Forbus Qualitative Process Theory , 1984, Artif. Intell..

[2]  Kenneth M. Ford,et al.  On Babies and Bathwater: A Cautionary Tale , 1994, AI Mag..

[3]  Michael P. Georgeff,et al.  Commitment and Effectiveness of Situated Agents , 1991, IJCAI.

[4]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[5]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[6]  Z. Pylyshyn Robot's Dilemma: The Frame Problem in Artificial Intelligence , 1987 .

[7]  Wai-Kiang Yeap Towards a Computational Theory of Cognitive Maps , 1988, Artif. Intell..

[8]  Paul R. Cohen,et al.  Trial by Fire: Understanding the Design Requirements for Agents in Complex Environments , 1989, AI Mag..

[9]  B. Kuipers Modelling spatial knowledge , 1977, IJCAI 1977.

[10]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.

[11]  Patrick J. Hayes,et al.  Naive physics I: ontology for liquids , 1989 .

[12]  Jerry R. Hobbs Commonsense summer : final report , 1985 .

[13]  S. Scribner Studying working intelligence. , 1984 .

[14]  V. Rich Personal communication , 1989, Nature.

[15]  M. J. Ricketts From Academe To Reality Or How I Learned That Operations Research Is Much More Than Just The Application Of Quantitative Analysis Techniques , 1979 .

[16]  Matthew L. Ginsberg,et al.  Universal Planning: An (Almost) Universally Bad Idea , 1989, AI Mag..

[17]  C. Cordell Green,et al.  Application of Theorem Proving to Problem Solving , 1969, IJCAI.

[18]  Leslie Pack Kaelbling,et al.  Planning With Deadlines in Stochastic Domains , 1993, AAAI.

[19]  Maria Gini,et al.  An empirical study of sensing and defaulting in planning , 1992 .

[20]  H. Penny Nii,et al.  The Handbook of Artificial Intelligence , 1982 .

[21]  Allen Newell,et al.  Empirical explorations with the logic theory machine: a case study in heuristics , 1995 .

[22]  Russell L. Ackoff,et al.  The Art and Science of Mess Management , 1981 .

[23]  Alex Goodall,et al.  The guide to expert systems , 1985 .

[24]  Paul R. Cohen,et al.  Benchmarks, Test Beds, Controlled Experimentation, and the Design of Agent Architectures , 1993, AI Mag..

[25]  Roger C. Schank,et al.  Dynamic memory - a theory of reminding and learning in computers and people , 1983 .

[26]  Stephen F. Smith,et al.  Reactive Plan Revision , 1988, AAAI.

[27]  Margaret A. Boden,et al.  The Structure of Intentions , 1973 .

[28]  OAK PARK,et al.  Detroit , 1954 .

[29]  Qiang Yang,et al.  ABTWEAK: Abstracting a Nonlinear, Least Commitment Planner , 1990, AAAI.

[30]  Allen Goldberg,et al.  Is complexity theory of use to AI , 1984 .

[31]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[32]  H. Penny Nii,et al.  Blackboard systems: the blackboard model of problem solving and the evolution of blackboard architectures , 1995 .

[33]  Mark S. Fox,et al.  Beyond The Knowledge Level , 1986, Expert Database Conf..

[34]  Marcel Schoppers,et al.  In Defense of Reaction Plans as Caches , 1989, AI Mag..

[35]  Robert K. Lindsay,et al.  Deterministic Autonomous Systems , 1991, AI Mag..

[36]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[37]  George W. Ernst,et al.  GPS : a case study in generality and problem solving , 1971 .

[38]  Mark Jeffrey Stefik Planning with constraints , 1980 .

[39]  Drew McDermott,et al.  A Temporal Logic for Reasoning About Processes and Plans , 1982, Cogn. Sci..

[40]  David Chapman,et al.  What are plans for? , 1990, Robotics Auton. Syst..

[41]  Vipin Kumar,et al.  Algorithms for Constraint-Satisfaction Problems: A Survey , 1992, AI Mag..

[42]  Oren Etzioni,et al.  Intelligence without Robots: A Reply to Brooks , 1993, AI Mag..

[43]  Philip E. Agre,et al.  The dynamic structure of everyday life , 1988 .

[44]  Herbert A. Simon,et al.  Search and Reasoning in Problem Solving , 1983, Artif. Intell..

[45]  Reid G. Smith,et al.  Fundamentals of expert systems , 1988 .

[46]  John Anderson,et al.  Constraint-Directed Improvisation for Complex Domains , 1996, Canadian Conference on AI.

[47]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[48]  Richard B. Segal Softbots as Testbeds for Machine Learning , 1992 .

[49]  Marcel Schoppers,et al.  Universal Plans for Reactive Robots in Unpredictable Environments , 1987, IJCAI.

[50]  J. Anderson,et al.  Constraint-Directed Reasoning as a Basis for Real-Time Planning , 1996 .

[51]  CoordinationExperimentsEdmund H. Durfee,et al.  MICE : A Flexible Testbed for Intelligent , 1989 .

[52]  Richard Alterman,et al.  Adaptive Planning , 1988, Cogn. Sci..

[53]  Robert Engelmore Readings from the AI magazine , 1989 .

[54]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[55]  Charles Jencks,et al.  Adhocism: The Case for Improvisation , 1972 .

[56]  Denis Johnson In Palo Alto , 1982 .

[57]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[58]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[59]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[60]  E. Goffman Frame analysis: An essay on the organization of experience , 1974 .

[61]  Edmund H. Durfee,et al.  Evaluating Research in Cooperative Distributed Problem Solving , 1990, Distributed Artificial Intelligence.

[62]  Stephen F. Smith,et al.  Constructing and Maintaining Detailed Production Plans: Investigations into the Development of Knowledge-Based Factory Scheduling Systems , 1986, AI Mag..

[63]  Edward P. K. Tsang Elements in Temporal Reasoning in Planning , 1988, ISMIS.

[64]  Randall Davis A Tale of Two Knowledge Servers , 1991, AI Mag..

[65]  Ian Horswill,et al.  Cultural Support for Improvisation , 1992, AAAI.

[66]  William Barrett Irrational Man: A Study in Existential Philosophy , 1958 .

[67]  P. Rabbitt Conceptions of Intelligence , 1993, Ageing and Society.

[68]  D. Hofstadter Metamagical Themas: Questing for the Essence of Mind and Pattern , 1985 .

[69]  W. S. Reilly,et al.  Building Emotional Agents , 1992 .

[70]  Douglas B. Lenat,et al.  CYC: Using Common Sense Knowledge to Overcome Brittleness and Knowledge Acquisition Bottlenecks , 1986, AI Mag..

[71]  Ramanathan V. Guha,et al.  CYC: A Midterm Report , 1990, AI Mag..

[72]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[73]  Gevarter,et al.  Overview of Expert Systems , 1982 .

[74]  Steven A. Vere,et al.  Planning in Time: Windows and Durations for Activities and Goals , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  John Anderson,et al.  Achieving flexible autonomy in multiagent systems using constraints , 1992, Appl. Artif. Intell..

[76]  M. Evans,et al.  Supporting flexible autonomy in a simulation environment for intelligent agent designs , 1993, 1993 4th Annual Conference on AI, Simulation and Planning in High Autonomy Systems.

[77]  Karl G. Kempf,et al.  Opportunistic scheduling for robotic assembly , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[78]  G. Gorry,et al.  Towards the simulation of clinical cognition. Taking a present illness by computer. , 1976, The American journal of medicine.

[79]  Drew McDermott,et al.  Artificial intelligence meets natural stupidity , 1976, SGAR.

[80]  Claude Le Pape,et al.  Adapting the behavior of a job-shop scheduling system , 1991, Decis. Support Syst..

[81]  Mark S. Fox,et al.  An Investigation of Opportunistic Constraint Satisfaction in Space Planning , 1987, IJCAI.

[82]  F. Bartlett Thinking: An Experimental and Social Study , 1958 .

[83]  Martha E. Pollack,et al.  Introducing the Tileworld: Experimentally Evaluating Agent Architectures , 1990, AAAI.

[84]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[85]  Edward H. Shortliffe,et al.  Production Rules as a Representation for a Knowledge-Based Consultation Program , 1977, Artif. Intell..

[86]  Paul R. Cohen,et al.  Failure Recovery: A Model and Experiments , 1991, AAAI.

[87]  David Wilkins,et al.  Using Patterns and Plans in Chess , 1980, Artif. Intell..

[88]  T. Bylander Complexity results for extended planning , 1992 .

[89]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[90]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[91]  Kristian J. Hammond,et al.  Stabilizing Environments to Facilitate Planning and Activity: An Engineering Argument , 1991, AAAI.

[92]  John McCarthy,et al.  Programs with common sense , 1960 .

[93]  P. Kline Models of man , 1986, Nature.

[94]  Barbara Hayes-Roth,et al.  A Cognitive Model of Planning , 1979, Cogn. Sci..

[95]  R. James Firby,et al.  Building symbolic primitives with continuous control routines , 1992 .

[96]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[97]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[98]  David P. Miller The Long-Term Effects of Secondary Sensing , 1994, AI Mag..

[99]  M. Evans,et al.  Constraint-directed intelligent control in multi-agent problem solving , 1990, Proceedings [1990]. AI, Simulation and Planning in High Autonomy Systems.

[100]  Leslie Pack Kaelbling,et al.  Action and planning in embedded agents , 1990, Robotics Auton. Syst..

[101]  Roberto Desimone SOCAP: Lessons learned in applying SIPE-2 to the military operations crisis action planning domain , 1992 .

[102]  Claude Le Pape Using constraint propagation in blackboard systems: a flexible software architecture for reactive and distributed systems , 1992, Computer.

[103]  Edmund H. Durfee,et al.  What Your Computer Really Needs to Know, You Learned in Kindergarten , 1992, AAAI.

[104]  Adele E. Howe Evaluating Planning Through Simulation: An Example Using Phoenix * , 1993 .

[105]  A Elithorn,et al.  ARTIFICIAL AND HUMAN INTELLIGENCE , 1984 .

[106]  Kristian J. Hammond,et al.  Integrating Planning and Acting in a Case-Based Framework , 1990, AAAI.

[107]  Mark S. Fox,et al.  Constraint-Directed Search: A Case Study of Job-Shop Scheduling , 1987 .

[108]  Roger C. Schank,et al.  What Is AI, Anyway? , 1987, AI Mag..

[109]  Henry Mintzberg,et al.  Managerial Work: Analysis from Observation , 1971 .

[110]  John Anderson,et al.  Pragmatic User Modelling in a Commercial Software System , 1997 .

[111]  Austin Tate,et al.  Interacting Goals And Their Use , 1975, IJCAI.

[112]  P. Maglio,et al.  Reaction and reflection in Tetris , 1992 .

[113]  Christopher K. Riesbeck,et al.  Inside Case-Based Reasoning , 1989 .

[114]  J. Pearce Introduction to animal cognition , 1987 .

[115]  Benjamin Kuipers,et al.  Qualitative Simulation , 1986, Artificial Intelligence.

[116]  J. Anderson,et al.  Intelligent agent modelling for natural resource management , 1994 .

[117]  John Anderson Waffler: A Constraint-Directed Approach to Intelligent Agent Design , 1997 .

[118]  Mark S. Boddy,et al.  An Analysis of Time-Dependent Planning , 1988, AAAI.

[119]  Erann Gat,et al.  On the Role of Stored Internal State in the Control of Autonomous Mobile Robots , 1993, AI Mag..

[120]  David Chapman,et al.  Planning for Conjunctive Goals , 1987, Artif. Intell..

[121]  Drew McDermott,et al.  Planning and Acting , 1978, Cogn. Sci..

[122]  D. Corkill Blackboard Systems , 1991 .

[123]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[124]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[125]  John S. Hammond,et al.  Do's and Don'ts of Computer Models for Planning. , 1974 .

[126]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[127]  Kristian J. Hammond,et al.  Case-Based Planning: Viewing Planning as a Memory Task , 1989 .

[128]  R. Wilensky Planning and Understanding: A Computational Approach to Human Reasoning , 1983 .

[129]  David E. Wilkins,et al.  Practical planning - extending the classical AI planning paradigm , 1989, Morgan Kaufmann series in representation and reasoning.

[130]  Bruce G. Buchanan,et al.  Artificial Intelligence as an Experimental Science , 1988 .

[131]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[132]  Paul K. Davis,et al.  The Base of Sand Problem: A White Paper on the State of Military Combat Modeling , 1991 .

[133]  Kristian J. Hammond,et al.  Opportunistic memory , 1989, IJCAI 1989.

[134]  E.H. Shortliffe,et al.  Knowledge engineering for medical decision making: A review of computer-based clinical decision aids , 1979, Proceedings of the IEEE.