$-Calculus of Bounded Rational Agents: Flexible Optimization as Search under Bounded Resources in Interactive Systems

This paper presents a novel model for resource bounded computation based on process algebras. Such model is called the $-calculus (cost calculus). Resource bounded computation attempts to find the best answer possible given operational constraints. The $-calculus provides a uniform representation for optimization in the presence of limited resources. It uses cost-optimization to find the best quality solutions while using a minimal amount of resources. A unique aspect of the approach is to propose a resource bounded process algebra as a generic problem solving paradigm targeting interactive AI applications. The goal of the $-calculus is to propose a computational model with built-in performance measure as its central element. This measure allows not only the expression of solutions, but also provides the means to incrementally construct solutions for computationally hard, real-life problems. This is a dramatic contrast with other models like Turing machines, λ-calculus, or conventional process algebras. This highly expressive model must therefore be able to express approximate solutions. This paper describes the syntax and operational cost semantics of the calculus. A standard cost function has been defined for strongly and weakly congruent cost expressions. Example optimization problems are given which take into account the incomplete knowledge and the amount of resources used by an agent. The contributions of the paper are twofold: firstly, some necessary conditions for achieving global optimization by performing local optimization in time and/or space are found. That deals with incomplete information and complexity during problem solving. Secondly, developing an algebra which expresses current practices, e.g., neural nets, cellular automata, dynamic programming, evolutionary computation, or mobile robotics as limiting cases, provides a tool for exploring the theoretical underpinnings of these methods. As the result, hybrid methods can be naturally expressed and developed using the algebra.

[1]  Fred Glover,et al.  Genetic algorithms and scatter search: unsuspected potentials , 1994 .

[2]  Peter Wegner,et al.  Beyond Turing Machines , 2003, Bull. EATCS.

[3]  Mark S. Boddy,et al.  An Analysis of Time-Dependent Planning , 1988, AAAI.

[4]  Robin Milner,et al.  Elements of interaction: Turing award lecture , 1993, CACM.

[5]  Max H. Garzon,et al.  Models of massive parallelism: analysis of cellular automata and neural networks , 1995 .

[6]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[7]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[8]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[9]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[10]  Nils J. Nilsson,et al.  Problem-solving methods in artificial intelligence , 1971, McGraw-Hill computer science series.

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  Fred W. Glover,et al.  Tabu Thresholding: Improved Search by Nonmonotonic Trajectories , 1995, INFORMS J. Comput..

[13]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[14]  Gary D. Doolen,et al.  The Turing Machine , 1998 .

[15]  Arthur W. Burks,et al.  Essays on cellular automata , 1970 .

[16]  Dieter Fensel,et al.  Problem-Solving Methods , 2001, Lecture Notes in Computer Science.

[17]  C. Teuscher,et al.  Alan Turing: Life and Legacy of a Great Thinker , 2004, Springer Berlin Heidelberg.

[18]  Robin Milner,et al.  A Calculus of Mobile Processes, II , 1992, Inf. Comput..

[19]  Christopher G. Langton,et al.  Artificial Life , 2019, Philosophical Posthumanism.

[20]  J. Van Leeuwen,et al.  Handbook of theoretical computer science - Part A: Algorithms and complexity; Part B: Formal models and semantics , 1990 .

[21]  Abraham Kandel,et al.  Anytime Algorithm for Feature Selection , 2000, Rough Sets and Current Trends in Computing.

[22]  Robin Milner,et al.  The Polyadic π-Calculus: a Tutorial , 1993 .

[23]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[24]  Kazimierz Kuratowski,et al.  Introduction to Set Theory and Topology , 1964 .

[25]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[26]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[27]  A. Church The calculi of lambda-conversion , 1941 .

[28]  S. Iyengar,et al.  Multi-Sensor Fusion: Fundamentals and Applications With Software , 1997 .

[29]  Robin Milner,et al.  Operational and Algebraic Semantics of Concurrent Processes , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[30]  G. Plotkin,et al.  Proof, language, and interaction: essays in honour of Robin Milner , 2000 .

[31]  Jan van Leeuwen,et al.  Handbook of Theoretical Computer Science, Vol. A: Algorithms and Complexity , 1994 .

[32]  Richard R. Brooks,et al.  Robust Sensor Fusion Algorithms: Calibration and Cost Minimization. , 1996 .

[33]  E. Eberbach $-calculus Bounded Rationality = Process Algebra + Anytime Algorithms , 2001 .

[34]  Dina Q. Goldin Persistent Turing Machines as a Model of Interactive Computation , 2000, FoIKS.

[35]  Robin Milner,et al.  A Calculus of Mobile Processes, II , 1992, Inf. Comput..

[36]  Eugene Eberbach,et al.  Neural networks and adaptive expert systems in the CSA approach , 1993, Int. J. Intell. Syst..

[37]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[38]  Hava T. Siegelmann,et al.  Neural networks and analog computation - beyond the Turing limit , 1999, Progress in theoretical computer science.

[39]  John N. Hooker,et al.  Needed: An Empirical Science of Algorithms , 1994, Oper. Res..

[40]  Wei-Kuan Shih,et al.  Algorithms for scheduling imprecise computations , 1991, Computer.

[41]  Oded Maimon Knowledge Discovery and Data Mining : The Info-Fuzzy Network (IFN) Methodology , 2000 .

[42]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[43]  Marco Tomassini,et al.  The firefly machine: online evolware , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[44]  Alan M. Turing,et al.  Systems of Logic Based on Ordinals , 2012, Alan Turing's Systems of Logic.

[45]  George Karypis,et al.  Introduction to Parallel Computing , 1994 .

[46]  Eric Horvitz,et al.  Computational tradeoffs under bounded resources , 2001, Artif. Intell..

[47]  Eugene Eberbach,et al.  A Portable Language for Control of Multiple Autonomous Vehicles and Distributed Problem Solving , 2003 .

[48]  Peter Wegner,et al.  Turing’s Ideas and Models of Computation , 2004 .

[49]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[50]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[51]  W. Wolfe Introduction to Imaging Spectrometers , 1997 .

[52]  Eugene Eberbach,et al.  A generic tool for distributed AI with matching as message passing , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[53]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[54]  Ivan Bratko,et al.  Machine Learning and Data Mining; Methods and Applications , 1998 .

[55]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[56]  Rob van Glabbeek,et al.  Handbook of Process Algebra , 2001 .

[57]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[58]  Shlomo Zilberstein,et al.  Operational Rationality through Compilation of Anytime Algorithms , 1995, AI Mag..

[59]  Jeffrey D. Ullman,et al.  Introduction to automata theory, languages, and computation, 2nd edition , 2001, SIGA.

[60]  Jan van Leeuwen,et al.  The Turing machine paradigm in contemporary computing , 2001 .

[61]  Peter Wegner,et al.  Interactive , 2021, Encyclopedia of the UN Sustainable Development Goals.

[62]  David B. Fogel,et al.  Anaconda defeats Hoyle 6-0: a case study competing an evolved checkers program against commercially available software , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[63]  Victor R. Lesser,et al.  Design-to-time real-time scheduling , 1993, IEEE Trans. Syst. Man Cybern..

[64]  A. Church The Calculi of Lambda Conversion. (AM-6) (Annals of Mathematics Studies) , 1985 .

[65]  Daniel Marcu,et al.  Controlling Autonomous Robots with GOLOG , 1997, Australian Joint Conference on Artificial Intelligence.

[66]  Eugene Eberbach CSA: In the Direction of Greater Representational Power for Neurocomputing , 1994, J. Parallel Distributed Comput..

[67]  Kagan Tumer,et al.  An Introduction to Collective Intelligence , 1999, ArXiv.

[68]  Eugene Eberbach,et al.  On designing CO$T: a new approach and programming environment for distributed problem solving based on evolutionary computation and anytime algorithms , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[69]  Jacob Barhen,et al.  TRUST: A deterministic algorithm for global optimization , 1997 .

[70]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[71]  Andrzej Skowron,et al.  New Directions in Rough Sets, Data Mining, and Granular-Soft Computing , 1999, Lecture Notes in Computer Science.

[72]  Chris Reade "Proof, Language and Interaction, Essays in Honour of Robin Milner" by Gordon Plotkin, Colin Sterling and Mads Tofte (eds.), Foundations of Computing Series, MIT Press 2000 , 2000, J. Funct. Program..

[73]  Simon Parsons,et al.  Do the right thing - studies in limited rationality by Stuart Russell and Eric Wefald, MIT Press, Cambridge, MA, £24.75, ISBN 0-262-18144-4 , 1994, The Knowledge Engineering Review.

[74]  W. W. Bledsoe,et al.  Review of "Problem-Solving Methods in Artificial Intelligence by Nils J. Nilsson", McGraw-Hill Pub. , 1971, SGAR.

[75]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[76]  Shashi Phoha,et al.  Flexible Optimization and Evolution of Underwater Autonomous Agents , 1999, RSFDGrC.

[77]  Andrew B. Kahng,et al.  Old Bachelor Acceptance: A New Class of Non-Monotone Threshold Accepting Methods , 1995, INFORMS J. Comput..

[78]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[79]  Eugene Eberbach Semal: a Cost Language Based on the Calculus of Self-Modifiable Algorithms , 1994, Int. J. Softw. Eng. Knowl. Eng..

[80]  Peter Wegner,et al.  New Models of Computation , 2004, Comput. J..

[81]  Carl A. Gunter,et al.  In handbook of theoretical computer science , 1990 .

[82]  Eugene Eberbach,et al.  Expressiveness of $-Calculus: What Matters? , 2000, Intelligent Information Systems.

[83]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[84]  Stuart J. Russell,et al.  Do the right thing - studies in limited rationality , 1991 .

[85]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[86]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[87]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[88]  S. Sitharama Iyengar,et al.  Automatic Correlation and Calibration of Noisy Sensor Readings Using Elite Genetic Algorithms , 1996, Artif. Intell..

[89]  Peter Wegner,et al.  Why interaction is more powerful than algorithms , 1997, CACM.

[90]  Stuart J. Russell,et al.  Do the right thing , 1991 .

[91]  Eric Horvitz,et al.  Reasoning about beliefs and actions under computational resource constraints , 1987, Int. J. Approx. Reason..

[92]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[93]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[94]  Peter Wegner,et al.  Coinductive Models of Finite Computing Agents , 1999, CMCS.

[95]  Nils J. Nilsson,et al.  Artificial Intelligence: A New Synthesis , 1997 .

[96]  Robin Milner,et al.  A Calculus of Communicating Systems , 1980, Lecture Notes in Computer Science.