Mitigating the Inevitable Failure of Knowledge Representation

This paper is a continuation of a previous paper on self-modeling systems, concerning mitigation methods for the Get Stuck Theorems, which are powerful theorems about the limits of knowledge representation. The First Get Stuck Theorem says that since there are only finitely many data structures of any given size, it follows that as a system tries to save more and more data / information / knowledge, the structures necessarily get larger, and eventually they are too large for effective computation.The mitigations we described are Behavior Mining, which is about building models of the system and environment behavior, Model Deficiency Analysis, which is about assessing the efficacy of those models and determining how to improve them, Knowledge Refactoring, which is about restructuring the saved data for more efficient access and smaller storage, and Constructive Forgetting, which is about explicitly discarding some data that is deemed to be less critical.We argue that these classes of mitigations, and a couple of new ones, can help a system retain effectively computable knowledge structures in a dynamic environment at higher levels of difficulty (of course, as the environment gets more dynamic, all systems, including individual biological organisms and even species, eventually fail).

[1]  Thomas Vogel,et al.  On Unifying Development Models and Runtime Models , 2014, MoDELS@Run.time.

[2]  Thomas Vogel,et al.  State of the Art in Architectures for Self-aware Computing Systems , 2017, Self-Aware Computing Systems.

[3]  Marco Platzner,et al.  Self-aware Computing Systems , 2016, Natural Computing Series.

[4]  Uwe Aßmann,et al.  Managing Distributed Context Models Requires Adaptivity too , 2015, Models@run.time.

[5]  Pierre Wolper,et al.  Specification and synthesis of communicating processes using an extended temporal logic: (preliminary version) , 1982, POPL '82.

[6]  P. Flajolet,et al.  Analytic Combinatorics: RANDOM STRUCTURES , 2009 .

[7]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[8]  Christopher Landauer Non-deterministic distributions , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[9]  Mauricio A. Saca Refactoring improving the design of existing code , 2017, 2017 IEEE 37th Central America and Panama Convention (CONCAPAN XXXVII).

[10]  Noam Chomsky,et al.  The Algebraic Theory of Context-Free Languages* , 1963 .

[11]  Christopher Landauer,et al.  Self-modeling Systems , 2001, IWSAS.

[12]  Brice Morin,et al.  Models@Runtime to Support the Iterative and Continuous Design of Autonomic Reasoners , 2013, Models@run.time.

[13]  E. Muñoz-Martínez Small Worlds: The Dynamics of Networks Between Order and Randomness, by Duncan J. Watts, (Princeton Studies in Complexity), Princeton University Press, 1999. $39.50 (hardcover), 262 pp. ISBN: 0-691-00541-9. (Book Reviews) , 2000 .

[14]  Alex M. Andrew,et al.  Intelligent Systems: Architecture, Design, and Control , 2002 .

[15]  Tatsuhiro Tsuchiya,et al.  Caching Strategies for Run-time Probabilistic Model Checking , 2016, MoDELS@Run.time.

[16]  Christopher Landauer,et al.  Generic programming, partial evaluation, and a new programming paradigm , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[17]  James S. Albus,et al.  Engineering of Mind: An Introduction to the Science of Intelligent Systems , 2001 .

[18]  Jaime Font,et al.  An Infrastructure for Generating Run-time Model Traces for Maintenance Tasks , 2016, Models@run.time.

[19]  Christopher Landauer,et al.  Model-Based Cooperative System Engineering and Integration , 2016, 2016 IEEE International Conference on Autonomic Computing (ICAC).

[20]  Christopher Landauer,et al.  Modeling spaces for real-time embedded systems , 2013, 16th IEEE International Symposium on Object/component/service-oriented Real-time distributed Computing (ISORC 2013).

[21]  Christopher Landauer Infrastructure for Studying Infrastructure , 2013, ESOS.

[22]  Q. Ethan McCallum Bad Data Handbook , 2012 .

[23]  Uwe Zdun,et al.  Enhancing Root Cause Analysis with Runtime Models and Interactive Visualizations , 2013, MoDELS@Run.time.

[24]  Thomas Vogel,et al.  Architectural Concepts for Self-aware Computing Systems , 2017, Self-Aware Computing Systems.

[25]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.

[26]  Christopher Landauer,et al.  Programming Paradigms for Real-Time Systems , 2014, 2014 IEEE 17th International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing.

[27]  Colin de la Higuera,et al.  Grammatical Inference: Learning Automata and Grammars , 2010 .

[28]  Joshua Kerievsky,et al.  Refactoring to Patterns , 2004, XP/Agile Universe.

[29]  Dov M. Gabbay,et al.  Handbook of Philosophical Logic , 2002 .

[30]  Thomas A. Russ,et al.  WhyNot: debugging failed queries in large knowledge bases , 2002, AAAI/IAAI.

[31]  Pierre Wolper Temporal Logic Can Be More Expressive , 1983, Inf. Control..

[32]  K. Thompson Reflections on trusting trust , 1984, CACM.

[33]  John M. Foster,et al.  Automatic Syntactic Analysis , 1970 .

[34]  Richard F. Paige,et al.  Exploring the Use of Metaheuristic Search to Infer Models of Dynamic System Behaviour , 2013, MoDELS@Run.time.

[35]  Kirstie L. Bellman An approach to integrating and creating flexible software environments supporting the design of complex systems , 1991, 1991 Winter Simulation Conference Proceedings..

[36]  Samuel Kounev,et al.  Towards Online Performance Model Extraction in Virtualized Environments , 2013, MoDELS@Run.time.

[37]  A. Paepcke CLOS in Context: The Shape of the Design Space , 1993 .

[38]  Christopher Landauer Problem Posing as a System Engineering Paradigm , 2011, 2011 21st International Conference on Systems Engineering.

[39]  Phyllis R. Nelson,et al.  Systems Engineering for Organic Computing: The Challenge of Shared Design and Control between OC Systems and their Human Engineers , 2008, Organic Computing.

[40]  Ada Diaconescu,et al.  The Notion of Self-aware Computing , 2017, Self-Aware Computing Systems.

[41]  Yacine Bellik,et al.  Building Heterogeneous Models at Runtime to Detect Faults in Ambient-Intelligent Environments , 2013, MoDELS@Run.time.

[42]  Nelly Bencomo,et al.  Runtime Models Based on Dynamic Decision Networks: Enhancing the Decision-making in the Domain of Ambient Assisted Living Applications , 2016, Models@run.time.

[43]  Phyllis R. Nelson,et al.  Managing Variable and Cooperative Time Behavior , 2010, 2010 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing Workshops.

[44]  Paola Inverardi,et al.  ModelLAND: Where Do Models Come from? , 2011, Models@run.time@Dagstuhl.