Cognitive Principles for Information Management: The Principles of Mnemonic Associative Knowledge (P-MAK)

Information management systems improve the retention of information in large collections. As such they act as memory prostheses, implying an ideal basis in human memory models. Since humans process information by association, and situate it in the context of space and time, systems should maximize their effectiveness by mimicking these functions. Since human attentional capacity is limited, systems should scaffold cognitive efforts in a comprehensible manner. We propose the Principles of Mnemonic Associative Knowledge (P-MAK), which describes a framework for semantically identifying, organizing, and retrieving information, and for encoding episodic events by time and stimuli. Inspired by prominent human memory models, we propose associative networks as a preferred representation. Networks are ideal for their parsimony, flexibility, and ease of inspection. Networks also possess topological properties—such as clusters, hubs, and the small world—that aid analysis and navigation in an information space. Our cognitive perspective addresses fundamental problems faced by information management systems, in particular the retrieval of related items and the representation of context. We present evidence from neuroscience and memory research in support of this approach, and discuss the implications of systems design within the constraints of P-MAK’s principles, using text documents as an illustrative semantic domain.

[1]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[2]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .

[3]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[4]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[5]  R. Nosofsky American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[6]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[7]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[8]  M. Ross Quillian,et al.  The teachable language comprehender: a simulation program and theory of language , 1969, CACM.

[9]  A. Tversky Features of Similarity , 1977 .

[10]  Lada A. Adamic The Small World Web , 1999, ECDL.

[11]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[12]  Daphne Koller,et al.  Hierarchically Classifying Documents Using Very Few Words , 1997, ICML.

[13]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[14]  David Gelernter,et al.  Lifestreams: an alternative to the desktop metaphor , 1996, CHI Conference Companion.

[15]  W. Kintsch,et al.  The representation of meaning in memory , 1974 .

[16]  Christian Lebiere,et al.  Cognition and Multi-Agent Interaction: From Cognitive Modeling to Social Simulation , 2006 .

[17]  Lance J. Rips,et al.  Structure and process in semantic memory: A featural model for semantic decisions. , 1974 .

[18]  Gordon Bell,et al.  MyLifeBits: fulfilling the Memex vision , 2002, MULTIMEDIA '02.

[19]  John D. Bransford,et al.  Considerations of some problems of comprehension. , 1973 .

[20]  Joao Antonio Pereira,et al.  Linked: The new science of networks , 2002 .

[21]  D. Parisi,et al.  Agent Interaction : From Cognitive Modeling to Social Simulation Sociality in embodied neural agents , 2004 .

[22]  Christian R. Huyck,et al.  Cell Assemblies as an Intermediate Level Model of Cognition , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[23]  Kai-Florian Richter,et al.  User-Centered Views and Spatial Concepts for Navigation in Information Spaces , 2004 .

[24]  William Buxton,et al.  Readings in human-computer interaction , 1987 .

[25]  G. Bower,et al.  Human Associative Memory , 1973 .

[26]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[27]  L. Jacoby,et al.  Remembering without awareness , 1982 .

[28]  R. Schvaneveldt,et al.  Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. , 1971, Journal of experimental psychology.

[29]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[30]  Friedemann Pulverm Uuml,et al.  Words in the brain's language , 1999 .

[31]  J. Mandler Stories, Scripts, and Scenes: Aspects of Schema Theory , 1984 .

[32]  John D. Bransford,et al.  The abstraction of linguistic ideas , 1971 .

[33]  C. Osgood The nature and measurement of meaning. , 1952, Psychological bulletin.

[34]  Charles James Nice Bailey,et al.  New ways of analyzing variation in English , 1973 .

[35]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[36]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[37]  James L. McClelland,et al.  Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences , 1986 .

[38]  Gregory D. Abowd,et al.  CybreMinder: A Context-Aware System for Supporting Reminders , 2000, HUC.

[39]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[40]  Todd R. Johnson Control in Act-R and Soar , 1997 .

[41]  Thomas K. Landauer,et al.  On the computational basis of learning and cognition: Arguments from LSA , 2002 .

[42]  S. Yamaguchi,et al.  Synchronization of Cellular Clocks in the Suprachiasmatic Nucleus , 2003, Science.

[43]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[44]  Brian Cantwell Smith,et al.  On the origin of objects , 1997, Trends in Cognitive Sciences.

[45]  Benoît Lemaire,et al.  Incremental Construction of an Associative Network from a Corpus , 2004 .

[46]  M. McDaniel,et al.  Normal aging and prospective memory. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[47]  Ian H. Witten,et al.  Managing gigabytes (2nd ed.): compressing and indexing documents and images , 1999 .

[48]  Mitsuru Ishizuka,et al.  Keyword extraction from a single document using word co-occurrence statistical information , 2004, Int. J. Artif. Intell. Tools.

[49]  B J Baars,et al.  How does a serial, integrated and very limited stream of consciousness emerge from a nervous system that is mostly unconscious, distributed, parallel and of enormous capacity? , 1993, Ciba Foundation symposium.

[50]  John E. Laird,et al.  Soar-RL: integrating reinforcement learning with Soar , 2005, Cognitive Systems Research.

[51]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[52]  Peter W. Foltz,et al.  Models of Human Memory and Computer Information Retrieval: Similar Approaches to Simiar Problems , 1991 .

[53]  W. Brewer,et al.  Role of schemata in memory for places , 1981, Cognitive Psychology.

[54]  Fabio Crestani,et al.  Application of Spreading Activation Techniques in Information Retrieval , 1997, Artificial Intelligence Review.

[55]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[56]  D. J. Foss,et al.  Semantic facilitation and lexical access during sentence processing , 1978 .

[57]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[58]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[59]  John F. Roddick,et al.  Database Issues in Knowledge Discovery and Data Mining , 1999, Australas. J. Inf. Syst..

[60]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[61]  B. Goertzel From complexity to creativity: explorations in evolutionary, autopoietic, and cognitive dynamics , 1997 .

[62]  H. P. Bahrick Semantic memory content in permastore: fifty years of memory for Spanish learned in school. , 1984, Journal of experimental psychology. General.

[63]  B. F. Skinner,et al.  Why I am Not a Cognitive Psychologist , 1977 .

[64]  M. Schölvinck,et al.  Differential components of prospective memory? Evidence from fMRI , 2006, Neuropsychologia.

[65]  C. Thornton Truth from Trash: How Learning Makes Sense , 2000 .

[66]  Ian H. Witten,et al.  Managing Gigabytes: Compressing and Indexing Documents and Images , 1999 .

[67]  Luisa Micó,et al.  Extending Fast Nearest Neighbour Search Algorithms for Approximate k-NN Classification , 2003, IbPRIA.

[68]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[69]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[70]  P Cariani,et al.  Symbols and dynamics in the brain. , 2001, Bio Systems.

[71]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[72]  Daniel Tranel,et al.  Knowing “What” and Knowing “When” , 2006, Journal of clinical and experimental neuropsychology.

[73]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[74]  Jeff Shrager,et al.  Observation of Phase Transitions in Spreading Activation Networks , 1987, Science.

[75]  Frederick L Coolidge,et al.  The expert Neandertal mind. , 2004, Journal of human evolution.

[76]  Mark Steyvers,et al.  Small Worlds in Semantic Networks , 2022 .

[77]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[78]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[79]  Curt Burgess,et al.  The Dynamics of Meaning in Memory , 1998 .

[80]  B. L. Whorf Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf , 1956 .

[81]  John R. Anderson,et al.  Modeling paradigms in ACT-R , 2006 .

[82]  A. Amedi,et al.  Functional imaging of human crossmodal identification and object recognition , 2005, Experimental Brain Research.

[83]  P M Todd,et al.  Précis of Simple heuristics that make us smart , 2000, Behavioral and Brain Sciences.

[84]  L. Barsalou,et al.  Ad hoc categories , 1983, Memory & cognition.

[85]  Hans P. Moravec Robot: Mere Machine to Transcendent Mind , 1998 .

[86]  Jim Austin,et al.  Emergent Neural Computational Architectures Based on Neuroscience: Towards Neuroscience-Inspired Computing , 2001 .

[87]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[88]  William A. Woods,et al.  What's in a Link: Foundations for Semantic Networks , 1975 .

[89]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[90]  Intentional and incidental learning in children and the von Restorff effect , 1973 .

[91]  R. Sun Cognition and Multi-Agent Interactions: From Cognitive Modeling to Social Simulation , 2005 .

[92]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .

[93]  W. P. Jones The memory extender personal filing system , 1986, CHI '86.

[94]  Dong Liu,et al.  On information and knowledge representation in the brain , 2003, The Second IEEE International Conference on Cognitive Informatics, 2003. Proceedings..

[95]  Lars Nyberg,et al.  Hemispheric asymmetries of memory: the HERA model revisited , 2003, Trends in Cognitive Sciences.

[96]  Gary Klein,et al.  The State of Cognitive Systems Engineering , 2002, IEEE Intell. Syst..

[97]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[98]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[99]  Mathieu Koppen,et al.  Modeling knowledge-based inferences in story comprehension , 2003, Cogn. Sci..

[100]  John R. Anderson,et al.  A rational analysis of human memory. , 1989 .

[101]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[102]  Partha Dasgupta,et al.  Topology of the conceptual network of language. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[103]  Edward A. Fox,et al.  Recommender Systems Research: A Connection-Centric Survey , 2004, Journal of Intelligent Information Systems.

[104]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[105]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[106]  M. Cole Cross-cultural universals of affective meaning. , 1976 .

[107]  Earl Hunt,et al.  ORIENTATION AND WAYFINDING: A REVIEW , 1999 .

[108]  STEVE WHITTAKER,et al.  The character, value, and management of personal paper archives , 2001, TCHI.

[109]  Lawrence W. Barsalou,et al.  Constructing Representations of Categories from Different Points of View , 1984 .

[110]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[111]  Yuko Munakata,et al.  Computational cognitive neuroscience of early memory development , 2004 .

[112]  John F. Sowa,et al.  Principles of semantic networks , 1991 .

[113]  Frank Harary,et al.  Graph Theory , 2016 .

[114]  M. J. Sharps,et al.  Memory for Animal Tracks: A Possible Cognitive Artifact of Human Evolution , 2002, The Journal of psychology.

[115]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[116]  Norman G. Vinson,et al.  Design guidelines for landmarks to support navigation in virtual environments , 1999, CHI '99.

[117]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[118]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[119]  S. Lynch,et al.  Sensory Processing , 2004 .

[120]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[121]  Peter W. Foltz,et al.  Learning Human-like Knowledge by Singular Value Decomposition: A Progress Report , 1997, NIPS.

[122]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[123]  Mariano Sigman,et al.  Global organization of the Wordnet lexicon , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[124]  Jonathan Grudin,et al.  Human Computer Interaction: The Year 2000 and Beyond , 1995, HCI.

[125]  Stefan Wermter,et al.  Emergent Neural Computational Architectures Based on Neuroscience , 2001, Lecture Notes in Computer Science.

[126]  Risto Miikkulainen,et al.  The capacity of convergence-zone episodic memory , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[127]  Hongyuan Zha,et al.  On Updating Problems in Latent Semantic Indexing , 1997, SIAM J. Sci. Comput..

[128]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[129]  Mark S. Ackerman,et al.  The perfect search engine is not enough: a study of orienteering behavior in directed search , 2004, CHI.

[130]  John R. Anderson A spreading activation theory of memory. , 1983 .

[131]  Christian Schlögl,et al.  Information and knowledge management: dimensions and approaches , 2005, Inf. Res..

[132]  G. A. Miller The magical number seven plus or minus two: some limits on our capacity for processing information. , 1956, Psychological review.