Dynamic searching in the brain

Cognitive functions rely on the extensive use of information stored in the brain, and the searching for the relevant information for solving some problem is a very complex task. Human cognition largely uses biological search engines, and we assume that to study cognitive function we need to understand the way these brain search engines work. The approach we favor is to study multi-modular network models, able to solve particular problems that involve searching for information. The building blocks of these multimodular networks are the context dependent memory models we have been using for almost 20 years. These models work by associating an output to the Kronecker product of an input and a context. Input, context and output are vectors that represent cognitive variables. Our models constitute a natural extension of the traditional linear associator. We show that coding the information in vectors that are processed through association matrices, allows for a direct contact between these memory models and some procedures that are now classical in the Information Retrieval field. One essential feature of context-dependent models is that they are based on the thematic packing of information, whereby each context points to a particular set of related concepts. The thematic packing can be extended to multimodular networks involving input-output contexts, in order to accomplish more complex tasks. Contexts act as passwords that elicit the appropriate memory to deal with a query. We also show toy versions of several ‘neuromimetic’ devices that solve cognitive tasks as diverse as decision making or word sense disambiguation. The functioning of these multimodular networks can be described as dynamical systems at the level of cognitive variables.

[1]  Eduardo Mizraji,et al.  A cognitive architecture that solves a problem stated by Minsky , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Leon N. Cooper,et al.  MEMORIES AND MEMORY: A PHYSICIST'S APPROACH TO THE BRAIN , 2000 .

[3]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[5]  I. Tsuda Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[6]  Nancy Ide,et al.  Introduction to the Special Issue on Word Sense Disambiguation: The State of the Art , 1998, Comput. Linguistics.

[7]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[8]  Chris Buckley,et al.  OHSUMED: an interactive retrieval evaluation and new large test collection for research , 1994, SIGIR '94.

[9]  E. Mizraji,et al.  Multiplicative contexts in associative memories. , 1994, Bio Systems.

[10]  Juan Lin,et al.  Fuzzy Decisions in Modular Neural Networks , 2001, Int. J. Bifurc. Chaos.

[11]  Juan Lin,et al.  A dynamical approach to logical decisions , 1997, Complex..

[12]  Autores varios,et al.  Tesis de maestria , 2009 .

[13]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[14]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[15]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[16]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[17]  Ntoulas Alexandros,et al.  Understanding Search Engines : Requirements for Explaining Search Results , 2001 .

[18]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[19]  S. Pinker,et al.  Connections and symbols , 1988 .

[20]  Juan C. Valle-Lisboa,et al.  Elman topology with sigma-pi units: An application to the modeling of verbal hallucinations in schizophrenia , 2005, Neural Networks.

[21]  L. Cooper,et al.  A theory for the development of feature detecting cells in visual cortex , 1975, Biological Cybernetics.

[22]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[23]  Eduardo Mizraji,et al.  Semantic graphs and associative memories. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Santosh S. Vempala,et al.  Latent semantic indexing: a probabilistic analysis , 1998, PODS '98.

[25]  E Mizraji,et al.  Context-dependent associations in linear distributed memories. , 1989, Bulletin of mathematical biology.

[26]  M. Raichle Functional Brain Imaging and Human Brain Function , 2003, The Journal of Neuroscience.

[27]  Ray Pike,et al.  Comparison of convolution and matrix distributed memory systems for associative recall and recognition , 1984 .

[28]  Marcelo A. Montemurro,et al.  Long-range fractal correlations in literary corpora , 2002, ArXiv.

[29]  Matthew. W. Spitzer,et al.  The Mind within the Net: Models of Learning, Thinking, and Acting , 1999 .

[30]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[31]  Thomas L. Griffiths,et al.  Probabilistic Topic Models , 2007 .

[32]  Eduardo Mizraji,et al.  Neural memories and search engines , 2008, Int. J. Gen. Syst..

[33]  Nick Dean,et al.  The Mind within the Net: Manfred Spitzer: MIT Press, Cambridge, MA, 351pp., ISBN: 0-262-1904-6 , 2000, Neurocomputing.

[34]  Karl J. Friston Imaging neuroscience: principles or maps? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999 .

[36]  David Servan-Schreiber,et al.  A Neural Network Simulation of Hallucinated Voices and Associated Speech Perception Impairments in Schizophrenic Patients , 1995, Journal of Cognitive Neuroscience.

[37]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[38]  E Mizraji,et al.  Memories in context. , 1999, Bio Systems.

[39]  Michael W. Berry,et al.  Understanding search engines: mathematical modeling and text retrieval (software , 1999 .

[40]  Lillian Lee,et al.  Iterative Residual Rescaling: An Analysis and Generalization of LSI , 2001, SIGIR 2002.

[41]  Santosh S. Vempala,et al.  Latent Semantic Indexing , 2000, PODS 2000.

[42]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[43]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[44]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[45]  Leon N. Cooper,et al.  A possible organization of animal memory and learning , 1973 .

[46]  S. Schultz Principles of Neural Science, 4th ed. , 2001 .

[47]  Shravan Vasishth,et al.  Towards dynamical system models of language-related brain potentials , 2008, Cognitive Neurodynamics.

[48]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[49]  R. Hoffman,et al.  Schizophrenia as a disorder of developmentally reduced synaptic connectivity. , 2000, Archives of general psychiatry.

[50]  Alexander Graham,et al.  Kronecker Products and Matrix Calculus: With Applications , 1981 .

[51]  Tim van Gelder Dynamic Approaches to Cognition , 1999 .

[52]  Eduardo Mizraji,et al.  The dynamics of logical decisions: a neural network approach , 2002 .

[53]  Juan C. Valle-Lisboa,et al.  The uncovering of hidden structures by Latent Semantic Analysis , 2007, Inf. Sci..

[54]  Richard A. Harshman,et al.  Indexing by latent semantic indexing analysis , 1990 .

[55]  M. Markus,et al.  Fluctuation theorem for a deterministic one-particle system. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Roland Potthast,et al.  Language processing with dynamic fields , 2008, Cognitive Neurodynamics.