Information retrieval with semantic memory model

Psycholinguistic theories of semantic memory form the basis of understanding of natural language concepts. These theories are used here as an inspiration for implementing a computational model of semantic memory in the form of semantic network. Combining this network with a vector-based object-relation-feature value representation of concepts that includes also weights for confidence and support, allows for recognition of concepts by referring to their features, enabling a semantic search algorithm. This algorithm has been used for word games, in particular the 20-question game in which the program tries to guess a concept that a human player thinks about. The game facilitates lexical knowledge validation and acquisition through the interaction with humans via supervised dialog templates. The elementary linguistic competencies of the proposed model have been evaluated assessing how well it can represent the meaning of linguistic concepts. To study properties of information retrieval based on this type of semantic representation in contexts derived from on-going dialogs experiments in limited domains have been performed. Several similarity measures have been used to compare the completeness of knowledge retrieved automatically and corrected through active dialogs to a ''golden standard''. Comparison of semantic search with human performance has been made in a series of 20-question games. On average results achieved by human players were better than those obtained by semantic search, but not by a wide margin.

[1]  E. Tulving,et al.  Organization of memory. , 1973 .

[2]  Shamik Sural,et al.  Similarity between Euclidean and cosine angle distance for nearest neighbor queries , 2004, SAC '04.

[3]  Wlodzislaw Duch,et al.  Unambiguous Concept Mapping in Radiology Reports: Graphs of Consistent Concepts , 2006, AMIA.

[4]  P. König,et al.  Testing the theory of embodied cognition with subliminal words , 2010, Cognition.

[5]  T. McNamara Semantic Priming: Perspectives from Memory and Word Recognition , 2005 .

[6]  John F. Sowa,et al.  Principles of semantic networks , 1991 .

[7]  Stuart M. Keeley,et al.  Asking the Right Questions , 1981 .

[8]  Friedemann Pulvermüller,et al.  The Neuroscience of Language: On Brain Circuits of Words and Serial Order , 2003 .

[9]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[10]  Donald G. MacKay,et al.  On the tip of the tongue: What causes word finding failures in young and older adults? , 1991 .

[11]  R. E. Warren,et al.  Time and the spread of activation in memory. , 1977 .

[12]  Nicola Guarino,et al.  Formal ontology, conceptual analysis and knowledge representation , 1995, Int. J. Hum. Comput. Stud..

[13]  Wlodzislaw Duch,et al.  Neurolinguistic approach to natural language processing with applications to medical text analysis , 2008, Neural Networks.

[14]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[15]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[16]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[17]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[18]  Lance J. Rips,et al.  Structure and process in semantic memory: A featural model for semantic decisions. , 1974 .

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  S. Lamb Pathways of the brain , 1999 .

[21]  G. Leech,et al.  Word Frequencies in Written and Spoken English: based on the British National Corpus , 2001 .

[22]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[23]  Steffen Staab,et al.  International Handbooks on Information Systems , 2013 .

[24]  Arul Menezes,et al.  MindNet: An Automatically-Created Lexical Resource , 2005, HLT.

[25]  Włodzisław Duch,et al.  Challenges for Computational Intelligence , 2007, Studies in Computational Intelligence.

[26]  Jerome A. Feldman,et al.  From Molecule to Metaphor - A Neural Theory of Language , 2006 .

[27]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[28]  O. Silva Pathways of the brain: The neurocognitive basis of language , 2000 .

[29]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[30]  Wlodzislaw Duch,et al.  What Is Computational Intelligence and Where Is It Going? , 2007, Challenges for Computational Intelligence.

[31]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[32]  Peter Szolovits,et al.  What Is a Knowledge Representation? , 1993, AI Mag..

[33]  Sharon C. Lyter,et al.  Diagnostic and Statistical Manual of Mental Disorders: Making it Work for Social Work , 2012 .

[34]  Julian Szymanski,et al.  Text Categorization with Semantic Commonsense Knowledge: First Results , 2007, ICONIP.

[35]  Peter Voss,et al.  Essentials of General Intelligence: The Direct Path to Artificial General Intelligence , 2007, Artificial General Intelligence.

[36]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[37]  C. K. Ogden,et al.  The Meaning of Meaning , 1923 .

[38]  Włodzisław Duch,et al.  Towards Avatars with Artificial Minds: Role of Semantic Memory , 2007 .

[39]  Erik C. W. Krabbe,et al.  Representation and Reasoning , 1988 .

[40]  K. Forster Category size effects revisited: Frequency and masked priming effects in semantic categorization , 2004, Brain and Language.

[41]  Jeffrey M. Zacks,et al.  Reading Stories Activates Neural Representations of Visual and Motor Experiences , 2009, Psychological science.

[42]  J. Cullen,et al.  The Knowledge Acquisition Bottleneck: Time for Reassessment? , 1988 .

[43]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[44]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[45]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[46]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[47]  Włodzisław Duch,et al.  Semantic Web: Asking the Right Questions , 2008 .