Knowledge of Language and Knowledge Science

Knowledge of language and principles of naturalistic learning are rarely used in information extraction systems. The main challenge for these systems is to provide conceptually relevant information while minimizing computational costs. This paper argues that knowledge of language and principles of naturalistic learning may enhance the capacity of intelligent systems to process linguistic expressions and simulate humans’ capacity for language. We contrast humans’ genetic endowment to genetic programming, as well as naturalistic learning to Reinforcement Learning used to extract information form texts. We point to limits of machine learning methodology and we draw consequences for knowledge science.

[1]  J. Fodor,et al.  What Darwin Got Wrong , 2010 .

[2]  Noam Chomsky Of Minds and Language , 2007, Biolinguistics.

[3]  Peter Nordin,et al.  Enhancing information retrieval by automatic acquisition of textual relations using genetic programming , 2000, IUI '00.

[4]  Noam Chomsky Three Factors in Language Design , 2005, Linguistic Inquiry.

[5]  Anna Maria Di Sciullo,et al.  The Biological Nature of Human Language , 2010 .

[6]  Anna Maria Di Sciullo Asymmetry Based Parsing and Semantic Compositionality , 2017, SoMeT.

[7]  Noam Chomsky,et al.  Language and problems of knowledge : the Managua lectures , 1990 .

[8]  Sandiway Fong Computation with probes and goals , 2005 .

[9]  T. SHALLICE,et al.  Learning and Memory , 1970, Nature.

[10]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  S. Freytag Knowledge Of Language Its Nature Origin And Use , 2016 .

[13]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[14]  Charles Darwin,et al.  On the origin of species, 1859 , 1988 .

[15]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[16]  Shigeru Miyagawa,et al.  The precedence of syntax in the rapid emergence of human language in evolution as defined by the integration hypothesis , 2015, Front. Psychol..

[17]  Anna Maria Di Sciullo,et al.  Asymmetry Theory and Asymmetry Based Parsing , 2015, SoMeT.

[18]  J. Michael Verbal behavior. , 1984, Journal of the experimental analysis of behavior.

[19]  A. Belletti,et al.  Relativized relatives: Types of intervention in the acquisition of A-bar dependencies , 2009 .

[20]  A. Monaco,et al.  A forkhead-domain gene is mutated in a severe speech and language disorder , 2001, Nature.

[21]  Edward P. Stabler,et al.  Two Models of Minimalist, Incremental Syntactic Analysis , 2013, Top. Cogn. Sci..

[22]  Heeyoung Lee,et al.  Joint Entity and Event Coreference Resolution across Documents , 2012, EMNLP.

[23]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[24]  P. Bork,et al.  Literature mining for the biologist: from information retrieval to biological discovery , 2006, Nature Reviews Genetics.

[25]  Dan Klein,et al.  A Joint Model for Entity Analysis: Coreference, Typing, and Linking , 2014, TACL.

[26]  Charles L. A. Clarke,et al.  Information Retrieval - Implementing and Evaluating Search Engines , 2010 .

[27]  Oren Etzioni,et al.  Open Information Extraction from the Web , 2007, CACM.

[28]  Brij Masand,et al.  Optimizing confidence of text classification by evolution of symbolic expressions , 1994 .

[29]  Ronen Feldman,et al.  The Data Mining and Knowledge Discovery Handbook , 2005 .

[30]  Anna Maria Di Sciullo,et al.  Asymmetric Agreement in Pronominal Anaphora , 2012, SoMeT.

[31]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[32]  Sandiway Fong,et al.  Morpho-syntax parsing , 2005 .

[33]  Angela D. Friederici,et al.  An fMRI study dissociating distance measures computed by Broca's area in movement processing: clause boundary vs. identity , 2015, Front. Psychol..

[34]  N. Pierce Origin of Species , 1914, Nature.

[35]  Denise Brandão de Oliveira e Britto,et al.  The faculty of language , 2007 .

[36]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[37]  Alex A. Freitas,et al.  A Genetic Programming Framework for Two Data Mining Tasks: Classification and Generalized Rule Induction , 1997 .

[38]  Jun Zhao,et al.  Collective entity linking in web text: a graph-based method , 2011, SIGIR.

[39]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[40]  E. Lenneberg On explaining language. , 1969, Science.

[41]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[42]  Anna Maria Di Sciullo,et al.  Parsing Asymmetries , 2000, Natural Language Processing.

[43]  David Yarowsky,et al.  Multi-Field Information Extraction and Cross-Document Fusion , 2005, ACL.

[44]  Regina Barzilay,et al.  Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning , 2016, EMNLP.

[45]  C. Gallistel The Replacement of General-Purpose Learning Models with Adaptively Specialized Learning Modules , 2000 .

[46]  Sanda M. Harabagiu,et al.  Unsupervised Event Coreference Resolution , 2014, Computational Linguistics.

[47]  Aravind K. Joshi,et al.  Tree Adjunct Grammars , 1975, J. Comput. Syst. Sci..

[48]  Alaa A. Kharbouch,et al.  Three models for the description of language , 1956, IRE Trans. Inf. Theory.

[49]  K. Maccorquodale ON CHOMSKY'S REVIEW OF SKINNER'S VERBAL BEHAVIOR , 1970 .

[50]  Anna Maria Di Sciullo UG and External Systems: Language, brain and computation , 2005 .