© 2006 by Matthew R McClain

It is the goal of the Language Acquisition Group at the University of Illinois at Urbana-Champaign (LAR-UIUC) to build a robot that is able to learn language as well as humans through embodied sensori-motor interaction with the physical world. This paper proposes cognitive structures to enable an autonomous robot to learn the syntax of two-word sentences using its understanding of lexical semantics. A production rule of syntax in Chomsky Normal Form will be explicitly represented using a hidden Markov Model. Results of robotic experiments show that these models can learn representations of syntax in this form and that they can be used to produce novel sentences.

[1]  Partha Niyogi,et al.  Optimizing the mutual intelligibility of linguistic agents in a shared world , 2004, Artif. Intell..

[2]  Jun Wang,et al.  Mutual online concept learning for multiple agents , 2002, AAMAS '02.

[3]  J. Baker,et al.  The DRAGON system--An overview , 1975 .

[4]  Lalit R. Bahl,et al.  Design of a linguistic statistical decoder for the recognition of continuous speech , 1975, IEEE Trans. Inf. Theory.

[5]  J. Saffran.  The Use of Predictive Dependencies in Language Learning , 2001 .

[6]  Benjamin Kuipers,et al.  Map Learning with Uninterpreted Sensors and Effectors , 1995, Artif. Intell..

[7]  Juyang Weng,et al.  Developmental Robotics: Theory and Experiments , 2004, Int. J. Humanoid Robotics.

[8]  Norbert Wiener,et al.  Cybernetics: Control and Communication in the Animal and the Machine. , 1949 .

[9]  Stephen E. Levinson,et al.  Automatic language acquisition by an autonomous robot , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[10]  Kenneth Wexler,et al.  Formal Principles of Language Acquisition , 1980 .

[11]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[12]  G. Dell,et al.  Becoming syntactic. , 2006, Psychological review.

[13]  Noah A. Smith,et al.  Annealing Structural Bias in Multilingual Weighted Grammar Induction , 2006, ACL.

[14]  Danfeng Li.  Computational Models for Binaural Sound Source Localization and Sound Understanding , 2003 .

[15]  Lois Bloom.  Language development from two to three , 1978 .

[16]  Olaf Sporns,et al.  Neuromodulation and plasticity in an autonomous robot , 2002, Neural Networks.

[17]  Qiong Liu,et al.  Interactive and Incremental Learning via a Multisensory Mobile Robot , 2001 .

[18]  Virginia Teller.  Review of Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition by Daniel Jurafsky and James H. Martin. Prentice Hall 2000. , 2000 .

[19]  J. Baker.  Trainable grammars for speech recognition , 1979 .

[20]  Jun Tani,et al.  A Holistic Approach to Compositional Semantics: A Connectionist Model and Robot Experiments , 2003, NIPS.

[21]  J. Macnamara.  Names for Things: A Study in Human Learning , 1984 .

[22]  J. Batali.  Linguistic Evolution Through Language Acquisition: The negotiation and acquisition of recursive grammars as a result of competition among exemplars , 2002 .

[23]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[24]  Stephen E. Levinson,et al.  Manifold Learning From Time Series , 2006 .

[25]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[26]  Terry Winograd,et al.  Understanding natural language , 1974 .

[27]  Olaf Sporns,et al.  Neuromodulation in a learning robot: interactions between neural plasticity and behavior , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[28]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[29]  Pierre-Yves Oudeyer,et al.  The Playground Experiment: Task-Independent Development of a Curious Robot , 2005 .

[30]  J. Piaget,et al.  The Origins of Intelligence in Children , 1971 .

[31]  C. Breazeal.  Sociable Machines: Expressive Social Ex-change Between Humans and Robots , 2000 .

[32]  Deb K. Roy,et al.  Learning visually grounded words and syntax for a scene description task , 2002, Comput. Speech Lang..

[33]  Christopher D. Manning,et al.  The unsupervised learning of natural language structure , 2005 .

[34]  Juyang Weng,et al.  Online-learning and Attention-based Approach to Obstacle Avoidance Using a Range Finder , 2007, J. Intell. Robotic Syst..

[35]  Stephen E. Levinson,et al.  Mathematical Models for Speech Technology , 2005 .

[36]  A. B. Poritz,et al.  Linear predictive hidden Markov models and the speech signal , 1982, ICASSP.

[37]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[38]  Michael P. Kaschak,et al.  Perception of motion affects language processing , 2005, Cognition.

[39]  A. Gopnik,et al.  The Scientist in the Crib: What Early Learning Tells Us About the Mind , 2000 .

[40]  L. Bloom.  Language Development: Form and Function in Emerging Grammars , 1970 .

[41]  L. Bloom,et al.  Language development from two to three , 1995 .

[42]  Juyang Weng,et al.  Grounded auditory development by a developmental robot , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[43]  D. Roy.  Learning Visually Grounded Words and Syntax of Natural Spoken Language , 2000 .

[44]  Daniel H. Younger,et al.  Recognition and Parsing of Context-Free Languages in Time n^3 , 1967, Inf. Control..

[45]  K. Davis,et al.  Automatic Recognition of Spoken Digits , 1952 .

[46]  Noam Chomsky,et al.  On Certain Formal Properties of Grammars , 1959, Inf. Control..

[47]  W. Koenig,et al.  The Sound Spectrograph , 1946 .

[48]  Rodney A. Brooks,et al.  Twilight Zones and Cornerstones: A Gnat Robot Double Feature , 1989 .

[49]  Benjamin Kuipers,et al.  Bootstrap learning for object discovery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[50]  Roger K. Moore.  Computer Speech and Language , 1986 .

[51]  Stephen E. Levinson,et al.  PQ−Learning: An Efficient Robot Learning Method for Intelligent Behavior Acquisition , 2001 .

[52]  T. K. Vintsyuk.  Speech discrimination by dynamic programming , 1968 .

[53]  Cynthia Fisher,et al.  The role of abstract syntactic knowledge in language acquisition: a reply to Tomasello (2000) , 2002, Cognition.

[54]  Terence Parsons,et al.  Events in the Semantics of English: A Study in Subatomic Semantics , 1990 .

[55]  Richard Montague,et al.  The Proper Treatment of Quantification in Ordinary English , 1973 .

[56]  F. Jelinek.  Fast sequential decoding algorithm using a stack , 1969 .

[57]  Bruce T. Lowerre,et al.  The HARPY speech recognition system , 1976 .

[58]  Benjamin Kuipers,et al.  The Spatial Semantic Hierarchy , 2000, Artif. Intell..

[59]  Terry Winograd,et al.  Language as a Cognitive Process , 1983, CL.

[60]  R. Brown,et al.  A First Language , 1973 .

[61]  Victor Lesser,et al.  Organization of the Hearsay II speech understanding system , 1975 .

[62]  Eiichi Tanaka,et al.  Error-Correcting Parsers for Formal Languages , 1978, IEEE Transactions on Computers.

[63]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[64]  R. Brooks,et al.  The cog project: building a humanoid robot , 1999 .

[65]  Chen Yu,et al.  The emergence of links between lexical acquisition and object categorization: a computational study , 2005, Connect. Sci..

[66]  C. L. Baker,et al.  The Logical problem of language acquisition , 1984 .

[67]  Benjamin Kuipers,et al.  Bootstrap learning for place recognition , 2002, AAAI/IAAI.

[68]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[69]  B. Atal,et al.  Speech analysis and synthesis by linear prediction of the speech wave. , 1971, The Journal of the Acoustical Society of America.

[70]  Michael Gasser,et al.  The Development of Embodied Cognition: Six Lessons from Babies , 2005, Artificial Life.

[71]  Stephen E. Levinson,et al.  Hmm-Based Semantic Learning for a Mobile Robot , 2004 .

[72]  Rodney A. Brooks,et al.  Achieving Artificial Intelligence through Building Robots , 1986 .

[73]  S. Vereza.  Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[74]  A. Oppenheim,et al.  Nonlinear filtering of multiplied and convolved signals , 1968 .

[75]  Rodney A. Brooks,et al.  Prospects for Human Level Intelligence for Humanoid Robots , 1998 .