Associative processes between behavioral symbols and a large scale language model

This paper describes an novel approach towards linguistic processing for robots through integration of a motion language model and a natural language model. The motion language model works for association of words from motion symbols. The natural language model is one used for a morphological analysis, which has been developed in natural language community. The natural language model is optimized using a enormous amount of words. So this model is scalable architecture. The motion language model and the natural language model can be integrated since both models are represented graphically. The integration of the motion language model and the natural language model allows robots not only to interpret motion patterns as sentences but also to generate motions from sentences. This paper demonstrates the validity of our proposed framework even in the case that large-scale word corpus is needed processing through experiments of interpreting motion patterns as sentences and generating motion patterns from sentences.

[1]  Yoshihiko Nakamura,et al.  Statistically integrated semiotics that enables mutual inference between linguistic and behavioral symbols for humanoid robots , 2009, 2009 IEEE International Conference on Robotics and Automation.

[2]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[3]  Yuji Matsumoto,et al.  Applying Conditional Random Fields to Japanese Morphological Analysis , 2004, EMNLP.

[4]  Jun Tani,et al.  Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes , 2005, Adapt. Behav..

[5]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[6]  Jun Tani,et al.  Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Yoshihiko Nakamura,et al.  Integrating whole body motion primitives and natural language for humanoid robots , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[8]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[9]  Sadao Kurohashi,et al.  Unsupervised Topic Identification by Integrating Linguistic and Visual Information Based on Hidden Markov Models , 2006, ACL.

[10]  Katsu Yamane,et al.  Primitive communication based on motion recognition and generation with hierarchical mimesis model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  Regina Barzilay,et al.  Catching the Drift: Probabilistic Content Models, with Applications to Generation and Summarization , 2004, NAACL.

[12]  Yuji Matsumoto,et al.  HMM Parameter Learning for Japanese Morphological Analyzer , 1995, PACLIC.

[13]  Tetsuya Ogata,et al.  Two-way translation of compound sentences and arm motions by recurrent neural networks , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Mei Han,et al.  Extract highlights from baseball game video with hidden Markov models , 2002, Proceedings. International Conference on Image Processing.

[15]  Y. Nakamura,et al.  Symbolic memory for humanoid robots using hierarchical bifurcations of attractors in nonmonotonic neural networks , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.