Extracting multi-modal dynamics of objects using RNNPB

Dynamic features play an important role in recognizing objects that have similar static features in colors and or shapes. This paper focuses on active sensing that exploits dynamic feature of an object. An extended version of the robot, Robovie-IIs, moves an object by its arm to obtain its dynamic features. Its issue is how to extract symbols from various kinds of temporal states of the object. We use the recurrent neural network with parametric bias (RNNPB) that generates self-organized nodes in the parametric bias space. The RNNPB with 42 neurons was trained with the data of sounds, trajectories, and tactile sensors generated while the robot was moving/hitting an object with its own arm. The clusters of 20 kinds of objects were successfully self-organized. The experiments with unknown (not trained) objects demonstrated that our method configured them in the PB space appropriately, which proves its generalization capability.

[1]  Yasuo Kuniyoshi,et al.  Statistical manipulation learning of unknown objects by a multi-fingered robot hand , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[2]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[3]  Taiichi Yuasa,et al.  Advanced Lisp Technology , 2002 .

[4]  Paolo Dario,et al.  Integrating visual and tactile information in disassembly tasks , 1993 .

[5]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[6]  Giorgio Metta,et al.  Better Vision through Manipulation , 2003, Adapt. Behav..

[7]  Guy J. Brown,et al.  Computational auditory scene analysis , 1994, Comput. Speech Lang..

[8]  J. Tani.  The Dynamical Systems Accounts for Phenomenology of Immanent Time: An Interpretation by Revisiting a Robotics Synthetic Study , 2004 .

[9]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[10]  Shigeki Sugano,et al.  Human-robot collaboration using behavioral primitives , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[11]  Yuki Suga,et al.  Robust modeling of dynamic environment based on robot embodiment , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Jun Tani,et al.  Self-organization of behavioral primitives as multiple attractor dynamics: A robot experiment , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[13]  Paul Fitzpatrick,et al.  Exploiting cross-modal rhythm for robot perception of objects , 2004 .

[14]  Tatsuya Kawahara,et al.  User Modeling in Spoken Dialogue Systems to Generate Flexible Guidance , 2004, User Modeling and User-Adapted Interaction.

[15]  Shigeru Kano,et al.  Utilizing the Internet , 1996 .

[16]  J. Peng,et al.  Efficient Learning and Planning Within the Dyna Framework , 1993, IEEE International Conference on Neural Networks.

[17]  Tetsuo Ono,et al.  Robovie: an interactive humanoid robot , 2001 .

[18]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[19]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[20]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.