Integrated Natural Spoken Dialogue System of Jijo-2 Mobile Robot for Office Services

Our Jijo-2 robot, whose purpose is to provide office services, such as answering queries about people's location, route guidance, and delivery tasks, is expected to conduct natural spoken conversation with the office dwellers. This paper describes dialogue technologies implemented on our Jijo-2 office robot, i.e. noise-free voice acquisition system by a microphone array, inference of under-specified referents and zero pronouns using the attentional states, and context-sensitive construction of semantic frames from fragmented utterances. The behavior of the dialogue system integrated with the sound source detection, navigation, and face recognition vision is demonstrated in real dialogue examples in a real office.

[1]  Ian Horswill,et al.  Integrating vision and natural language without central models , 1995 .

[2]  Marilyn A. Walker,et al.  Japanese Discourse and the Process of Centering , 1994, Comput. Linguistics.

[3]  Kazuyo Tanaka,et al.  System Design, Data Collection and Evaluation of a Speech Dialogue System (Special Issue on Speech and Discourse Processing in Dialogue Systems) , 1993 .

[4]  Nils J. Nilsson,et al.  A mobius automation: an application of artificial intelligence techniques , 1969, IJCAI 1969.

[5]  David G. Long,et al.  Array signal processing , 1985, IEEE Trans. Acoust. Speech Signal Process..

[6]  Mark C. Torrance,et al.  Natural communication with robots , 1994 .

[7]  Takio Kurita,et al.  Scale and Rotation Invariant Recognition Method Using Higher-Order Local Autocorrelation Features of Log-Polar Image , 1998, ACCV.

[8]  Niels Ole Bernsen,et al.  What Should Your Speech System Say? , 1997, Computer.

[9]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[10]  Terry Winograd,et al.  Understanding natural language , 1974 .

[11]  Nils J. Nilsson,et al.  A Mobile Automaton: An Application of Artificial Intelligence Techniques , 1969, IJCAI.

[12]  Keiichiro Hoashi,et al.  Humanoid robot-development of an information assistant robot Hadaly , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[13]  John Fry,et al.  Natural dialogue with the Jijo-2 office robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[14]  Hideki Asoh,et al.  An event-driven architecture for controlling behaviors of the office conversant mobile robot, Jijo-2 , 1997, Proceedings of International Conference on Robotics and Automation.

[15]  Akikazu Takeuchi,et al.  Social Interaction: Multimodal Conversation with Social Agents , 1994, AAAI.

[16]  Kazuyo Tanaka,et al.  Active Agent Oriented Multimodal Interface System , 1995, IJCAI.

[17]  Satoru Hayamizu,et al.  Combining probabilistic map and dialog for robust life-long office navigation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[18]  C. Burrus,et al.  Array Signal Processing , 1989 .