The paper describes emergent verbal behaviour that arises when speech components are added to a robotics simulator. In the existing simulator the robot performs its activities silently. When speech synthesis is added, the first level of emergent verbal behaviour is that the robot produces spoken monologues giving a stream of simple explanations of its movements. When speech recognition is added, human-robot interaction can be initiated by the human, using voice commands to direct the robot's movements. In addition, cooperative verbal behaviour emerges when the robot modifies its own verbal behaviour in response to being asked by the human to talk less or more. The robotics framework supports different behavioural paradigms, including finite state machines, reinforcement learning and fuzzy decisions. By combining finite state machines with the speech interface, spoken dialogue systems based on state transitions can be implemented. These dialogue systems exemplify emergent verbal behaviour that is robot-initiated: the robot asks appropriate questions in order to achieve the dialogue goal. The paper mentions current work on using Wikipedia as a knowledge base for open-domain dialogues, and suggests promising ideas for topic-tracking and robot-initiated conversational topics.
[1]
Kristiina Jokinen,et al.
Adding Speech to a Robotics Simulator
,
2011
.
[2]
M S Magnusson,et al.
Discovering hidden time patterns in behavior: T-patterns and their detection
,
2000,
Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.
[3]
Stephanie Seneff,et al.
Spoken Dialogue Systems
,
2008
.
[4]
Michael F. McTear,et al.
Modelling spoken dialogues with state transition diagrams: experiences with the CSLU toolkit
,
1998,
ICSLP.
[5]
Wells Goodrich,et al.
Face‐to‐Face Interaction: Research, Methods, and Theory
,
1979
.
[6]
Illah R. Nourbakhsh,et al.
A survey of socially interactive robots
,
2003,
Robotics Auton. Syst..
[7]
A. Kendon.
Conducting Interaction: Patterns of Behavior in Focused Encounters
,
1990
.
[8]
Kristiina Jokinen,et al.
Adaptivity and Response Generation in a Spoken Dialogue System
,
2003
.
[9]
Holly A. Yanco,et al.
The Pyro Toolkit for AI and Robotics
,
2006,
AI Mag..
[10]
Kristiina Jokinen,et al.
Constructive Dialogue Modelling - Speech Interaction and Rational Agents
,
2009,
Wiley series in agent technology.