Automated Robot Behavior Recognition

Automated recognition of the behavior of robots is increasingly needed in a variety of tasks, as we develop more autonomous robots and general information processing agents. For example, in environments with multiple autonomous robots, a robot may need to make decisions based on the behavior of the other robots. As another interesting example, an intelligent narrator agent observing a robot will need to automatically identify the robot’s behaviors. In this paper, we introduce a novel framework for using Hidden Markov Models (HMMs) to represent and recognize strategic behaviors of robotic agents. We first introduce and characterize the perceived signal in terms of behavioral-relevant state features. We then show how several HMMs capture different defined robot behaviors Finally we present the HMM-based recognition algorithm which orchestrates and selects the appropriate HMMs in real time. We use the multi-robot robotic soccer domain as the substrate of our empirical validation, both in simulation and using real robots. Robots will then adapt their behaviors as a function of the autonomously recognized behavior of the other agents, either teammates or opponents.

[1]  Tucker R. Balch,et al.  Communication in reactive multiagent robotic systems , 1995, Auton. Robots.

[2]  Kim Binsted,et al.  Character Design for Soccer Commentary , 1998, RoboCup.

[3]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[4]  Manuela M. Veloso,et al.  Reactive visual control of multiple non-holonomic robotic agents , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[5]  Mike Bowling and Peter Stone and Manuela Veloso,et al.  Predictive Memory for an Inaccessible Environment , 1996 .

[6]  Hiroaki Kitano,et al.  The RoboCup Synthetic Agent Challenge 97 , 1997, IJCAI.

[7]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[8]  浅田 稔,et al.  RoboCup-98 : Robot Soccer World Cup II , 1999 .

[9]  Maja J. Mataric,et al.  Interaction and intelligent behavior , 1994 .

[10]  Manuela M. Veloso,et al.  CMUNITED-98: RoboCup-98 Small-Robot World Champion Team , 2000, AI Mag..

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Yangsheng Xu,et al.  Online, interactive learning of gestures for human/robot interfaces , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[13]  Milind Tambe,et al.  Agent Architectures for Flexible, Practical Teamwork , 1997, AAAI/IAAI.