Issues in Assessing Performance of Social Robots

How can the performance of a social robot be measured? Are existing metrics and techniques appropriate for physically and socially embodied autonomous mobile robots? With the rapid expansion of robust robotic systems from strong industrial applications to domestic and entertainment domains which naturally involve social interactions, a requirement to gauge a system’s abilities either individually or relatively has emerged. This paper discusses the implications that arise in aiming to assess the performance of robots engaged in a degree of social interaction with people. Key-Words: social robotics, performance evaluation, anthropomorphism, artificial intelligence, robot metrics

[1]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[2]  Nicholas R. Jennings,et al.  Towards a social level characterisation of socially responsible agents , 1997, IEE Proc. Softw. Eng..

[3]  Erann Gat,et al.  Mars microrover navigation: performance evaluation and enhancement , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[4]  Brian R. Duffy,et al.  INTELLIGENT ROBOTS: THE QUESTION OF EMBODIMENT , 2000 .

[5]  Marco Colombetti,et al.  Behavior analysis and training-a methodology for behavior engineering , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Fumihito Arai,et al.  Hierarchical control architecture for Cellular Robotic System-simulations and experiments , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[7]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[8]  R. Brooks,et al.  The cog project: building a humanoid robot , 1999 .

[9]  Tim Smithers,et al.  On quantitative performance measures of robot behaviour , 1995, Robotics Auton. Syst..

[10]  Gerard Lacey,et al.  1ST International Workshop on Managing Interactions in Smart Environments (MANSE 99) , 1999 .

[11]  Luc Steels,et al.  The "Artificial Life" Route to "Artificial Intelligence": Building Situated Embodied Agents , 1995 .

[12]  F. Hara,et al.  Use of face robot for human-computer communication , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[13]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[14]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[15]  Erann Gat,et al.  Towards principled experimental study of autonomous mobile robots , 1995, Auton. Robots.

[16]  Tom Ziemke,et al.  Life, Mind, and Robots: The Ins and Outs of Embodied Cognition , 1998, Hybrid Neural Systems.

[17]  Giulio Sandini,et al.  Cellular robotics: simulation and HW implementation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[18]  Paul F. Lazarsfeld,et al.  Notes on the History of Quantification in Sociology--Trends, Sources and Problems , 1961, Isis.