RoboCup@Home: Scientific Competition and Benchmarking for Domestic Service Robots

Being part of the RoboCup initiative, the ROBOCUP@HOME league targets the development and deployment of autonomous service and assistive robot technology being essential for future personal domestic applications. The domain of domestic service and assistive robotics implicates a wide range of possible problems. The primary reasons for this include the large amount of uncertainty in the dynamic and non-standardized environments of the real world, and the related human interaction. Furthermore, the application orientation requires a large effort towards high level integration combined with a demand for general robustness of the systems. This article details the need for interdisciplinary community effort to iteratively identify related problems, to define benchmarks, to test and, finally, to solve the problems. The concepts and the implementation of the ROBOCUP@HOME initiative as a combination of scientific exchange and competition is presented as an efficient method to accelerate and focus technological and scientific progress in the domain of domestic service robots. Finally, the progress in terms of performance increase in the benchmarks and technological advancements is evaluated and discussed.

[1]  Thomas Wisspeintner,et al.  VolksBot - A Construction Kit for Multi-Purpose Robot Prototyping , 2007 .

[2]  Herman Bruyninckx,et al.  Open robot control software: the OROCOS project , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[3]  Hiroaki Kitano,et al.  RoboCup: A Challenge Problem for AI , 1997, AI Mag..

[4]  Tucker R. Balch,et al.  Ten Years of the AAAI Mobile Robot Competition and Exhibition , 2002, AI Mag..

[5]  Javier Ruiz-del-Solar,et al.  Robust Object Recognition Using Wide Baseline Matching for RoboCup Applications , 2007, RoboCup.

[6]  Javier Ruiz-del-Solar,et al.  Face Recognition for Human-Robot Interaction Applications: A Comparative Study , 2009, RoboCup.

[7]  Marek P. Michalowski,et al.  Robots in the wild: observing human-robot social interaction outside the lab , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[8]  Stefano Carpin,et al.  USARSim: Providing a Framework for Multi-Robot Performance Evaluation | NIST , 2006 .

[9]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[10]  Luca Iocchi,et al.  A unified benchmark framework for autonomous Mobile robots and Vehicles Motion Algorithms (MoVeMA benchmarks) , 2008 .

[11]  David P. Miller,et al.  The AAAI 1999 Mobile Robot Competitions and Exhibitions , 2000, AI Mag..

[12]  J. A. Valencia,et al.  Evaluation of navigation of an autonomous mobile robot , 2007 .

[13]  Javier Ruiz-del-Solar,et al.  Real-Time Hand Gesture Detection and Recognition Using Boosted Classifiers and Active Learning , 2007, PSIVT.

[14]  Alfredo Weitzenfeld,et al.  The Use of Scripts Based on Conceptual Dependency Primitives for the Operation of Service Mobile Robots , 2009, RoboCup.

[15]  Giulio Fontana,et al.  The RAWSEEDS Proposal for Representation-Independet Benchmarking of SLAM , 2008 .

[16]  Alexander Ferrein,et al.  Football is coming home , 2006, PCAR '06.

[17]  M. Matarić,et al.  Benchmarks for evaluating socially assistive robotics , 2007 .

[18]  Thomas Deselaers,et al.  Randomized trees for real-time one-step face detection and recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[19]  Thomas Wisspeintner,et al.  RoboCup X: A Proposal for a New League Where RoboCup Goes Real World , 2005, RoboCup.

[20]  Jean Scholtz,et al.  Using competitions to study human-robot interaction in urban search and rescue , 2005, INTR.

[21]  Takayuki Kanda,et al.  What is a Human? - Toward Psychological Benchmarks in the Field of Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[22]  Sebastian Thrun,et al.  Perspectives on standardization in mobile robot programming: the Carnegie Mellon Navigation (CARMEN) Toolkit , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[23]  Roland Siegwart,et al.  International Contest for Cleaning Robots: Fun Event or a First Step towards Benchmarking Service Robots , 2003, FSR.

[24]  Jean Scholtz,et al.  Beyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition , 2004, Hum. Comput. Interact..

[25]  Javier Ruiz-del-Solar.  Personal Robots as Ubiquitous-Multimedial-Mobile Web Interfaces , 2007, 2007 Latin American Web Conference (LA-WEB 2007).

[26]  Jacky Baltes,et al.  A benchmark suite for mobile robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[27]  Hiroaki Kitano,et al.  RoboCup Rescue A Grand Challenge for Multiagent and Intelligent Systems , 2001 .

[28]  Vladimir J. Lumelsky,et al.  Final report for the DARPA/NSF interdisciplinary study on human-robot interaction , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Thomas Wisspeintner,et al.  RoboCup@Home: Creating and Benchmarking Tomorrows Service Robot Applications , 2007 .

[30]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[31]  V. Pisarevsky,et al.  Intel's Computer Vision Library: applications in calibration, stereo segmentation, tracking, gesture, face and object recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[32]  Peter Stone,et al.  Domestic Interaction on a Segway Base , 2008, RoboCup.