Robust and accurate global vision system for real time tracking of multiple mobile robots

This paper presents a new global vision system for tracking of multiple mobile robots. To the best knowledge of the authors it outperforms all existing global vision systems with respect to measurement precision and accuracy, high speed and real time operation and reliable tracking of large (theoretically unlimited) number of robots under light intensity changes. The originality of the proposed system lies mainly in specially designed robot marks and robots' poses measuring directly in Bayer format image delivered by the camera. These two measures enable robust pose estimation of the robots with subpixel precision, while the significant simplification of the image processing algorithms ensures tracking of many robots with very high framerates. With algorithms running on a 3 GHz Athlon 64 processor 65 robots can be tracked at 80 fps. Moreover, in order to perform a thorough analysis of the system performances related to defined requirements, we propose a new experimental procedure that can serve as a benchmark for evaluation of other systems for the same purpose.

[1]  Wesley E. Snyder,et al.  Demosaicking methods for Bayer color arrays , 2002, J. Electronic Imaging.

[2]  Hideki Hashimoto.  Present state and future of Intelligent Space—Discussion on the implementation of RT in our environment— , 2006, Artificial Life and Robotics.

[3]  M. Brezak,et al.  Global Vision Based Tracking of Multiple Mobile Robots in Subpixel Precision , 2007, 2007 5th IEEE International Conference on Industrial Informatics.

[4]  Kazuyuki Morioka,et al.  Human-following robot using the particle filter in ISpace with distributed vision sensors , 2006, Artificial Life and Robotics.

[5]  Joo-Ho Lee,et al.  Intelligent Space — concept and contents , 2002, Adv. Robotics.

[6]  Gregor Klancar,et al.  Robust and efficient vision system for group of cooperating mobile robots with application to soccer robots. , 2004, ISA transactions.

[7]  S. Nayar,et al.  Polycameras: Camera Clusters for Wide Angle Imaging , 1999 .

[8]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[9]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[10]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Drago Matko,et al.  Supervised tracking of a mobile robot team , 2005 .

[12]  Karl-Friedrich Kraiss,et al.  Real-Time Adaptive Colour Segmentation for the RoboCup Middle Size League , 2004, RoboCup.

[13]  Carsten Steger,et al.  EVALUATION OF SUBPIXEL LINE AND EDGE DETECTION PRECISION AND ACCURACY , 1998 .

[14]  Rihard Karba,et al.  Wide-angle camera distortions and non-uniform illumination in mobile robot tracking , 2004, Robotics Auton. Syst..

[15]  Manuela M. Veloso,et al.  Fast and inexpensive color image segmentation for interactive robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[16]  Brett Browning,et al.  Real-time, adaptive color-based robot vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Hiroaki Kitano,et al.  RoboCup: The Robot World Cup Initiative , 1997, AGENTS '97.

[18]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[19]  David Ball,et al.  A global vision system for a robot soccer team , 2004 .

[20]  Toni Granollers,et al.  COMPUTER VISION INTERACTION FOR PEOPLE WITH SEVERE MOVEMENT RESTRICTIONS , 2006 .

[21]  Kazuyuki Morioka,et al.  Moving object tracking and an application in intelligent space , 2005 .

[22]  Takashi Minato,et al.  DISTRIBUTED VISION SYSTEM FOR ROBOT LOCALISATION IN INDOOR ENVIRONMENT , 2005 .

[23]  Sven Behnke,et al.  Robust Real Time Color Tracking , 2000, RoboCup.

[24]  Manuela M. Veloso,et al.  Fast and accurate vision-based pattern detection and identification , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Peter Stone,et al.  Structure-based color learning on a mobile robot under changing illumination , 2007, Auton. Robots.

[26]  Gianluca Antonelli,et al.  A calibration method for odometry of mobile robots based on the least-squares technique: theory and experimental validation , 2005, IEEE Transactions on Robotics.

[27]  Takashi Matsuyama,et al.  Real-time cooperative multi-target tracking by communicating active vision agents , 2005, Comput. Vis. Image Underst..

[28]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[29]  Kevin E. Spaulding,et al.  Color processing in digital cameras , 1998, IEEE Micro.

[30]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Raúl Rojas,et al.  Plug and Play: Fast Automatic Geometry and Color Calibration for Cameras Tracking Robots , 2004, RoboCup.

[32]  Frederic Devernay.  A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy , 1995 .

[33]  Matthew McNaughton,et al.  Color vision for RoboCup with fast lookup tables , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[34]  Raúl Rojas,et al.  The Color and the Shape: Automatic On-Line Color Calibration for Autonomous Robots , 2005, RoboCup.