Real-time object segmentation for soccer robots based on depth images

Object detection and localization is a paramount important and challenging task in RoboCup MSL (Middle Size League). It has a strong constraint on real-time, as both the robot and obstacles (also robots) are moving quickly. In this paper, a real-time object segmentation approach is proposed, based on a RGB-D camera in which only the range information has been used. The method has four main steps, e.g., point cloud filtering, background points removing, clustering and object localization. Experimental results show that the proposed algorithm can effectively detect and segment objects in 3D space in real-time.

[1]  Martin Lauer,et al.  Real-time 3D Ball Recognition using Perspective and Catadioptric Cameras , 2007, EMCR.

[2]  Huimin Lu,et al.  Object Motion Estimation Based on Hybrid Vision for Soccer Robots in 3D Space , 2014, RoboCup.

[3]  Peter Stone,et al.  A Low Cost Ground Truth Detection System for RoboCup Using the Kinect , 2011, RoboCup.

[4]  Jared Glover,et al.  Bingham procrustean alignment for object detection in clutter , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Martin Lauer,et al.  3D-objecttracking with a mixed omnidirectional stereo camera system , 2011 .

[6]  Dieter Fox,et al.  Detection-based object labeling in 3D scenes , 2012, 2012 IEEE International Conference on Robotics and Automation.

[7]  Piyush Khandelwal and Peter Stone A Low Cost Ground Truth Detection System Using the Kinect , 2011 .

[8]  Stefan Schaal,et al.  Probabilistic object tracking using a range camera , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Nico Blodow,et al.  Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Hiroaki Kitano,et al.  RoboCup: A Challenge Problem for AI , 1997, AI Mag..

[11]  António J. R. Neves,et al.  Aerial Ball Perception Based on the Use of a Single Perspective Camera , 2013, EPIA.

[12]  Dong-Soo Kwon,et al.  Unsupervised object individuation from RGB-D image sequences , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Hiroaki Kitano,et al.  RoboCup: The Robot World Cup Initiative , 1997, AGENTS '97.

[14]  Ming-Ting Sun,et al.  Automatic objects segmentation with RGB-D cameras , 2014, J. Vis. Commun. Image Represent..

[15]  Vincent Lepetit,et al.  Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes , 2012, ACCV.

[16]  Eric L. Miller,et al.  Multiple Hypothesis Video Segmentation from Superpixel Flows , 2010, ECCV.

[17]  Henrik I. Christensen,et al.  RGB-D object tracking: A particle filter approach on GPU , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Dongheui Lee,et al.  Real-time and model-free object tracking using particle filter with Joint Color-Spatial Descriptor , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.