A Fast Color Information Setup Using EP-Like PSO for Manipulator Grasping Color Objects

A fast color information setup based on evolutionary programming (EP) like particles swarm optimization (EPSO) for the manipulator control system is examined in this paper. The first step for a manipulator to grasp and place color objects into the correct location is to correctly identify the RGB or the corresponding hue, saturation, value (HSV) color model. The commonly used method to determine the thresholds of HSV range is manual tuning, but it is time-consuming to find the best boundary to segment the color image. This paper proposes a new method to learn color information, which is executed by semiautomatic learning. At first, the watershed algorithm incorporates user interactions to segment the color image and obtain the target image. Then, the comparison between the target image and the original image is utilized to build a lookup table (LUT) of color information, where three HSV thresholds are learned by PSO methods. Because the convergence speed of well-known PSO algorithms is slow and may be stuck in the local minimum, we present the EPSO method realized by applying EP to the PSO method. Moreover, a novel approach is investigated to escape the local minimum supposing the particles are stuck in the local minimum. Finally, both the numerical and experimental results demonstrate that the developed approach can not only rapidly learn the thresholds to segment a color image but can also jump out the local minimum.

[1]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[2]  Ming Xie,et al.  Hand image segmentation using color and RCE neural network , 2001, Robotics Auton. Syst..

[3]  Karl-Friedrich Kraiss,et al.  Real-Time Adaptive Colour Segmentation for the RoboCup Middle Size League , 2004, RoboCup.

[4]  Javier-Flavio Vigueras,et al.  Registration and interactive planar segmentation for stereo images of polyhedral scenes , 2010, Pattern Recognit..

[5]  Wenbing Tao,et al.  Interactively multiphase image segmentation based on variational formulation and graph cuts , 2010, Pattern Recognit..

[6]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.

[7]  W. Sardha Wijesoma,et al.  Eye-to-Hand Coordination for Vision-Guided Robot Control Applications , 1993, Int. J. Robotics Res..

[8]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[10]  Dijun Luo,et al.  An improved error-correcting output coding framework with kernel-based decoding , 2008, Neurocomputing.

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Yijia Cao Eigenvalue optimisation problems via evolutionary programming , 1997 .

[13]  Éric Marchand,et al.  Eye-in-hand/eye-to-hand cooperation for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[14]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[15]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[16]  Tharam S. Dillon,et al.  Enhancement of Speech Recognitions for Control Automation Using an Intelligent Particle Swarm Optimization , 2012, IEEE Transactions on Industrial Informatics.

[17]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[18]  Feiping Nie,et al.  Interactive Image Segmentation With Multiple Linear Reconstructions in Windows , 2011, IEEE Transactions on Multimedia.

[19]  Roberto Marcondes Cesar Junior,et al.  Interactive image segmentation by matching attributed relational graphs , 2012, Pattern Recognit..

[20]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[21]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[22]  Juing-Shian Chiou,et al.  Numerical simulation for Fuzzy-PID controllers and helping EP reproduction with PSO hybrid algorithm , 2009, Simul. Model. Pract. Theory.

[23]  Thorsten Schmitt,et al.  Fast Image Segmentation, Object Recognition and Localization in a RoboCup Scenario , 1999, RoboCup.

[24]  Hongdong Li,et al.  Interactive color image segmentation with linear programming , 2008, Machine Vision and Applications.

[25]  Peter Stone,et al.  Color learning and illumination invariance on mobile robots: A survey , 2009, Robotics Auton. Syst..

[26]  Fei Tao,et al.  Resource Service Composition and Its Optimal-Selection Based on Particle Swarm Optimization in Manufacturing Grid System , 2008, IEEE Transactions on Industrial Informatics.

[27]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[28]  Wen-Chung Chang,et al.  Precise Positioning of Binocular Eye-to-Hand Robotic Manipulators , 2007, J. Intell. Robotic Syst..

[29]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[30]  Giorgio Metta,et al.  Learning to track colored objects with log-polar vision , 2004 .

[31]  Vincent Roberge,et al.  Comparison of Parallel Genetic Algorithm and Particle Swarm Optimization for Real-Time UAV Path Planning , 2013, IEEE Transactions on Industrial Informatics.

[32]  Hung-Chih Chiu,et al.  Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions , 2011, Inf. Sci..

[33]  Ming-Feng Yeh,et al.  Grey particle swarm optimization , 2012, Appl. Soft Comput..

[34]  Helge J. Ritter,et al.  Gestalt-based action segmentation for robot task learning , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[35]  Jun Morimoto,et al.  Segmentation and learning of unknown objects through physical interaction , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[36]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[37]  Jwu-Sheng Hu,et al.  Calibration of an eye-to-hand system using a laser pointer on hand and planar constraints , 2011, 2011 IEEE International Conference on Robotics and Automation.

[38]  Kit Po Wong,et al.  Quantum-Inspired Particle Swarm Optimization for Power System Operations Considering Wind Power Uncertainty and Carbon Tax in Australia , 2012, IEEE Transactions on Industrial Informatics.

[39]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.