Gesture segmentation based on a two-phase estimation of distribution algorithm

A multi-objective optimization model for the problem of gesture segmentation is formulated, and a method of solving the model based on a two-phase estimation of distribution algorithm is presented. When building the model, the positions of a series of pixels are taken as the decision variable, and the differences between the colors of pixels and those of a hand are taken as objective functions. A method of gesture segmentation based on a two-phase estimation of distribution algorithm is proposed according to the correlation among the positions of pixels. The method divides the solution of the problem based on evolutionary optimization into two phases, and uses different estimation of distribution algorithms in different phases. In the first phase, the probability model of candidates is formulated by a number of intervals given the fact that the positions of hand pixels distribute in several intervals. In the second phase, the probability model of candidates is built through a series of segments since the positions of hand pixels further distribute around curves. A series of pixels constituting a hand region are obtained based on sampling by the above probability models. The proposed method is applied to 2515 problems of gesture segmentation, and is compared with the existing methods. The experimental results demonstrate the effectiveness of the proposed method.

[1]  Qingfu Zhang,et al.  An Estimation of Distribution Algorithm With Cheap and Expensive Local Search Methods , 2015, IEEE Transactions on Evolutionary Computation.

[2]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[3]  Ling Wang,et al.  An estimation of distribution algorithm and new computational results for the stochastic resource-constrained project scheduling problem , 2015, Flexible Services and Manufacturing Journal.

[4]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[5]  Marzieh Dadvar,et al.  Skin Color Segmentation in RGB Color Space by Adaptive Network Based Fuzzy Inference System (ANFIS) , 2015 .

[6]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yaochu Jin,et al.  Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise , 2015, IEEE Transactions on Cybernetics.

[8]  S N Karishma,et al.  Fusion of Skin Color Detection and Background Subtraction for Hand Gesture Segmentation , 2014 .

[9]  A. Gupta,et al.  Robust skin segmentation using color space switching , 2015, Pattern Recognition and Image Analysis.

[10]  Sanghamitra Bandyopadhyay,et al.  An Algorithm for Many-Objective Optimization With Reduced Objective Computations: A Study in Differential Evolution , 2015, IEEE Transactions on Evolutionary Computation.

[11]  Jing Zhang,et al.  Real-Time Hand Gesture Recognition Using Finger Segmentation , 2014, TheScientificWorldJournal.

[12]  Carlos A. Coello Coello,et al.  A comparative study of variation operators used for evolutionary multi-objective optimization , 2014, Inf. Sci..

[13]  Omar S. Soliman,et al.  Niching Estimation of Distribution Algorithm Based on Fuzzy Clustering for Multi-mode Resource-constrained Project Scheduling Problems , 2014 .

[14]  C. Duan.  A Survey of Skin Color Detection , 2006 .

[15]  Jonathan M. Garibaldi,et al.  A multi-cycled sequential memetic computing approach for constrained optimisation , 2016, Inf. Sci..

[16]  Shengyao Wang,et al.  An Estimation of Distribution Algorithm-Based Memetic Algorithm for the Distributed Assembly Permutation Flow-Shop Scheduling Problem , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Sayed Masoud Sayedi,et al.  Color-based skin segmentation in videos using a multi-step spatial method , 2016, Multimedia Tools and Applications.

[18]  Peter J. Fleming,et al.  Generalized decomposition and cross entropy methods for many-objective optimization , 2014, Inf. Sci..

[19]  Alexander Mendiburu,et al.  A Distance-Based Ranking Model Estimation of Distribution Algorithm for the Flowshop Scheduling Problem , 2014, IEEE Transactions on Evolutionary Computation.

[20]  Xin Yao,et al.  Estimation of the Distribution Algorithm With a Stochastic Local Search for Uncertain Capacitated Arc Routing Problems , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[22]  Zhongping Wan,et al.  Estimation of distribution algorithm for a class of nonlinear bilevel programming problems , 2014, Inf. Sci..

[23]  Feng Zou,et al.  Multiobjective Memetic Estimation of Distribution Algorithm Based on an Incremental Tournament Local Searcher , 2014, TheScientificWorldJournal.

[24]  Yang Luo,et al.  A Method of Gesture Segmentation Based on Skin Color and Background Difference Method , 2013 .

[25]  Concha Bielza,et al.  Multiobjective Estimation of Distribution Algorithm Based on Joint Modeling of Objectives and Variables , 2014, IEEE Transactions on Evolutionary Computation.

[26]  Huaping Chen,et al.  A Boltzmann-Based Estimation of Distribution Algorithm for a General Resource Scheduling Model , 2015, IEEE Transactions on Evolutionary Computation.

[27]  Wei Zeng,et al.  A modified EM algorithm for hand gesture segmentation in RGB-D data , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[28]  Min Liu,et al.  Solving system-level synthesis problem by a multi-objective estimation of distribution algorithm , 2014, Expert Syst. Appl..

[29]  Ling Shao,et al.  Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Lu Lv,et al.  Hand Gesture Segmentation Method Based on YCbCr Color Space and K-Means Clustering , 2015 .

[31]  Tamás Szirányi,et al.  User-adaptive hand gesture recognition system with interactive training , 2005, Image Vis. Comput..

[32]  Marco Ceccarelli,et al.  Structure-control design of a mechatronic system with parallelogram mechanism using an estimation of distribution algorithm , 2016 .

[33]  Ricardo Pérez-Rodríguez,et al.  A continuous estimation of distribution algorithm for the online order-batching problem , 2015 .

[34]  Yaochu Jin,et al.  Pareto-based Multi-Objective Machine Learning , 2007, 7th International Conference on Hybrid Intelligent Systems (HIS 2007).

[35]  Alexander Mendiburu,et al.  Distributed Estimation of Distribution Algorithms for continuous optimization: How does the exchanged information influence their behavior? , 2014, Inf. Sci..

[36]  Xianbo He,et al.  Skin Region Segmentation based on the Average Preprocessed Image of Multicolor Face Image Sequence , 2014 .

[37]  Tansel Özyer,et al.  Boosting real-time recognition of hand posture and gesture for virtual mouse operations with segmentation , 2015, Applied Intelligence.

[38]  Ke Tang,et al.  Improving Estimation of Distribution Algorithm on Multimodal Problems by Detecting Promising Areas , 2015, IEEE Transactions on Cybernetics.

[39]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[40]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[41]  Shengchao Zhou,et al.  Minimizing makespan in a no-wait flowshop with two batch processing machines using estimation of distribution algorithm , 2016 .

[42]  Fuqing Zhao,et al.  A hybrid differential evolution and estimation of distribution algorithm based on neighbourhood search for job shop scheduling problems , 2016 .

[43]  Napoleon H. Reyes,et al.  A New 2D Static Hand Gesture Colour Image Dataset for ASL Gestures , 2011 .

[44]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[45]  B. D. Avinash,et al.  Color hand gesture segmentation for images with complex background , 2013, 2013 International Conference on Circuits, Power and Computing Technologies (ICCPCT).

[46]  Bernhard Sendhoff,et al.  Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[47]  Tohru Ifukube,et al.  [Foreword] Welcome to the Special Section on Technology for Information and Content Accessibility , 2017 .