Seeking multi-thresholds for image segmentation with Learning Automata

This paper explores the use of the Learning Automata (LA) algorithm to compute threshold selection for image segmentation as it is a critical preprocessing step for image analysis, pattern recognition and computer vision. LA is a heuristic method which is able to solve complex optimization problems with interesting results in parameter estimation. Despite other techniques commonly seek through the parameter map, LA explores in the probability space providing appropriate convergence properties and robustness. The segmentation task is therefore considered as an optimization problem and the LA is used to generate the image multi-threshold separation. In this approach, one 1-D histogram of a given image is approximated through a Gaussian mixture model whose parameters are calculated using the LA algorithm. Each Gaussian function approximating the histogram represents a pixel class and therefore a threshold point. The method shows fast convergence avoiding the typical sensitivity to initial conditions such as the Expectation- Maximization (EM) algorithm or the complex time-consuming computations commonly found in gradient methods. Experimental results demonstrate the algorithm’s ability to perform automatic multi-threshold selection and show interesting advantages as it is compared to other algorithms solving the same task.

[1]  BaştürkAlper,et al.  Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm , 2009 .

[2]  Chih-Chin Lai,et al.  A Novel Image Segmentation Approach Based on Particle Swarm Optimization , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[3]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[4]  Zhihua Zhang,et al.  EM algorithms for Gaussian mixtures with split-and-merge operation , 2003, Pattern Recognition.

[5]  Kenji Fukumizu,et al.  Adaptive natural gradient learning algorithms for various stochastic models , 2000, Neural Networks.

[6]  Wilfried Seidel,et al.  Editorial: recent developments in mixture models , 2003, Comput. Stat. Data Anal..

[7]  Timothy Gordon,et al.  Continuous action reinforcement learning applied to vehicle suspension control , 1997 .

[8]  Wesley E. Snyder,et al.  Optimal thresholding - A new approach , 1990, Pattern Recognit. Lett..

[9]  Enis Günay,et al.  Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm , 2009, Expert Syst. Appl..

[10]  Lalit Gupta,et al.  A gaussian-mixture-based image segmentation algorithm , 1998, Pattern Recognit..

[11]  Jinwen Ma,et al.  Asymptotic Convergence Rate of the EM Algorithm for Gaussian Mixtures , 2000, Neural Computation.

[12]  Matt C. Best,et al.  On-line PID tuning for engine idle-speed control using continuous action reinforcement learning automata , 2000 .

[13]  Bülent Sankur,et al.  The performance evaluation of thresholding algorithms for optical character recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[14]  Michael I. Jordan,et al.  On Convergence Properties of the EM Algorithm for Gaussian Mixtures , 1996, Neural Computation.

[15]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .

[16]  Q. H. Wu Learning coordinated control of power systems using interconnected learning automata , 1995 .

[17]  G. P. Frost,et al.  Stochastic optimisation of vehicle suspension control systems via learning automata , 1998 .

[18]  Bir Bhanu,et al.  Automatic Target Recognition: State of the Art Survey , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Hyeyoung Park,et al.  Singularity and Slow Convergence of the EM algorithm for Gaussian Mixtures , 2009, Neural Processing Letters.

[20]  Seyed-Hamid Zahiri,et al.  Learning automata based classifier , 2008, Pattern Recognit. Lett..

[21]  Xianyi Zeng,et al.  A learning automata based algorithm for optimization of continuous complex functions , 2005, Inf. Sci..

[23]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[24]  Hamid Beigy,et al.  A new continuous action-set learning automaton for function optimization , 2006, J. Frankl. Inst..

[25]  Mohamed S. Kamel,et al.  Extraction of Binary Character/Graphics Images from Grayscale Document Images , 1993, CVGIP Graph. Model. Image Process..

[26]  Mehmet Sezgin,et al.  A new dichotomization technique to multilevel thresholding devoted to inspection applications , 2000, Pattern Recognit. Lett..

[27]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[28]  Mohammad Ali Abido,et al.  A Reinforcement Learning Automata Optimization Approach for Optimum Tuning of PID Controller in AVR System , 2008, ICIC.

[29]  S. Soltani,et al.  SURVEY A Survey of Thresholding Techniques , 1988 .

[30]  Chih-Chin Lai,et al.  An optimal L-filter for reducing blocking artifacts using genetic algorithms , 2001, Signal Process..

[31]  Kaare Brandt Petersen,et al.  State-Space Models: From the EM Algorithm to a Gradient Approach , 2007, Neural Computation.

[32]  P. S. Sastry,et al.  Varieties of learning automata: an overview , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[33]  Kaddour Najim,et al.  Learning Automata: Theory and Applications , 1994 .

[34]  Timothy Gordon,et al.  Continuous action reinforcement learning automata and their application to adaptive digital filter design , 2001 .

[35]  S. M. Pandit,et al.  Automatic threshold selection based on histogram modes and a discriminant criterion , 1998, Machine Vision and Applications.

[36]  Min Wang,et al.  Seeking multi-thresholds directly from support vectors for image segmentation , 2005, Neurocomputing.

[37]  Chih-Chin Lai,et al.  A genetic algorithm for MRF-based segmentation of multi-spectral textured images , 1999, Pattern Recognit. Lett..

[38]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[39]  C. Vasseur,et al.  A strategy for controlling nonlinear systems using a learning automaton , 2000, Autom..

[40]  Anil K. Jain,et al.  Goal-Directed Evaluation of Binarization Methods , 1995, IEEE Trans. Pattern Anal. Mach. Intell..