Multilevel image segmentation with adaptive image context based thresholding

Neural network based image segmentation techniques primarily focus on the selection of appropriate thresholding points in the image feature space. Research initiatives in this direction aim at addressing this problem of effective threshold selection for activation functions. Multilevel activation functions resort to fixed and uniform thresholding mechanisms. These functions assume homogeneity of the image information content. In this paper, we propose a collection of adaptive thresholding approaches to multilevel activation functions. The proposed thresholding mechanisms incorporate the image context information in the thresholding process. Applications of these mechanisms are demonstrated on the segmentation of real life multilevel intensity images using a self-supervised multilayer self-organizing neural network (MLSONN) and a supervised pyramidal neural network (PyraNet). We also present a bi-directional self-organizing neural network (BDSONN) architecture suitable for multilevel image segmentation. The architecture uses an embedded adaptive thresholding mechanism to a characteristic multilevel activation function. The segmentation efficiencies of the thresholding mechanisms evaluated using four unsupervised measures of merit, are reported for the three neural network architectures considered.

[1]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[2]  Michael Georgiopoulos,et al.  Classification of noisy signals using fuzzy ARTMAP neural networks , 2001, IEEE Trans. Neural Networks.

[3]  Pan Lin,et al.  Image thresholding based on spatially weighted fuzzy c-means clustering , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[4]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[5]  Hamed Hamid Muhammed,et al.  Unsupervised fuzzy clustering and image segmentation using weighted neural networks , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[6]  Hui Zhang,et al.  An entropy-based objective evaluation method for image segmentation , 2003, IS&T/SPIE Electronic Imaging.

[7]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[8]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[10]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[11]  C. L Liu,et al.  Elements of discrete mathematics (McGraw-Hill computer science series) , 1977 .

[12]  Klaus Lehnertz,et al.  A cellular neural network based method for classification of magnetic resonance images: Towards an automated detection of hippocampal sclerosis , 2008, Journal of Neuroscience Methods.

[13]  Min Tang,et al.  Edge Detection and Image Segmentation Based on Cellular Neural Network , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[14]  Ujjwal Maulik,et al.  Genetic clustering for automatic evolution of clusters and application to image classification , 2002, Pattern Recognit..

[15]  Huilong Duan,et al.  Cellular Neural Network Based Urinary Image Segmentation , 2007, Third International Conference on Natural Computation (ICNC 2007).

[16]  Shitong Wang,et al.  Advanced fuzzy cellular neural network: Application to CT liver images , 2007, Artif. Intell. Medicine.

[17]  Abdesselam Bouzerdoum,et al.  A Pyramidal Neural Network For Visual Pattern Recognition , 2007, IEEE Transactions on Neural Networks.

[18]  Mitja Lenic,et al.  Obtaining completely stable cellular neural network templates for ultrasound image segmentation , 2007 .

[19]  Jan P. Allebach,et al.  Halftoning via direct binary search using analytical and stochastic printer models , 2003, IEEE Trans. Image Process..

[20]  John M. Gauch,et al.  Image segmentation and analysis via multiscale gradient watershed hierarchies , 1999, IEEE Trans. Image Process..

[21]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[22]  Thierry Pun,et al.  A new method for grey-level picture thresholding using the entropy of the histogram , 1980 .

[23]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[24]  Li Ming,et al.  Image segmentation using multiple and partially evolved Hopfield neural networks , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[25]  C. L. Liu.  Elements of Discrete Mathematics , 1985 .

[26]  S. Pal,et al.  Segmentation of remotely sensed images with fuzzy thresholding, and quantitative evaluation , 2000 .

[27]  Beat Fasel,et al.  Head-pose invariant facial expression recognition using convolutional neural networks , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[28]  Daphna Weinshall,et al.  Subordinate class recognition using relational object models , 2006, NIPS.

[29]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[30]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[31]  Kenji Suzuki,et al.  Fast connected-component labeling based on sequential local operations in the course of forward raster scan followed by backward raster scan , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[32]  Hong Yan,et al.  A technique of three-level thresholding based on probability partition and fuzzy 3-partition , 2001, IEEE Trans. Fuzzy Syst..

[33]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[34]  A. Bouzerdoum,et al.  Texture Classification using Convolutional Neural Networks , 2006, TENCON 2006 - 2006 IEEE Region 10 Conference.

[35]  Ujjwal Maulik,et al.  A Self Supervised Bi-directional Neural Network (BDSONN) Architecture for Object Extraction Guided by Beta Activation Function and Adaptive Fuzzy Context Sensitive Thresholding , 2008 .

[36]  Onur Osman,et al.  Breast MR segmentation and lesion detection with cellular neural networks and 3D template matching , 2008, Comput. Biol. Medicine.

[37]  Martin D. Levine,et al.  Dynamic Measurement of Computer Generated Image Segmentations , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Abdesselam Bouzerdoum,et al.  Efficient training algorithms for a class of shunting inhibitory convolutional neural networks , 2005, IEEE Transactions on Neural Networks.

[39]  Shitong Wang,et al.  A new detection algorithm (NDA) based on fuzzy cellular neural networks for white blood cell detection , 2006, IEEE Transactions on Information Technology in Biomedicine.

[40]  Andrew Zisserman,et al.  Advances in Neural Information Processing Systems (NIPS) , 2007 .

[41]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[42]  Demin Wang,et al.  A multiscale gradient algorithm for image segmentation using watershelds , 1997, Pattern Recognit..

[43]  Ahmed S. Abutableb.  Automatic thresholding of gray-level pictures using two-dimensional entropy , 1989 .

[44]  Jong-Sen Lee,et al.  The use of fully polarimetric information for the fuzzy neural classification of SAR images , 2003, IEEE Trans. Geosci. Remote. Sens..

[45]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[46]  Sankar K. Pal,et al.  Self-organization for object extraction using a multilayer neural network and fuzziness measures , 1993, IEEE Trans. Fuzzy Syst..

[47]  Hugo Guterman,et al.  An adaptive neuro-fuzzy system for automatic image segmentation and edge detection , 2002, IEEE Trans. Fuzzy Syst..

[48]  Ujjwal Maulik,et al.  Binary object extraction using bi-directional self-organizing neural network (BDSONN) architecture with fuzzy context sensitive thresholding , 2007, Pattern Analysis and Applications.

[49]  Alicia Fernández,et al.  Ultrasound Image Segmentation With Shape Priors: Application to Automatic Cattle Rib-Eye Area Estimation , 2007, IEEE Transactions on Image Processing.

[50]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[51]  Christian Viard-Gaudin,et al.  A Convolutional Neural Network Approach for Objective Video Quality Assessment , 2006, IEEE Transactions on Neural Networks.

[52]  Abdesselam Bouzerdoum,et al.  A generalized feedforward neural network architecture for classification and regression , 2003, Neural Networks.

[53]  Jan-Ru Chen,et al.  Object segmentation for video coding , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[54]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[55]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[56]  Shouhong Wang,et al.  Classification with incomplete survey data: a Hopfield neural network approach , 2005, Comput. Oper. Res..

[57]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[58]  Yee-Hong Yang,et al.  Multiresolution Color Image Segmentation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  T. Ross.  Fuzzy Logic with Engineering Applications , 1994 .

[61]  David Dagan Feng,et al.  Real-Time Volume Rendering Visualization of Dual-Modality PET/CT Images With Interactive Fuzzy Thresholding Segmentation , 2007, IEEE Transactions on Information Technology in Biomedicine.

[62]  Hugh G. Lewis,et al.  Super-resolution target identification from remotely sensed images using a Hopfield neural network , 2001, IEEE Trans. Geosci. Remote. Sens..

[63]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[64]  Paola Campadelli,et al.  Quantitative evaluation of color image segmentation results , 1998, Pattern Recognit. Lett..

[65]  William E. Higgins,et al.  Symmetric region growing , 2003, IEEE Trans. Image Process..

[66]  King-Sun Fu,et al.  A survey on image segmentation , 1981, Pattern Recognit..

[67]  Yu-Tai Ching,et al.  Fuzzy Hopfield neural network with fixed weight for medical image segmentation , 2002 .

[68]  Elisabetta Binaghi,et al.  Comparison of the multilayer perceptron with neuro-fuzzy techniques in the estimation of cover class mixture in remotely sensed data , 2001, IEEE Trans. Geosci. Remote. Sens..

[69]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  George D. C. Cavalcanti,et al.  Classification and Segmentation of Visual Patterns Based on Receptive and Inhibitory Fields , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[71]  Tomer Hertz,et al.  Learning Distance Functions using Equivalence Relations , 2003, ICML.

[72]  Martin T. Hagan,et al.  Neural network design , 1995 .

[73]  M.-R. Akbarzadeh-T,et al.  Fast image segmentation using C-means based Fuzzy Hopfield neural network , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.