Global Image Thresholding Adaptive Neuro-Fuzzy Inference System Trained with Fuzzy Inclusion and Entropy Measures

Thresholding algorithms segment an image into two parts (foreground and background) by producing a binary version of our initial input. It is a complex procedure (due to the distinctive characteristics of each image) which often constitutes the initial step of other image processing or computer vision applications. Global techniques calculate a single threshold for the whole image while local techniques calculate a different threshold for each pixel based on specific attributes of its local area. In some of our previous work, we introduced some specific fuzzy inclusion and entropy measures which we efficiently managed to use on both global and local thresholding. The general method which we presented was an open and adaptable procedure, it was free of sensitivity or bias parameters and it involved image classification, mathematical functions, a fuzzy symmetrical triangular number and some criteria of choosing between two possible thresholds. Here, we continue this research and try to avoid all these by automatically connecting our measures with the wanted threshold using some Artificial Neural Network (ANN). Using an ANN in image segmentation is not uncommon especially in the domain of medical images. However, our proposition involves the use of an Adaptive Neuro-Fuzzy Inference System (ANFIS) which means that all we need is a proper database. It is a simple and immediate method which could provide researchers with an alternative approach to the thresholding problem considering that they probably have at their disposal some appropriate and specialized data.

[1]  Minxia Luo,et al.  A Novel Similarity Measure for Interval-Valued Intuitionistic Fuzzy Sets and Its Applications , 2018, Symmetry.

[2]  Shyi-Chyi Cheng,et al.  A Neural Network Implementation of the Moment-Preserving Technique and Its Application to Thresholding , 1993, IEEE Trans. Computers.

[3]  Basil K. Papadopoulos,et al.  Producing fuzzy inclusion and entropy measures and their application on global image thresholding , 2017, Evolving Systems.

[4]  Ashutosh Saxena,et al.  Cascaded Classification Models: Combining Models for Holistic Scene Understanding , 2008, NIPS.

[5]  S. D. Yanowitz,et al.  A new method for image segmentation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[6]  Hamid R. Tizhoosh,et al.  Image thresholding using neural network , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[7]  C. V. Jawahar,et al.  Investigations on fuzzy thresholding based on fuzzy clustering , 1997, Pattern Recognit..

[8]  Saeed Shariati,et al.  Comparison of anfis Neural Network with several other ANNs and Support Vector Machine for diagnosing hepatitis and thyroid diseases , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[9]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[10]  Anton Konev,et al.  A Fuzzy Classifier with Feature Selection Based on the Gravitational Search Algorithm , 2018, Symmetry.

[11]  Basil K. Papadopoulos,et al.  Local thresholding of degraded or unevenly illuminated documents using fuzzy inclusion and entropy measures , 2019, Evol. Syst..

[12]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[13]  Basil K. Papadopoulos,et al.  Producing Fuzzy Inclusion and Entropy Measures , 2015 .

[14]  Igor N. Rozenberg,et al.  Ranking probability measures by inclusion indices in the case of unknown utility function , 2014, Fuzzy Optim. Decis. Mak..

[15]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[16]  Mohammad Sadegh Es-haghi,et al.  Design of a Hybrid ANFIS–PSO Model to Estimate Sediment Transport in Open Channels , 2018, Iranian Journal of Science and Technology, Transactions of Civil Engineering.

[17]  Heng-Da Cheng,et al.  Fuzzy partition of two-dimensional histogram and its application to thresholding , 1999, Pattern Recognit..

[18]  Virginia R. Young,et al.  Fuzzy subsethood , 1996, Fuzzy Sets Syst..

[19]  Ramón Fuentes-González,et al.  Inclusion grade and fuzzy implication operators , 2000, Fuzzy Sets Syst..

[20]  Jinhai Cai,et al.  A new thresholding algorithm based on all-pole model , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  Chun-hung Li,et al.  Minimum cross entropy thresholding , 1993, Pattern Recognit..

[22]  Azedine Boulmakoul,et al.  An original approach to ranking fuzzy numbers by inclusion index and Bitset Encoding , 2017, Fuzzy Optim. Decis. Mak..

[23]  Valerie V. Cross Relating Fuzzy Set Similarity Measures , 2017, NAFIPS.

[24]  Wen-Nung Lie,et al.  An efficient threshold-evaluation algorithm for image segmentation based on spatial graylevel co-occurrences , 1993, Signal Process..

[25]  Azriel Rosenfeld,et al.  Image enhancement and thresholding by optimization of fuzzy compactness , 1988, Pattern Recognit. Lett..

[26]  Azriel Rosenfeld,et al.  Histogram concavity analysis as an aid in threshold selection , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  Sawal Hamid Md Ali,et al.  Calibration Model of a Low-Cost Air Quality Sensor Using an Adaptive Neuro-Fuzzy Inference System , 2018, Sensors.

[28]  Aly A. Farag,et al.  Two-stage neural network for volume segmentation of medical images , 1997, Pattern Recognit. Lett..

[29]  B. Kosko Fuzzy Thinking: The New Science of Fuzzy Logic , 1993 .

[30]  Jian-Ping Li,et al.  Medical image De-noising schemes using wavelet transform with fixed form thresholding , 2014, 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing(ICCWAMTIP).

[31]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Wen-Hsiang Tsai,et al.  Moment-preserving thresolding: A new approach , 1985, Comput. Vis. Graph. Image Process..

[33]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  Edward J. Delp,et al.  Transactions Papers Moment Preserving Quantization , 1991 .

[35]  R. Kirby,et al.  A Note on the Use of (Gray Level, Local Average Gray Level) Space as an Aid in Threshold Selection. , 1979 .

[36]  Galina L. Demidova,et al.  Application of adaptive Neuro Fuzzy Inference System (ANFIS) controller in servodrive with multi-mass object , 2018, 2018 25th International Workshop on Electric Drives: Optimization in Control of Electric Drives (IWED).

[37]  C. K. Leung,et al.  Maximum a posteriori spatial probability segmentation , 1997 .

[38]  Nial Friel,et al.  A new thresholding technique based on random sets , 1999, Pattern Recognit..

[39]  Michael A. Wirth,et al.  Worn-out Images in Testing Image Processing Algorithms , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[40]  Jean-Christophe Olivo-Marin,et al.  Automatic Threshold Selection Using the Wavelet Transform , 1994, CVGIP Graph. Model. Image Process..

[41]  A. D. Brink Thresholding of digital images using two-dimensional entropies , 1992, Pattern Recognit..

[42]  Lawrence O'Gorman Binarization and Multithresholding of Document Images Using Connectivity , 1994, CVGIP Graph. Model. Image Process..

[43]  Pasi Luukka,et al.  Feature selection using fuzzy entropy measures with similarity classifier , 2011, Expert Syst. Appl..

[44]  Azriel Rosenfeld,et al.  Histogram modification for threshold selection , 1977 .

[45]  Chris Cornelis,et al.  Sinha-Dougherty approach to the fuzzification of set inclusion revisited , 2003, Fuzzy Sets Syst..

[46]  Thanh-Phong Dao,et al.  An effective approach of adaptive neuro-fuzzy inference system-integrated teaching learning-based optimization for use in machining optimization of S45C CNC turning , 2018, Optimization and Engineering.

[47]  Ahmed S. Abutableb Automatic thresholding of gray-level pictures using two-dimensional entropy , 1989 .

[48]  C. A. Murthy,et al.  Fuzzy thresholding: mathematical framework, bound functions and weighted moving average technique , 1990, Pattern Recognit. Lett..

[49]  A. D. Brink,et al.  Minimum cross-entropy threshold selection , 1996, Pattern Recognit..

[50]  Bülent Sankur,et al.  Image segmentation by relaxation using constraint satisfaction neural network , 2002, Image Vis. Comput..

[51]  Wen-Hsiang Tsai,et al.  Moment-preserving thresholding: a new approach , 1995 .

[52]  Wei Chen,et al.  Applying population-based evolutionary algorithms and a neuro-fuzzy system for modeling landslide susceptibility , 2019, CATENA.

[53]  Azriel Rosenfeld,et al.  Threshold Evaluation Techniques , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[54]  Barbara Vantaggi,et al.  Fuzzy inclusion and similarity through coherent conditional probability , 2009, Fuzzy Sets Syst..

[55]  S. Meikandasivam,et al.  Load Flattening and Voltage Regulation Using Plug-In Electric Vehicle's Storage Capacity With Vehicle Prioritization Using ANFIS , 2020, IEEE Transactions on Sustainable Energy.

[56]  Mark J. Carlotto,et al.  Histogram Analysis Using a Scale-Space Approach , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Shyang Chang,et al.  A new criterion for automatic multilevel thresholding , 1995, IEEE Trans. Image Process..

[58]  Wen-Chiao Cheng,et al.  Conditional Fuzzy Entropy of Maps in Fuzzy Systems , 2011, Theory of Computing Systems.

[59]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[60]  Peter Sussner,et al.  Classification of Fuzzy Mathematical Morphologies Based on Concepts of Inclusion Measure and Duality , 2008, Journal of Mathematical Imaging and Vision.

[61]  A. Rosenfeld,et al.  A Note on the Use of Second-Order Gray Level Statistics for Threshold Selection. , 1977 .

[62]  L. F. Hulianytskyi,et al.  Automatic Classification Method Based on a Fuzzy Similarity Relation , 2016 .

[63]  Heng-Da Cheng,et al.  Thresholding based on fuzzy partition of 2D histogram , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[64]  Ladislav Halada,et al.  Histogram concavity analysis by quasicurvature , 1987 .

[65]  C. H. Li,et al.  An iterative algorithm for minimum cross entropy thresholding , 1998, Pattern Recognit. Lett..

[66]  B. Chanda,et al.  A note on the use of graylevel co-occurence matrix in threshold selection , 1988 .

[67]  Dan A. Ralescu,et al.  A Portfolio Optimization Model Based on Information Entropy and Fuzzy Time Series , 2013, 2013 Sixth International Conference on Business Intelligence and Financial Engineering.

[68]  Sargur N. Srihari,et al.  Document image binarization based on texture analysis , 1994, Electronic Imaging.

[69]  A. D. Brink,et al.  Minimum spatial entropy threshold selection , 1995 .

[70]  D. Manimegalai,et al.  Quantitative fuzzy measures for threshold selection , 2000, Pattern Recognit. Lett..

[71]  Sungzoon Cho,et al.  Improvement of kittler and illingworth's minimum error thresholding , 1989, Pattern Recognit..

[72]  Kai Kwong Lam,et al.  Performance analysis for a class of iterative image thresholding algorithms , 1996, Pattern Recognit..

[73]  Azriel Rosenfeld,et al.  Threshold Selection Using Quadtrees , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Matti Pietikäinen,et al.  Adaptive document image binarization , 2000, Pattern Recognit..

[75]  Melih Inal,et al.  Comparison of neural network application for fuzzy and ANFIS approaches for multi-criteria decision making problems , 2014, Appl. Soft Comput..

[76]  Sankar K. Pal,et al.  Automatic grey level thresholding through index of fuzziness and entropy , 1983, Pattern Recognit. Lett..

[77]  Eghbal G. Mansoori,et al.  On fuzzy feature selection in designing fuzzy classifiers for high-dimensional data , 2016, Evol. Syst..

[78]  Chuan-Yu Chang,et al.  Medical image segmentation using a contextual-constraint-based Hopfield neural cube , 2001, Image Vis. Comput..

[79]  S. Selvan,et al.  Efficient subspace clustering for higher dimensional data using fuzzy entropy , 2009 .

[80]  Basil K. Papadopoulos,et al.  Binarization of texts with varying lighting conditions using fuzzy inclusion and entropy measures , 2018 .

[81]  Gagandeep Kaur,et al.  Performance Evaluation of Two ANFIS Models for Predicting Water Quality Index of River Satluj (India) , 2018 .

[82]  M. Ibrahim Sezan,et al.  A Peak Detection Algorithm and its Application to Histogram-Based Image Data Reduction , 1990, Comput. Vis. Graph. Image Process..

[83]  Dong Cheng,et al.  Force Loading Tracking Control of an Electro-Hydraulic Actuator Based on a Nonlinear Adaptive Fuzzy Backstepping Control Scheme , 2018, Symmetry.

[84]  Sanjeevikumar Padmanaban,et al.  Adaptive Neuro-Fuzzy Inference System ( ANFIS ) Based Direct Torque Control of PMSM driven centrifugal pump , 2017 .

[85]  Azriel Rosenfeld,et al.  Thresholding Using Relaxation , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Jorge Núñez,et al.  Astronomical image segmentation by self-organizing neural networks and wavelets , 2003, Neural Networks.

[87]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[88]  Stanley R. Rotman,et al.  Comments on Picture thresholding using an iterative selection method , 1990, IEEE Trans. Syst. Man Cybern..

[89]  A. D. Brink,et al.  Grey-level thresholding of images using a correlation criterion , 1989, Pattern Recognit. Lett..

[90]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[91]  Prasanna K. Sahoo,et al.  Threshold selection using Renyi's entropy , 1997, Pattern Recognit..

[92]  Amir Averbuch,et al.  Digital image thresholding, based on topological stable-state , 1996, Pattern Recognit..

[93]  Suwarno,et al.  Transformer Paper Expected Life Estimation Using ANFIS Based on Oil Characteristics and Dissolved Gases (Case Study: Indonesian Transformers) , 2017 .

[94]  R. Erol,et al.  A Comparative Study of Neural Networks and ANFIS for Forecasting Attendance Rate of Soccer Games , 2017 .

[95]  Thierry Pun,et al.  Entropic thresholding, a new approach , 1981 .

[96]  A. Rosenfeld The fuzzy geometry of image subsets , 1984, Pattern Recognit. Lett..

[97]  Ahmed A. D. Sarhan,et al.  Prediction of specific grinding forces and surface roughness in machining of AL6061-T6 alloy using ANFIS technique , 2019 .

[98]  H. Joel Trussell,et al.  Comments on "Picture Thresholding Using an Iterative Selection Method" , 1979, IEEE Trans. Syst. Man Cybern..

[99]  Ying Liu,et al.  Image Thresholding by Maximizing the Similarity Degree Based on Intuitionistic Fuzzy Sets , 2017 .

[100]  Tahir Mahmood,et al.  Similarity Measures for T-Spherical Fuzzy Sets with Applications in Pattern Recognition , 2018, Symmetry.

[101]  Ronald W. Schafer,et al.  Multilevel thresholding using edge matching , 1988, Comput. Vis. Graph. Image Process..

[102]  I. Sethi,et al.  Thresholding based on histogram approximation , 1995 .

[103]  Weinan Chen,et al.  Gray level image thresholding based on fisher linear projection of two-dimensional histogram , 1997, Pattern Recognit..

[104]  Edward J. Delp,et al.  Moment preserving quantization [signal processing] , 1991, IEEE Trans. Commun..

[105]  Dilip Kumar Pratihar,et al.  Genetic algorithm-tuned entropy-based fuzzy C-means algorithm for obtaining distinct and compact clusters , 2011, Fuzzy Optim. Decis. Mak..

[106]  Sanghyuk Lee,et al.  Quantitative comparison of similarity measure and entropy for fuzzy sets , 2011 .

[107]  Azriel Rosenfeld,et al.  Relaxation: Evaluation and Applications , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  S. M. Pandit,et al.  Automatic threshold selection based on histogram modes and a discriminant criterion , 1998, Machine Vision and Applications.

[109]  Chein-I Chang,et al.  A relative entropy-based approach to image thresholding , 1994, Pattern Recognit..

[110]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[111]  Thomas Kämpke,et al.  Nonparametric optimal binarization , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[112]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[113]  Hongying Zhang,et al.  Inclusion measure for typical hesitant fuzzy sets, the relative similarity measure and fuzzy entropy , 2016, Soft Comput..