AFDL: a new adaptive fuzzy dictionary learning for medical image classification

Sparse coding allows the representation of complex data as a linear combination of basis sparse vectors (alternatively called atoms or codewords), a collection of which constitutes a dictionary. Dictionary learning is a learning process aimed at finding a small number of optimal basis vectors for a more accurate representation of the original data. The existing dictionary learning methods do not address the inherent uncertainty of the input data in their learning processes. To compensate for the uncertainty, and to obtain a flexible and effective learning system, we introduce a new adaptive fuzzy dictionary learning (AFDL) method for image classification purposes. The new method iteratively alternates between sparse coding based on a given dictionary and an adaptive fuzzy dictionary learning approach to learn (improve) dictionary atoms. The adjustability of the dictionary and coefficients vectors, in this method, provide us a more accurate and straight representation of input data. AFDL was applied on magnetic resonance images from the cancer image archive datasets, for medical image classification of cancer tumors. Finally, the overall experimental results clearly show that our approach outperforms its rival techniques in terms of accuracy, sensitivity, and specificity. Convergence speed in the experimental results shows that AFDL can achieve its acceptable precision in a reasonable time.

[1]  Licheng Jiao,et al.  Unsupervised High-Level Feature Extraction of SAR Imagery With Structured Sparsity Priors and Incremental Dictionary Learning , 2016, IEEE Geoscience and Remote Sensing Letters.

[2]  Fuchun Sun,et al.  Hierarchical Structured Sparse Representation for T–S Fuzzy Systems Identification , 2013, IEEE Transactions on Fuzzy Systems.

[3]  Jian Yang,et al.  Sample diversity, representation effectiveness and robust dictionary learning for face recognition , 2017, Inf. Sci..

[4]  KubatMiroslav,et al.  Brain tumors detection and segmentation in MR images , 2015 .

[5]  Lorenzo Bruzzone,et al.  Class-wise dictionary learning for hyperspectral image classification , 2017, Neurocomputing.

[6]  Nooshin Nabizadeh,et al.  Brain tumors detection and segmentation in MR images: Gabor wavelet vs. statistical features , 2015, Comput. Electr. Eng..

[7]  M. Borda,et al.  Speckle noise removal in ultrasound images using sparse code shrinkage , 2015, 2015 E-Health and Bioengineering Conference (EHB).

[8]  Vladik Kreinovich,et al.  Extracting fuzzy sparse rules by Cartesian representation and clustering , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[9]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..

[10]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[11]  Syed Abdul Rahman Syed Abu Bakar,et al.  Review of Brain Lesion Detection and Classification using Neuroimaging Analysis Techniques , 2015 .

[12]  Karthikeyan Natesan Ramamurthy,et al.  Multiple Kernel Sparse Representations for Supervised and Unsupervised Learning , 2013, IEEE Transactions on Image Processing.

[13]  Yan Huang,et al.  Dynamic Texture Recognition via Orthogonal Tensor Dictionary Learning , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  Mahmoud Khaled Abd-Ellah,et al.  A review on brain tumor diagnosis from MRI images: Practical implications, key achievements, and lessons learned. , 2019, Magnetic resonance imaging.

[15]  Qigang Gao,et al.  N-Gram Based Image Representation and Classification Using Perceptual Shape Features , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[16]  Wei Dai,et al.  Sparse coding with adaptive dictionary learning for underdetermined blind speech separation , 2013, Speech Commun..

[17]  Salim Lahmiri,et al.  Glioma detection based on multi-fractal features of segmented brain MRI by particle swarm optimization techniques , 2017, Biomed. Signal Process. Control..

[18]  Panagiota Spyridonos,et al.  Brain tumor characterization using the soft computing technique of fuzzy cognitive maps , 2008, Appl. Soft Comput..

[19]  Abdel-Badeeh M. Salem,et al.  Hybrid intelligent techniques for MRI brain images classification , 2010, Digit. Signal Process..

[20]  Li Yao,et al.  Multi-feature kernel discriminant dictionary learning for face recognition , 2017, Pattern Recognit..

[21]  Jeng-Shyang Pan,et al.  Fuzzy Rules Interpolation for Sparse Fuzzy Rule-Based Systems Based on Interval Type-2 Gaussian Fuzzy Sets and Genetic Algorithms , 2013, IEEE Transactions on Fuzzy Systems.

[22]  Zhuowen Tu,et al.  Weakly supervised histopathology cancer image segmentation and classification , 2014, Medical Image Anal..

[23]  Stéphane Mallat,et al.  Matching pursuit of images , 1995, Proceedings., International Conference on Image Processing.

[24]  B. Vinod,et al.  Fuzzy based Multiple Dictionary Bag of Words for Image Classification , 2012 .

[25]  Yan Song,et al.  Gaussian derivative models and ensemble extreme learning machine for texture image classification , 2018, Neurocomputing.

[26]  Ding Yuan,et al.  Sparse representation over discriminative dictionary for stereo matching , 2017, Pattern Recognit..

[27]  Marta Schuhmacher,et al.  Fuzzy uncertainty analysis in system modelling , 2005 .

[28]  Akila Thiyagarajan,et al.  Comparative analysis of classifier Performance on MR brain images , 2015, Int. Arab J. Inf. Technol..

[29]  Virendra P. Vishwakarma,et al.  Extended interval type-II and kernel based sparse representation method for face recognition , 2019, Expert Syst. Appl..

[30]  Tuan D. Pham,et al.  Nonstationary Mapping of Spatial Uncertainty for Medical Image Classification , 2014, 2014 International Conference on Medical Biometrics.

[31]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[32]  Webster K. Cavenee,et al.  Erratum: The 2007 WHO classification of tumours of the central nervous system (Acta Neuropathol (2007) vol. 114 (97-109)) , 2007 .

[33]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[34]  Haoxiang Wang,et al.  SAR image change detection using regularized dictionary learning and fuzzy clustering , 2014, 2014 IEEE 3rd International Conference on Cloud Computing and Intelligence Systems.

[35]  Christopher O. Jaynes,et al.  Feature uncertainty arising from covariant image noise , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[37]  Mohammad Hossein Fazel Zarandi,et al.  A Type-2 Fuzzy Image Processing Expert System for Diagnosing Brain Tumors , 2015, Journal of Medical Systems.

[38]  Fang Liu,et al.  Joint sparse regularization based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for classification , 2015, Knowl. Based Syst..

[39]  B. Scheithauer,et al.  The 2007 WHO classification of tumours of the central nervous system , 2007, Acta Neuropathologica.

[40]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[41]  Changyin Sun,et al.  Supervised class-specific dictionary learning for sparse modeling in action recognition , 2012, Pattern Recognit..

[42]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[43]  Jian Shen,et al.  Medical image classification based on multi-scale non-negative sparse coding , 2017, Artif. Intell. Medicine.

[44]  Zhao Zhi-zhong,et al.  An Improved Remote Sensing Image Classification Based on K-Means Using HSV Color Feature , 2014 .

[45]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[46]  Jill S. Barnholtz-Sloan,et al.  CBTRUS Statistical Report: Primary Brain and Central Nervous System Tumors Diagnosed in the United States in 2008-2012 , 2015, Neuro-oncology.

[47]  Licheng Jiao,et al.  High-Level Feature Selection With Dictionary Learning for Unsupervised SAR Imagery Terrain Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  B. Shoban Babu,et al.  Detection of Brain Tumour in MRI Scan Images using Tetrolet Transform and SVM Classifier , 2017 .

[49]  Vijayan K. Asari,et al.  Classification of hyperspectral image using multiscale spatial texture features , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[50]  Minakshi Sharma Brain Tumor Segmentation using hybrid Genetic Algorithm and Artificial Neural Network Fuzzy Inference System (ANFIS) , 2012 .

[51]  Dapeng Tao,et al.  Discriminative dictionary learning via Fisher discrimination K-SVD algorithm , 2015, Neurocomputing.

[52]  Abdellah Adib,et al.  Performance evaluation of feature extraction techniques in MR-Brain image classification system , 2018 .

[53]  Shuyuan Yang,et al.  Unsupervised classification of polarimetric SAR images integrating color features , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[54]  Xue-Cheng Tai,et al.  A Weighted Dictionary Learning Model for Denoising Images Corrupted by Mixed Noise , 2013, IEEE Transactions on Image Processing.

[55]  Miki Haseyama,et al.  Random combination for information extraction in compressed sensing and sparse representation-based pattern recognition , 2014, Neurocomputing.

[56]  Zhenghua Zhou,et al.  Pose and illumination variable face recognition via sparse representation and illumination dictionary , 2016, Knowl. Based Syst..

[57]  Qi Tian,et al.  Image classification using spatial pyramid robust sparse coding , 2013, Pattern Recognit. Lett..

[58]  Shutao Li,et al.  Contextual Online Dictionary Learning for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Luc Van Gool,et al.  Latent Dictionary Learning for Sparse Representation Based Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Laurent Mouchard,et al.  Dealing with uncertainty and imprecision in image segmentation using belief function theory , 2014, Int. J. Approx. Reason..

[61]  Eyke Hüllermeier,et al.  Does machine learning need fuzzy logic? , 2015, Fuzzy Sets Syst..

[62]  Tai-hoon Kim,et al.  Brain Tumor Classification using Adaptive Neuro-Fuzzy Inference System from MRI , 2016 .

[63]  Xiao Li,et al.  Supervised transfer kernel sparse coding for image classification , 2015, Pattern Recognit. Lett..

[64]  Xue Li,et al.  Face recognition using class specific dictionary learning for sparse representation and collaborative representation , 2016, Neurocomputing.

[65]  Rahime Ceylan,et al.  Classification of mammogram images by dictionary learning , 2017, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP).

[66]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[67]  Yong Xu,et al.  Supervised dictionary learning with multiple classifier integration , 2016, Pattern Recognit..

[68]  J. Barnholtz-Sloan,et al.  CBTRUS statistical report: primary brain and central nervous system tumors diagnosed in the United States in 2007-2011. , 2012, Neuro-oncology.

[69]  Nilesh Bhaskarrao Bahadure,et al.  Comparative Approach of MRI-Based Brain Tumor Segmentation and Classification Using Genetic Algorithm , 2018, Journal of Digital Imaging.

[70]  Mark D. Plumbley,et al.  Fast Dictionary Learning for Sparse Representations of Speech Signals , 2011, IEEE Journal of Selected Topics in Signal Processing.

[71]  Xiaohong W. Gao,et al.  Classification of CT brain images based on deep learning networks , 2017, Comput. Methods Programs Biomed..

[72]  Shuyuan Yang,et al.  Sparse learning based fuzzy c-means clustering , 2017, Knowl. Based Syst..

[73]  Zi Liu,et al.  A Fuzzy Adaptive K-SVD Dictionary Algorithm for Face Recogntion , 2013 .

[74]  Wei Dai,et al.  Simultaneous Codeword Optimization (SimCO) for Dictionary Update and Learning , 2011, IEEE Transactions on Signal Processing.

[75]  Vinod Kumar,et al.  Classification of brain tumors using PCA-ANN , 2011, 2011 World Congress on Information and Communication Technologies.

[76]  Jacques A. de Guise,et al.  A method for modeling noise in medical images , 2004, IEEE Transactions on Medical Imaging.

[77]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[78]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[79]  W. Kracht,et al.  Textural image classification of foams based on variographic analysis , 2016 .

[80]  Yap-Peng Tan,et al.  Nonlinear dictionary learning with application to image classification , 2018, Pattern Recognit..

[81]  Bodo Rosenhahn,et al.  Brain tumor classification and segmentation using sparse coding and dictionary learning , 2016, Biomedizinische Technik. Biomedical engineering.

[82]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[83]  Biao Hou,et al.  Multilevel Distribution Coding Model-Based Dictionary Learning for PolSAR Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[84]  Shyi-Ming Chen,et al.  Fuzzy interpolative reasoning for sparse fuzzy rule-based systems based on interval type-2 fuzzy sets , 2011, Expert Syst. Appl..

[85]  Bodo Rosenhahn,et al.  Brain tumor classification using sparse coding and dictionary learning , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[86]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[87]  Nanning Zheng,et al.  Constructing Deep Sparse Coding Network for image classification , 2017, Pattern Recognit..

[88]  Mohammad Hossein Fazel Zarandi,et al.  Systematic image processing for diagnosing brain tumors: A Type-II fuzzy expert system approach , 2011, Appl. Soft Comput..

[89]  Jianbo Su,et al.  Sparse embedded dictionary learning on face recognition , 2017, Pattern Recognit..

[90]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[91]  V. K. Govindan,et al.  SPARSE REPRESENTATION BASED CLASSIFICATION OF MR IMAGES OF BRAIN FOR ALZHEIMER'S DISEASE DIAGNOSIS , 2014 .