Bayesian inference framework for bounded generalized Gaussian‐based mixture model and its application to biomedical images classification

Biomedical image classification problem has attracted a lot of attention in medical engineering community and medicine applications. Accurate and automatic classification (eg, normal/abnormal or malignant/benign) has a variety of applications such as automatic decision making and is known to be very challenging. In this research, we address this problem by investigating the effectiveness of Bayesian inference methods for statistical bounded mixture models. Indeed, a novel approach termed as Bayesian learning for bounded generalized Gaussian mixture models is developed. The consideration of bounded mixture models is encouraged by their capability to take into account the nature of the data that is compactly supported. Furthermore, the consideration of Bayesian inference is more attractive compared to frequentist reasoning. In this work, we address main issues related to accurate data classification such as the effective estimation of the model's parameters and the selection of the optimal model complexity. Moreover, the problem of over‐ or under‐fitting is treated by taking into account the uncertainty through introducing prior information about the model's parameters. A comparative study between different Gaussian‐based models is also performed to evaluate the performance of the proposed framework. Experiments have been conducted on challenging biomedical image datasets that involve retinal images for diabetic retinopathy detection and mammograms for breast cancer detection. Obtained results are encouraging and show the benefits of our Bayesian framework.

[1]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Alireza Osareh,et al.  A Computational-Intelligence-Based Approach for Detection of Exudates in Diabetic Retinopathy Images , 2009, IEEE Transactions on Information Technology in Biomedicine.

[3]  Asoke K. Nandi,et al.  Exponent parameter estimation for generalized Gaussian probability density functions with application to speech modeling , 2005, Signal Process..

[4]  J. Olson,et al.  The efficacy of automated “disease/no disease” grading for diabetic retinopathy in a systematic screening programme , 2007, British Journal of Ophthalmology.

[5]  Bram van Ginneken,et al.  Contextual computer-aided detection: Improving bright lesion detection in retinal images and coronary calcification identification in CT scans , 2012, Medical Image Anal..

[6]  Sami Bourouis,et al.  Hybrid Statistical Framework for Diabetic Retinopathy Detection , 2018, ICIAR.

[7]  Nizar Bouguila,et al.  A Novel Model-Based Approach for Medical Image Segmentation Using Spatially Constrained Inverted Dirichlet Mixture Models , 2017, Neural Processing Letters.

[8]  Nizar Bouguila,et al.  Variational learning of a Dirichlet process of generalized Dirichlet distributions for simultaneous clustering and feature selection , 2013, Pattern Recognit..

[9]  Joseph M. Reinhardt,et al.  Splat Feature Classification With Application to Retinal Hemorrhage Detection in Fundus Images , 2013, IEEE Transactions on Medical Imaging.

[10]  A. Raftery,et al.  Estimating Bayes Factors via Posterior Simulation with the Laplace—Metropolis Estimator , 1997 .

[11]  Chong Wang,et al.  Stochastic variational inference , 2012, J. Mach. Learn. Res..

[12]  Nizar Bouguila,et al.  Bayesian learning of finite generalized Gaussian mixture models on images , 2011, Signal Process..

[13]  Kok-Swee Sim,et al.  Convolutional neural network improvement for breast cancer classification , 2019, Expert Syst. Appl..

[14]  Sami Bourouis,et al.  Color image segmentation with bounded generalized Gaussian mixture model and feature selection , 2018, 2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[15]  Ilias Maglogiannis,et al.  An intelligent system for automated breast cancer diagnosis and prognosis using SVM based classifiers , 2009, Applied Intelligence.

[16]  Nizar Bouguila,et al.  A hierarchical nonparametric Bayesian approach for medical images and gene expressions classification , 2014, Soft Computing.

[17]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[18]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[19]  Zhihua Zhang,et al.  EM algorithms for Gaussian mixtures with split-and-merge operation , 2003, Pattern Recognition.

[20]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[21]  Yudong Zhang,et al.  A hybrid method for MRI brain image classification , 2011, Expert Syst. Appl..

[22]  Bin Sheng,et al.  Clinical Report Guided Retinal Microaneurysm Detection With Multi-Sieving Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[23]  Santi P. Maity,et al.  Automatic Detection of Retinal Lesions for Screening of Diabetic Retinopathy , 2018, IEEE Transactions on Biomedical Engineering.

[24]  Jalil Taghia,et al.  Insights Into Multiple/Single Lower Bound Approximation for Extended Variational Inference in Non-Gaussian Structured Data Modeling , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[26]  Lucas J. van Vliet,et al.  An Automated System for the Detection and Classification of Retinal Changes Due to Red Lesions in Longitudinal Fundus Images , 2018, IEEE Transactions on Biomedical Engineering.

[27]  Fatma Najar,et al.  Unsupervised Human Action Categorization Using a Riemannian Averaged Fixed-Point Learning of Multivariate GGMM , 2018, ICIAR.

[28]  Bunyarit Uyyanonvara,et al.  Automatic detection of diabetic retinopathy exudates from non-dilated retinal images using mathematical morphology methods , 2008, Comput. Medical Imaging Graph..

[29]  K A Birney,et al.  On the modeling of DCT and subband image data for compression , 1995, IEEE Trans. Image Process..

[30]  Sami Bourouis,et al.  Deriving Probabilistic SVM Kernels From Flexible Statistical Mixture Models and its Application to Retinal Images Classification , 2019, IEEE Access.

[31]  Shankar M. Krishnan,et al.  Image segmentation using finite mixtures and spatial information , 2004, Image Vis. Comput..

[32]  Fatma Najar,et al.  A Comparison Between Different Gaussian-Based Mixture Models , 2017, 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA).

[33]  Devi Vijayan,et al.  Detection of Exudates in Diabetic Retinopathy , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[34]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[35]  Fatma Najar,et al.  A Fixed-Point Estimation Algorithm for Learning the Multivariate GGMM: Application to Human Action Recognition , 2018, 2018 IEEE Canadian Conference on Electrical & Computer Engineering (CCECE).

[36]  Sushma G. Thorat Locating the Optic Nerve in a Retinal Image Using the Fuzzy Convergence of the Blood Vessels , 2014 .

[37]  Nizar Bouguila,et al.  Bayesian Learning of Generalized Gaussian Mixture Models on Biomedical Images , 2010, ANNPR.

[38]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[39]  Marios S. Pattichis,et al.  Multiscale AM-FM Methods for Diabetic Retinopathy Lesion Detection , 2010, IEEE Transactions on Medical Imaging.

[40]  Sami Bourouis,et al.  Multimodal Bone Cancer Detection Using Fuzzy Classification and Variational Model , 2013, CIARP.

[41]  Sami Bourouis,et al.  Spatially Constrained Mixture Model with Feature Selection for Image and Video Segmentation , 2018, ICISP.

[42]  Shilpa Joshi,et al.  A review on exudates detection methods for diabetic retinopathy. , 2018, Biomedicine & pharmacotherapy = Biomedecine & pharmacotherapie.

[43]  Jean-Michel Marin,et al.  Bayesian Modelling and Inference on Mixtures of Distributions , 2005 .

[44]  Nizar Bouguila,et al.  Semantic Scene Classification with Generalized Gaussian Mixture Models , 2015, ICIAR.

[45]  Sami Bourouis,et al.  Image and video denoising by combining unsupervised bounded generalized gaussian mixture modeling and spatial information , 2018, Multimedia Tools and Applications.

[46]  Peter F. Sharp,et al.  Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes , 2008, Diabetes Care.

[47]  András Hajdu,et al.  Retinal Microaneurysm Detection Through Local Rotating Cross-Section Profile Analysis , 2013, IEEE Transactions on Medical Imaging.

[48]  Jouni Lampinen,et al.  Differential evolution based nearest prototype classifier with optimized distance measures for the features in the data sets , 2013, Expert Syst. Appl..

[49]  Saeed Rubaiee,et al.  Supervised Machine Learning of KFCG Algorithm and MBTC features for efficient classification of Image Database and CBIR Systems , 2018 .

[50]  Josef Kittler,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2015 .

[51]  Gwénolé Quellec,et al.  Optimal Wavelet Transform for the Detection of Microaneurysms in Retina Photographs , 2008, IEEE Transactions on Medical Imaging.

[52]  P. Deb Finite Mixture Models , 2008 .

[53]  Jun Guo,et al.  Variational Bayesian Learning for Dirichlet Process Mixture of Inverted Dirichlet Distributions in Non-Gaussian Image Feature Modeling , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Marcelo Mendoza,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2017, Lecture Notes in Computer Science.

[55]  Ahmad Taher Azar,et al.  Performance analysis of support vector machines classifiers in breast cancer mammography recognition , 2013, Neural Computing and Applications.

[56]  Sami Bourouis,et al.  A Flexible Statistical Model for Image Denoising , 2018, ICIAR.

[57]  Muhammad Sharif,et al.  A method for the detection and classification of diabetic retinopathy using structural predictors of bright lesions , 2017, J. Comput. Sci..

[58]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[59]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[60]  Bart M. ter Haar Romeny,et al.  Retinal Microaneurysms Detection Using Local Convergence Index Features , 2017, IEEE Transactions on Image Processing.

[61]  Sami Bourouis,et al.  Automatic MRI Brain Segmentation with Combined Atlas-Based Classification and Level-Set Approach , 2008, ICIAR.

[62]  Kemal Polat,et al.  A new hybrid method based on fuzzy-artificial immune system and k-nn algorithm for breast cancer diagnosis , 2007, Comput. Biol. Medicine.

[63]  Kenneth Revett,et al.  Computer-aided diagnosis of human brain tumor through MRI: A survey and a new algorithm , 2014, Expert Syst. Appl..

[64]  Jonas Samuelsson,et al.  Bounded support Gaussian mixture modeling of speech spectra , 2003, IEEE Trans. Speech Audio Process..

[65]  Markus Flierl,et al.  Bayesian estimation of Dirichlet mixture model with variational inference , 2014, Pattern Recognit..

[66]  Hui Zhang,et al.  Bounded generalized Gaussian mixture model , 2014, Pattern Recognit..

[67]  Abdulmajeed Alsufyani,et al.  A comparison of classification algorithms for Event Related Potentials , 2017, 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT).

[68]  Qin Li,et al.  Detection of microaneurysms using multi-scale correlation coefficients , 2010, Pattern Recognit..

[69]  U. Rajendra Acharya,et al.  An Integrated Index for the Identification of Diabetic Retinopathy Stages Using Texture Parameters , 2012, Journal of Medical Systems.