Rotation invariant features based on three dimensional Gaussian Markov random fields for volumetric texture classification

Abstract This paper proposes a set of rotation invariant features based on three dimensional Gaussian Markov Random Fields (3D-GMRF) for volumetric texture image classification. In the method proposed here, the mathematical notion of spherical harmonics is employed to produce a set of features which are used to construct the rotation invariant descriptor. Our proposed method is evaluated and compared with other method in the literature for datasets containing synthetic textures as well as medical images. The results of our experiments demonstrate excellent classification performance for our proposed method compared with state-of-the-art methods. Furthermore, our method is evaluated using a clinical dataset and show good performance in discriminating between healthy individuals and COPD patients. Our method also performs well in classifying lung nodules in the LIDC-IDRI dataset. Our results indicate that our 3D-GMRF-based method enjoys more superior performance compared with other methods in the literature.

[1]  A. Björkström Ridge Regression and inverse problems , 2007 .

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[4]  B. van Ginneken,et al.  Computer-aided diagnosis in high resolution CT of the lungs. , 2003, Medical physics.

[5]  Taco S Cohen,et al.  Pulmonary nodule detection in CT scans with equivariant CNNs , 2019, Medical Image Anal..

[6]  E. Hoffman,et al.  Interstitial lung disease: A quantitative study using the adaptive multiple feature method. , 1999, American journal of respiratory and critical care medicine.

[7]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Robin Green,et al.  Spherical Harmonic Lighting: The Gritty Details , 2003 .

[10]  Michael Unser,et al.  Rotation Invariance and Directional Sensitivity: Spherical Harmonics versus Radiomics Features , 2018, MLMI@MICCAI.

[11]  Jan Boehm,et al.  A review on deep learning techniques for 3D sensed data classification , 2019, Remote. Sens..

[12]  Theo van Walsum,et al.  3D LBP-Based Rotationally Invariant Region Description , 2012, ACCV Workshops.

[13]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[14]  Sasan Mahmoodi,et al.  Extended three-dimensional rotation invariant local binary patterns , 2017, Image Vis. Comput..

[15]  E. Hoffman,et al.  Quantification of pulmonary emphysema from lung computed tomography images. , 1997, American journal of respiratory and critical care medicine.

[16]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Vassili A. Kovalev,et al.  3D Texture Analysis of MRI Brain Datasets , 2001, IEEE Trans. Medical Imaging.

[18]  Sasan Mahmoodi,et al.  Volumetric Texture Analysis Based on Three-Dimensional Gaussian Markov Random Fields for COPD Detection , 2018, MIUA.

[19]  Vincent Andrearczyk,et al.  Rotational 3D Texture Classification Using Group Equivariant CNNs , 2018, ArXiv.

[20]  Weidong Cai,et al.  Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT , 2019, IEEE Transactions on Medical Imaging.

[21]  Sasan Mahmoodi,et al.  Gaussian Markov random field based improved texture descriptor for image segmentation , 2014, Image Vis. Comput..

[22]  Hans Burkhardt,et al.  3D rotation invariant local binary patterns , 2008, 2008 19th International Conference on Pattern Recognition.

[23]  M. Mascalchi,et al.  Lung densitometry: why, how and when. , 2017, Journal of thoracic disease.

[24]  Jean-Yves Ramel,et al.  Comparison between 2D and 3D Local Binary Pattern Methods for Characterisation of Three-Dimensional Textures , 2008, ICIAR.

[25]  J. Wedzicha,et al.  Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Lung Disease 2017 Report: GOLD Executive Summary , 2017, European Respiratory Journal.

[26]  Sasan Mahmoodi,et al.  Rotation invariant texture descriptors based on Gaussian Markov random fields for classification , 2016, Pattern Recognit. Lett..

[27]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[28]  Rongchun Zhao,et al.  Adaptive Segmentation of Textured Images by Using the Coupled Markov Random Field Model , 2006, IEEE Transactions on Image Processing.

[29]  David A Lynch Progress in Imaging COPD, 2004 - 2014. , 2014, Chronic obstructive pulmonary diseases.

[30]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[31]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[32]  N. Müller,et al.  "Density mask". An objective method to quantitate emphysema using computed tomography. , 1988, Chest.

[33]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[34]  Hong Zhao,et al.  Texture Feature Analysis for Computer-Aided Diagnosis on Pulmonary Nodules , 2015, Journal of Digital Imaging.

[35]  Yong Xu,et al.  Scale-space texture description on SIFT-like textons , 2012, Comput. Vis. Image Underst..

[36]  Rama Chellappa,et al.  Classification of textures using Gaussian Markov random fields , 1985, IEEE Trans. Acoust. Speech Signal Process..

[37]  Ulas Bagci,et al.  Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning , 2017, IPMI.

[38]  Nikos Komodakis,et al.  Markov Random Field modeling, inference & learning in computer vision & image understanding: A survey , 2013, Comput. Vis. Image Underst..

[39]  Jianpeng Zhang,et al.  Semi-supervised adversarial model for benign-malignant lung nodule classification on chest CT , 2019, Medical Image Anal..

[40]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[41]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[42]  Rama Chellappa,et al.  Unsupervised Texture Segmentation Using Markov Random Field Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Shawn D. Newsam,et al.  Comparing SIFT descriptors and gabor texture features for classification of remote sensed imagery , 2008, 2008 15th IEEE International Conference on Image Processing.

[44]  Yassine Ruichek,et al.  Local directional ternary pattern: A New texture descriptor for texture classification , 2018, Comput. Vis. Image Underst..

[45]  J. Seo,et al.  Texture-Based Quantification of Pulmonary Emphysema on High-Resolution Computed Tomography: Comparison With Density-Based Quantification and Correlation With Pulmonary Function Test , 2008, Investigative radiology.

[46]  Henning Müller,et al.  3D Solid Texture Classification Using Locally-Oriented Wavelet Transforms , 2017, IEEE Transactions on Image Processing.

[47]  Xin Geng,et al.  Classification of Lung Nodule Malignancy Risk on Computed Tomography Images Using Convolutional Neural Network: A Comparison Between 2D and 3D Strategies , 2016, ACCV Workshops.

[48]  Maria Petrou,et al.  Image processing - dealing with texture , 2020 .

[49]  Steve R. Gunn,et al.  Snake based unsupervised texture segmentation using Gaussian Markov Random Field Models , 2011, 2011 18th IEEE International Conference on Image Processing.

[50]  Taco Cohen,et al.  3D G-CNNs for Pulmonary Nodule Detection , 2018, ArXiv.

[51]  Jean-Yves Ramel,et al.  A Solid Texture Database for Segmentation and Classification Experiments , 2009, VISAPP.

[52]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[53]  Jan Stolk,et al.  Optimization and Standardization of Lung Densitometry in the Assessment of Pulmonary Emphysema , 2004, Investigative radiology.

[54]  Sasan Mahmoodi,et al.  Gaussian Markov Random Fields-Based Features for Volumetric Texture Segmentation , 2019, 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).