A Novel Fusion-Based Texture Descriptor to Improve the Detection of Architectural Distortion in Digital Mammography

Architectural distortion (AD) is the earliest sign of breast cancer that can be detected on a mammogram, and it is usually associated with malignant tumors. Breast cancer is one of the major causes of death among women, and the chance of cure can increase significantly when detected early. Computer-aided detection (CAD) systems have been used in clinical practice to assist radiologists with the task of detecting breast lesions. However, due to the complexity and subtlety of AD, its detection is still a challenge, even with the assistance of CAD. Recently, the fusion of descriptors has become a trend for improving the performance of computer vision algorithms. In this work, we evaluated some local texture descriptors and their possible combinations, considering different fusion approaches, for application in CAD systems to improve AD detection. In addition, we present a novel fusion-based texture descriptor, the Completed Mean Local Mapped Pattern (CMLMP), which is based on complementary information between three LMP operators (signal, magnitude and center) and the local differences between pixel values and the mean value of a neighborhood. We compared the performance of the proposed descriptor with two other well-known descriptors: the Completed Local Binary Pattern (CLBP) and the Completed Local Mapped Pattern (CLMP), for the task of detecting AD in 350 digital mammography clinical images. The results showed that the descriptor proposed in this work outperforms the others, for both individual and fused approaches. Moreover, the choice of the fusion operator is crucial because it results in different detection performances.

[1]  P. Langenberg,et al.  Breast Imaging Reporting and Data System: inter- and intraobserver variability in feature analysis and final assessment. , 2000, AJR. American journal of roentgenology.

[2]  V. K. Jain,et al.  Characterization of Architectural Distortion in Mammograms Based on Texture Analysis Using Support Vector Machine Classifier with Clinical Evaluation , 2016, Journal of Digital Imaging.

[3]  Rangaraj M. Rangayyan,et al.  Computer-Aided Detection of Architectural Distortion in Prior Mammograms of Interval Cancer , 2013, Journal of Digital Imaging.

[4]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[5]  Rangaraj M. Rangayyan,et al.  Contour-independent detection and classification of mammographic lesions , 2016, Biomed. Signal Process. Control..

[6]  Adilson Gonzaga,et al.  Feature description based on center-symmetric local mapped patterns , 2014, SAC.

[7]  A. Karellas,et al.  Breast cancer imaging: a perspective for the next decade. , 2008, Medical physics.

[8]  Hamid Sheikhzadeh,et al.  A textural approach for recognizing architectural distortion in mammograms , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[9]  Slobodan Ilic,et al.  PPFNet: Global Context Aware Local Features for Robust 3D Point Matching , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[11]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[12]  Yiu-ming Cheung,et al.  Ultra local binary pattern for image texture analysis , 2014, Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[13]  Helder Cesar Rodigues de Oliveira,et al.  Exploratory learning with convolutional autoencoder for discrimination of architectural distortion in digital mammography , 2019, Medical Imaging.

[14]  Julia E. E. de Oliveira,et al.  Model based approach for Detection of Architectural Distortions and Spiculated Masses in Mammograms , 2011 .

[15]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[16]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[17]  Yong Gan,et al.  Completed hybrid local binary pattern for texture classification , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[18]  Ting Zhu,et al.  Multiple TBSVM-RFE for the detection of architectural distortion in mammographic images , 2017, Multimedia Tools and Applications.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Akinobu Shimizu,et al.  A pilot study of architectural distortion detection in mammograms based on characteristics of line shadows , 2008, International Journal of Computer Assisted Radiology and Surgery.

[21]  Mohammad Hossein Shakoor,et al.  Fabric classification using new mapping of local binary pattern , 2018, 2018 International Conference on Intelligent Systems and Computer Vision (ISCV).

[22]  M. Rawashdeh,et al.  In the digital era, architectural distortion remains a challenging radiological task. , 2016, Clinical radiology.

[23]  Adilson Gonzaga,et al.  A new texture descriptor based on local micro-pattern for detection of architectural distortion in mammographic images , 2017, Medical Imaging.

[24]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[25]  Paolo Napoletano,et al.  Improving CNN-Based Texture Classification by Color Balancing , 2017, J. Imaging.

[26]  Li Zhang,et al.  Texture Classification Using Local Pattern Based on Vector Quantization , 2015, IEEE Transactions on Image Processing.

[27]  Samuel J. Magny,et al.  Breast Imaging Reporting and Data System , 2020, Definitions.

[28]  Artur Przelaskowski,et al.  A Two-Step Method for Detection of Architectural Distortions in Mammograms , 2010 .

[29]  Arianna Mencattini,et al.  Reduction of false-positives in a CAD scheme for automated detection of architectural distortion in digital mammography , 2018, Medical Imaging.

[30]  Dong Tian,et al.  FoldingNet: Interpretable Unsupervised Learning on 3D Point Clouds , 2017, ArXiv.

[31]  J. Baker,et al.  Architectural Distortion on Mammography: Correlation With Pathologic Outcomes and Predictors of Malignancy. , 2015, AJR. American journal of roentgenology.

[32]  Jenny Benois-Pineau,et al.  Fusion in Computer Vision , 2014, Advances in Computer Vision and Pattern Recognition.

[33]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Lucas R. Borges,et al.  Transfer learning in deep convolutional neural networks for detection of architectural distortion in digital mammography , 2020, Other Conferences.

[35]  S. Jha,et al.  Why CAD Failed in Mammography. , 2018, Journal of the American College of Radiology : JACR.

[36]  Adilson Gonzaga,et al.  Object Recognition Based on Bag of Features and a New Local Pattern Descriptor , 2014, Int. J. Pattern Recognit. Artif. Intell..

[37]  Zoran Obradovic,et al.  A Robust Descriptor for Color Texture Classification Under Varying Illumination , 2017, VISIGRAPP.

[38]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[39]  C. D'Orsi,et al.  International variation in screening mammography interpretations in community-based programs. , 2003, Journal of the National Cancer Institute.

[40]  Dipti Prasad Mukherjee,et al.  Context-based ensemble classification for the detection of architectural distortion in a digitised mammogram , 2020, IET Image Process..

[41]  Rangaraj M. Rangayyan,et al.  Measures of divergence of oriented patterns for the detection of architectural distortion in prior mammograms , 2013, International Journal of Computer Assisted Radiology and Surgery.

[42]  Christina Ilvento,et al.  Improved cancer detection using computer-aided detection with diagnostic and screening mammography: prospective study of 104 cancers. , 2006, AJR. American journal of roentgenology.

[43]  Arthur A. Goshtasby,et al.  An Autoencoder-Based Image Descriptor for Image Matching and Retrieval , 2016 .

[44]  WangXiaogang,et al.  Local binary features for texture classification , 2017 .

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  Lu Wang,et al.  Land-use scene classification using multi-scale completed local binary patterns , 2015, Signal, Image and Video Processing.

[47]  Hang Zhang,et al.  Deep Texture Manifold for Ground Terrain Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Vandana Dialani,et al.  Architectural distortion of the breast. , 2013, AJR. American journal of roentgenology.

[49]  Bonnie N Joe,et al.  Suspicious Findings at Digital Breast Tomosynthesis Occult to Conventional Digital Mammography: Imaging Features and Pathology Findings , 2015, The breast journal.

[50]  Richard H. Moore,et al.  THE DIGITAL DATABASE FOR SCREENING MAMMOGRAPHY , 2007 .

[51]  Adilson Gonzaga,et al.  Improving the classification of rotated images by adding the signal and magnitude information to a local texture descriptor , 2018, Multimedia Tools and Applications.

[52]  Sankey V. Williams,et al.  Computer‐Aided Diagnosis , 2005 .

[53]  Dione M Farria,et al.  Effect of transition to digital mammography on clinical outcomes. , 2011, Radiology.

[54]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[55]  Hong Huo,et al.  Improving the Separability of Deep Features with Discriminative Convolution Filters for RSI Classification , 2018, ISPRS Int. J. Geo Inf..

[56]  R. L. Birdwell Screening Mammography–detected Cancers: Sensitivity of a Computer-aided Detection System Applied to Full-Field Digital Mammograms , 2008 .

[57]  Ali Farhadi,et al.  XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks , 2016, ECCV.

[58]  Tomas Piatrik,et al.  Fusion in Computer Vision: Understanding Complex Visual Content , 2014 .

[59]  Adilson Gonzaga,et al.  Human iris feature extraction under pupil size variation using local texture descriptors , 2019, Multimedia Tools and Applications.

[60]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[61]  Jun Guo,et al.  Compressive Binary Patterns: Designing a Robust Binary Face Descriptor with Random-Field Eigenfilters , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  SchmidhuberJürgen Deep learning in neural networks , 2015 .