Discriminative feature extraction from X-ray images using deep convolutional neural networks

Feature extraction is one of the most important phases of medical image classification which requires extensive domain knowledge. Convolutional Neural Networks (CNN) have been successfully used for feature extraction in images from different domains involving a lot of classes. In this paper, CNNs are exploited to extract a hierarchical and discriminative representation of X-ray images. This representation is then used for classification of the X-ray images as various parts of the body. Visualization of the feature maps in the hidden layers show that features learnt by the CNN resemble the essential features which help discern the discrimination among different body parts. A comparison on the standard IRMA X-ray image dataset demonstrates that the CNNs easily outperform classifiers with hand-engineered features.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  J Jiang,et al.  Medical image analysis with artificial neural networks , 2010, Comput. Medical Imaging Graph..

[4]  C. Krishna Mohan,et al.  Content based medical image retrieval using dictionary learning , 2015, Neurocomputing.

[5]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[6]  H. Pourghassem,et al.  Medical X-ray Images Classification Based on Shape Features and Bayesian Rule , 2012, 2012 Fourth International Conference on Computational Intelligence and Communication Networks.

[7]  Berkman Sahiner,et al.  Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images , 1996, IEEE Trans. Medical Imaging.

[8]  M. Srinivas,et al.  Medical Image Indexing and Retrieval using Multiple Features , 2013 .

[9]  Hermann Ney,et al.  A Statisti al Framework for Model-basedImage Retrieval in Medi al Appli ations , 2003 .

[10]  Stefan Holban,et al.  Segmentation of bone structure in X-ray images using convolutional neural network , 2013 .

[11]  Xiaogang Wang,et al.  Medical image classification with convolutional neural network , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[12]  Mohammad Reza Zare,et al.  Merging Scheme-based Classification of Medical X-ray Images , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[13]  Günther Palm,et al.  Learning convolutional neural networks from few samples , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[14]  Hermann Ney,et al.  Automatic categorization of medical images for content-based retrieval and data mining. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[15]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[16]  Hayit Greenspan,et al.  Medical Image Categorization and Retrieval for PACS Using the GMM-KL Framework , 2007, IEEE Transactions on Information Technology in Biomedicine.

[17]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[18]  Bipin C. Desai,et al.  A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques With Relevance Feedback , 2007, IEEE Transactions on Information Technology in Biomedicine.

[19]  Li-dong Fu,et al.  Medical Image Retrieval and Classification Based on Morphological Shape Feature , 2010, 2010 Third International Conference on Intelligent Networks and Intelligent Systems.

[20]  Hayit Greenspan,et al.  Content-Based Image Retrieval in Radiology: Current Status and Future Directions , 2010, Journal of Digital Imaging.

[21]  C. Krishna Mohan,et al.  Medical images modality classification using multi-scale dictionary learning , 2014, 2014 19th International Conference on Digital Signal Processing.

[22]  Hossein Pourghassem,et al.  Content-based medical image classification using a new hierarchical merging scheme , 2008, Comput. Medical Imaging Graph..

[23]  Hayit Greenspan,et al.  X-ray image categorization and retrieval using patch-based visualwords representation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Tony Basil,et al.  Adaptive learning based heartbeat classification. , 2015, Bio-medical materials and engineering.