Grading of Knee Osteoarthritis Using Convolutional Neural Networks

Knee osteoarthritis (OA) is a disease of the joints and a leading cause of disability among the elderly. If detected at an early stage, its advancement can be slowed and the patient’s suffering can be reduced. A new approach involving multiscale convolutional blocks in convolutional neural network (MCBCNN) has been introduced in this paper for automatic classification and grading of knee OA. The proposed model is implemented using pretrained convolutional neural networks (CNNs) and multiscale convolutional filters. Three pretrained CNN models, namely mobileNet2, resNet50 and inceptionNetv3 have been used for the implementation of MCBCNN. Exhaustive performance analysis has been conducted on the three proposed models. The results of knee OA grading delivered by all the three proposed MCBCNNs have been compared. The results show that the performance of MCBCNNs is better than that of the pretrained CNNs. Among the proposed three MCBCNNs, the MCB resNet50 delivers better performance in terms of average accuracy of over $$95\%$$ , area under curve of nearly 0.9 and F1 score of 0.8.

[1]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[2]  Noel E. O'Connor,et al.  Predicting knee osteoarthritis severity: comparative modeling based on patient’s data and plain X-ray images , 2019, Scientific Reports.

[3]  Stefan Klein,et al.  Improving Robustness of Deep Learning Based Knee MRI Segmentation: Mixup and Adversarial Domain Adaptation , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[4]  Ming Zhang,et al.  A Novel Method to Predict Knee Osteoarthritis Progression on MRI Using Machine Learning Methods , 2018, IEEE Transactions on NanoBioscience.

[5]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[6]  H Yoshida,et al.  Fully automatic quantification of knee osteoarthritis severity on plain radiographs. , 2008, Osteoarthritis and cartilage.

[7]  Xiaoshuang Shi,et al.  Fully automatic knee osteoarthritis severity grading using deep neural networks with a novel ordinal loss , 2019, Comput. Medical Imaging Graph..

[8]  C. Patel,et al.  Integrated Analysis of Gene Expression Differences in Twins Discordant for Disease and Binary Phenotypes , 2017, Scientific Reports.

[9]  Bram van Ginneken,et al.  Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images , 2016, IEEE Transactions on Medical Imaging.

[10]  Milan Sonka,et al.  Learning-Based Cost Functions for 3-D and 4-D Multi-Surface Multi-Object Segmentation of Knee MRI: Data From the Osteoarthritis Initiative , 2018, IEEE Transactions on Medical Imaging.

[11]  V. Rajini,et al.  Local Binary Pattern Approach to the Classification of Osteoarthritis in Knee X-ray Images , 2013 .

[12]  Rajini,et al.  A non-invasive computer aided diagnosis of osteoarthritis from digitalx-ray images , 2015 .

[13]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[15]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[16]  Simo Saarakkala,et al.  Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach , 2017, Scientific Reports.

[17]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[18]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Joseph Antony,et al.  Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[21]  C. Goldsmith,et al.  Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. , 1988, The Journal of rheumatology.

[22]  Inas A. Yassine,et al.  Automatic localization of the left ventricle in cardiac MRI images using deep learning , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Kebin Jia,et al.  Deep Feature Learning with Discrimination Mechanism for Brain Tumor Segmentation and Diagnosis , 2015, 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP).

[24]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[25]  Lior Shamir,et al.  WND-CHARM: Multi-purpose image classification using compound image transforms , 2008, Pattern Recognit. Lett..

[26]  Noel E. O'Connor,et al.  Automatic Detection of Knee Joints and Quantification of Knee Osteoarthritis Severity Using Convolutional Neural Networks , 2017, MLDM.

[27]  Xiaohong W. Gao,et al.  A deep learning based approach to classification of CT brain images , 2016, 2016 SAI Computing Conference (SAI).

[28]  M. D. Kohn,et al.  Classifications in Brief: Kellgren-Lawrence Classification of Osteoarthritis , 2016, Clinical orthopaedics and related research.

[29]  Jude W. Shavlik,et al.  Transfer Learning via Advice Taking , 2010, Advances in Machine Learning I.

[30]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Wenqing Sun,et al.  Enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data , 2017, Comput. Medical Imaging Graph..

[33]  Sung Wook Baik,et al.  Multi-grade brain tumor classification using deep CNN with extensive data augmentation , 2019, J. Comput. Sci..

[34]  S. Chaturvedi,et al.  Epidemiology of knee osteoarthritis in India and related factors , 2016, Indian journal of orthopaedics.

[35]  R. Kulkarni,et al.  Convolutional neural networks in medical image understanding: a survey , 2021, Evolutionary Intelligence.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Li Fei-Fei,et al.  ImageNet: Constructing a large-scale image database , 2010 .

[38]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.