Detecting Bone Fracture Using Transfer Learning

Deep learning is a key technology which is used in medical image analysis to enhance informed decision-making. Decision-making models need accuracy for better outcomes. In this chapter, we have presented an application of Transfer Learning (TL) to detect open bone fracture using limited set of images. TL is a kind of self-evolving Deep Learning (DL) technique. In each iteration of TL, the model is improvised based on the knowledge transferred from the previously learned task. One of the research challenges in medical image analysis is the unavailability of large data set publicly. This data set is necessary for deep learning methods. There are many sources of image generation such as X-rays, CT scan, ECG, and Ultrasound. But, these images are not available to researchers due to privacy issue of the patients. In order to overcome this limitation of availability of large data set, we have used augmented data set. A small data set has been augmented to increase the image orientation and count. We have applied DL based Convolution Neural Networks (CNN) on medical images for overcoming the limitation of availability of large data set for training. We have attempted to solve the problem of open bone fracture detection using limited number of images. We have achieved this by applying Speeded Up Robust Features (SURF) extractor on preprocessed radiograph images. SURF is a local feature descriptor and detector. The outcome of SURF extractor is then fed to per-trained models using transfer learning technique. Our proposed system would ease the manual process of identifying the presence and extremity of bone fracture. The proposed approach detects fracture from the given X-ray images with an accuracy of 98.8%. Comparative analysis shows that transfer learning gives significantly comparable results as compared to training model from scratch or even better in some cases. There is a downside of the proposed approach as in some cases, TL is vulnerable to overfitting due to less training data, and in some cases, poor preprocessing might lead to the poor classification of data.

[1]  Anupam Garg,et al.  Bone Fraction Detection using Image Segmentation , 2016 .

[2]  J. Anitha,et al.  Diabetic Retinopathy Diagnosis from Retinal Images Using Modified Hopfield Neural Network , 2018, Journal of Medical Systems.

[3]  Sudhanshu Kulshrestha,et al.  Text Extraction from Bills and Invoices , 2018, 2018 International Conference on Advances in Computing, Communication Control and Networking (ICACCCN).

[4]  Siddhartha Kumar Khaitan,et al.  Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection , 2017 .

[5]  Atul M. Gonsai,et al.  Bone Fracture Detection from X-Ray Image of Human Fingers Using Image Processing , 2018, Advances in Intelligent Systems and Computing.

[6]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[7]  Wu Zhou,et al.  Processing global and local features in convolutional neural network (CNN) and primate visual systems , 2018, Commercial + Scientific Sensing and Imaging.

[8]  Amit Verma,et al.  An Efficient Edge Detection Approach to Provide Better Edge Connectivity for Image Analysis , 2019, IEEE Access.

[9]  Max A. Viergever,et al.  Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities , 2016, MICCAI.

[10]  A. A. Kompiang Oka Sudana,et al.  Bone Fracture Detection using OpenCV. , 2014 .

[11]  Kamil Dimililer,et al.  IBFDS: Intelligent bone fracture detection system , 2017 .

[12]  D. H. Kim,et al.  Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. , 2017, Clinical radiology.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Yu Cao,et al.  Fracture detection in x-ray images through stacked random forests feature fusion , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[15]  Amit Verma,et al.  An improved salient object detection algorithm combining background and foreground connectivity for brain image analysis , 2018, Comput. Electr. Eng..

[16]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Sanjeev Patel,et al.  A New Approach for Vehicle Number Plate Detection , 2018, 2018 Eleventh International Conference on Contemporary Computing (IC3).

[19]  M. S. Mallikarjunaswamy,et al.  Detection of Bone Fracture using Image Processing Methods , 2015 .

[20]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.