A Learning Approach for Informative-Frame Selection in US Rheumatology Images

Rheumatoid arthritis (RA) is an autoimmune disorder that causes pain, swelling and stiffness in joints. Nowadays, ultrasound (US) has undergone an increasing role in RA screening since it is a powerful tool to assess disease activity. However, obtaining a good quality US frame is a tricky operator dependent procedure. For this reason, the purpose of this paper is to present a strategy to the automatic selection of informative US rheumatology images by means of Convolutional Neural Networks (CNNs). The proposed method is based on VGG16 and Inception V3 CNNs, which are fine tuned to classify 214 balanced metacarpal head US images (75% used for training and 25% used for testing). A repeated 3 fold cross validation for each CNN was performed. The best results were achieved with VGG16 (area under the curve = 90%). These results support the possibility of applying this method in the actual clinical practice for supporting the diagnostic process and helping young residents’ training.

[1]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[2]  Yoshito Mekada,et al.  Automatic detection of informative frames from wireless capsule endoscopy images , 2010, Medical Image Anal..

[3]  David M. Blei,et al.  Stochastic Gradient Descent as Approximate Bayesian Inference , 2017, J. Mach. Learn. Res..

[4]  Mohammad H. Jafari,et al.  Melanoma detection by analysis of clinical images using convolutional neural network , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  I Cavazzana,et al.  Mechanisms of immune-mediated skin diseases: an overview. , 2006, Clinical and experimental rheumatology.

[6]  Nima Tajbakhsh,et al.  Automatic Assessment of Image Informativeness in Colonoscopy , 2014, ABDI@MICCAI.

[7]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[8]  A. Giovagnoni,et al.  Ultrasound imaging in rheumatoid arthritis , 2019, La radiologia medica.

[9]  Nader Karimi,et al.  Classification of Informative Frames in Colonoscopy Videos Using Convolutional Neural Networks with Binarized Weights , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Elena De Momi,et al.  Learning-based classification of informative laryngoscopic frames , 2018, Comput. Methods Programs Biomed..

[11]  Alexander Behrens.  Creating Panoramic Images for Bladder Fluorescence Endoscopy , 2008 .

[12]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.