Computer aided diagnosis of obesity based on thermal imaging using various convolutional neural networks

Abstract Objectives The study aims at the following: i) To construct a custom Deep Learning Network for classifying the thermal images of abdomen, forearm and shank regions into obese and normal cases ii) To compare the performance of the proposed CNN with some of the state-of-the-art pre-trained CNN and Machine Learning models in detection of obesity. Methods Fifty healthy subjects along with fifty other age cum sex matched obese subjects were included in the study. The mean skin surface temperature was measured in abdomen, shank and forearm region for normal and obese subjects. After data augmentation, the images are fed to the proposed CNN and pre-trained networks for training, validation and classification of normal and obese thermograms. Results Among the ROI studied, the abdomen region exhibited a high temperature difference of 4.703 % between the normal and obese compared to other regions. The proposed custom network-2 provided an overall accuracy of 92 %, area under the curve (AUC) value of 0.948 whereas the pre-trained model VGG16 net produced an accuracy of 79 % and AUC value of 0.90 for discrimination into obese and normal thermograms. Conclusions Hence, the deep learning system based on custom CNN provided a reliable classification performance to identify the occurrence of obesity in test subjects. The experimental analysis showed that custom CNN network-2 provided a commendable degree of accuracy in classification of normal and obese subjects from the thermal images. Thus, the trained Custom-2 CNN model can be used for computer aided screening of test subjects for obesity detection.

[1]  Stefano Soatto,et al.  Domain-size pooling in local descriptors: DSP-SIFT , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Nadia Mammone,et al.  A deep CNN approach to decode motor preparation of upper limbs from time-frequency maps of EEG signals at source level , 2020, Neural Networks.

[3]  Hongfei Lin,et al.  Deep Transfer Learning for Modality Classification of Medical Images , 2017, Inf..

[4]  Shivajirao M. Jadhav,et al.  Deep convolutional neural network based medical image classification for disease diagnosis , 2019, Journal of Big Data.

[5]  H. Lukaski,et al.  Validity of segmental multiple-frequency bioelectrical impedance analysis to estimate body composition of adults across a range of body mass indexes. , 2009, Nutrition.

[6]  Roberto Vettor,et al.  Infrared thermography for indirect assessment of activation of brown adipose tissue in lean and obese male subjects , 2016, Physiological measurement.

[7]  U. Snekhalatha,et al.  Thermal Imaging of Abdomen in Evaluation of Obesity: A Comparison with Body Composition Analyzer––A Preliminary Study , 2018, Proceedings of the International Conference on ISMAC in Computational Vision and Bio-Engineering 2018 (ISMAC-CVB).

[8]  Zheng Wang,et al.  Application of neural network based on SIFT local feature extraction in medical image classification , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[9]  B. Guy-grand,et al.  Dual x-ray absorptiometry, bioelectrical impedance, and near infrared interactance in obese women. , 2001, Medicine and science in sports and exercise.

[10]  Jordan Yap,et al.  Multimodal skin lesion classification using deep learning , 2018, Experimental dermatology.

[11]  P. Schrauwen,et al.  Intramyocellular Lipid Content in Human Skeletal Muscle , 2006, Obesity.

[12]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[13]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[14]  Julie Delon,et al.  SIFT-AID: Boosting Sift With an Affine Invariant Descriptor Based on Convolutional Neural Networks , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[15]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[16]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[17]  Ian R Pateyjohns,et al.  Comparison of Three Bioelectrical Impedance Methods with DXA in Overweight and Obese Men , 2006, Obesity.

[18]  A. L'Abbate,et al.  Multimodal Imaging for the Detection of Brown Adipose Tissue Activation in Women: A Pilot Study Using NIRS and Infrared Thermography , 2017, Journal of healthcare engineering.

[19]  Yanpeng Cao,et al.  A new method of infrared thermography for quantification of brown adipose tissue activation in healthy adults (TACTICAL): a randomized trial , 2016, The Journal of Physiological Sciences.

[20]  Zhipeng Jia,et al.  Constrained Deep Weak Supervision for Histopathology Image Segmentation , 2017, IEEE Transactions on Medical Imaging.

[21]  Pradip Sircar,et al.  Seizures classification based on higher order statistics and deep neural network , 2020, Biomed. Signal Process. Control..

[22]  Jasjit S Suri,et al.  A Review on a Deep Learning Perspective in Brain Cancer Classification , 2019, Cancers.

[23]  Celina Imielinska,et al.  Adipose tissue quantification by imaging methods: a proposed classification. , 2003, Obesity research.

[24]  Henning Müller,et al.  Bag-of-Colors for Biomedical Document Image Classification , 2012, MCBR-CDS.

[25]  Guoyan Zheng,et al.  3D U-net with Multi-level Deep Supervision: Fully Automatic Segmentation of Proximal Femur in 3D MR Images , 2017, MLMI@MICCAI.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Who Consultation on Obesity Obesity: preventing and managing the global epidemic. Report of a WHO consultation. , 2000, World Health Organization technical report series.

[28]  Fabio A. González,et al.  Histopathology Image Classification Using Bag of Features and Kernel Functions , 2009, AIME.

[29]  R. Soder,et al.  Quantification of Abdominal Fat in Obese and Healthy Adolescents Using 3 Tesla Magnetic Resonance Imaging and Free Software for Image Analysis , 2017, PloS one.

[30]  Hong Liu,et al.  Applying a deep learning based CAD scheme to segment and quantify visceral and subcutaneous fat areas from CT images , 2017, Medical Imaging.

[31]  Hoo-Chang Hoo-Chang Shin Shin,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, Ieee Transactions on Medical Imaging.

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Hao Jiang,et al.  Image indexing and content analysis in children’s picture books using a large-scale database , 2019, Multimedia Tools and Applications.

[34]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.

[35]  Krystian Mikolajczyk,et al.  Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[36]  Z. Jalil,et al.  A Pilot Study of Infrared Thermography Based Assessment of Local Skin Temperature Response in Overweight and Lean Women during Oral Glucose Tolerance Test , 2019, Journal of clinical medicine.

[37]  S. Das,et al.  Assessment tools in obesity — Psychological measures, diet, activity, and body composition , 2012, Physiology & Behavior.

[38]  D. Wagner,et al.  Ultrasound as a Tool to Assess Body Fat , 2013, Journal of obesity.