Computer-assisted liver graft steatosis assessment via learning-based texture analysis

PurposeFast and accurate graft hepatic steatosis (HS) assessment is of primary importance for lowering liver dysfunction risks after transplantation. Histopathological analysis of biopsied liver is the gold standard for assessing HS, despite being invasive and time consuming. Due to the short time availability between liver procurement and transplantation, surgeons perform HS assessment through clinical evaluation (medical history, blood tests) and liver texture visual analysis. Despite visual analysis being recognized as challenging in the clinical literature, few efforts have been invested to develop computer-assisted solutions for HS assessment. The objective of this paper is to investigate the automatic analysis of liver texture with machine learning algorithms to automate the HS assessment process and offer support for the surgeon decision process.MethodsForty RGB images of forty different donors were analyzed. The images were captured with an RGB smartphone camera in the operating room (OR). Twenty images refer to livers that were accepted and 20 to discarded livers. Fifteen randomly selected liver patches were extracted from each image. Patch size was $$100\times 100$$100×100. This way, a balanced dataset of 600 patches was obtained. Intensity-based features (INT), histogram of local binary pattern ($$H_{{\mathrm{LBP}}_{riu2}}$$HLBPriu2), and gray-level co-occurrence matrix ($$F_{\mathrm{GLCM}}$$FGLCM) were investigated. Blood-sample features (Blo) were included in the analysis, too. Supervised and semisupervised learning approaches were investigated for feature classification. The leave-one-patient-out cross-validation was performed to estimate the classification performance.ResultsWith the best-performing feature set ($$H_{{\mathrm{LBP}}_{riu2}}+\hbox {INT}+\hbox {Blo}$$HLBPriu2+INT+Blo) and semisupervised learning, the achieved classification sensitivity, specificity, and accuracy were 95, 81, and 88%, respectively.ConclusionsThis research represents the first attempt to use machine learning and automatic texture analysis of RGB images from ubiquitous smartphone cameras for the task of graft HS assessment. The results suggest that is a promising strategy to develop a fully automatic solution to assist surgeons in HS assessment inside the OR.

[1]  Nicolas Pichon,et al.  Controlled Attenuation Parameter and Liver Stiffness Measurements for Steatosis Assessment in the Liver Transplant of Brain Dead Donors , 2015, Transplantation.

[2]  Metin Nafi Gürcan,et al.  Quantification of liver fat: A comprehensive review , 2016, Comput. Biol. Medicine.

[3]  M. Nystrom,et al.  MRI steatosis grading: development and initial validation of a color mapping system. , 2012, AJR. American journal of roentgenology.

[4]  Su Zhang,et al.  Lesion detection of electronic gastroscope images based on multiscale texture feature , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[5]  Guy Cazuguel,et al.  Multiple-Instance Learning for Medical Image and Video Analysis , 2017, IEEE Reviews in Biomedical Engineering.

[6]  P A Clavien,et al.  Fatty Liver in Liver Transplantation and Surgery , 2001, Seminars in liver disease.

[7]  A. Demetris,et al.  Enhancing the Value of Histopathological Assessment of Allograft Biopsy Monitoring. , 2019, Transplantation.

[8]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[9]  Pan Liang,et al.  A computer-aided lesion diagnose method based on gastroscopeimage , 2012, 2012 IEEE International Conference on Information and Automation.

[10]  S. Knechtle,et al.  The predictive value of donor liver biopsies for the development of primary nonfunction after orthotopic liver transplantation. , 1991, Transplantation.

[11]  Luc Soler,et al.  On-patient see-through augmented reality based on visual SLAM , 2016, International Journal of Computer Assisted Radiology and Surgery.

[12]  G. Klintmalm,et al.  THE USE OF mARGINAL DONORS FOR LIVER TRANSPLANTATION A RETROSPECTIVE STUDY OF 365 LIVER DONORS 1,2 , 1992, Transplantation.

[13]  Nicolai Schoch,et al.  Surgical Data Science: Enabling Next-Generation Surgery , 2017, ArXiv.

[14]  David Lechaux,et al.  Technique du prélèvement « multiorganes » : cœur–foie–reins ☆ , 2004 .

[15]  Kenichi Takeda,et al.  Accuracy of computer-aided diagnosis based on narrow-band imaging endocytoscopy for diagnosing colorectal lesions: comparison with experts , 2017, International Journal of Computer Assisted Radiology and Surgery.

[16]  Ali Zarrinpar,et al.  Assessment of hepatic steatosis by transplant surgeon and expert pathologist: A prospective, double‐blind evaluation of 201 donor livers , 2013, Liver transplantation : official publication of the American Association for the Study of Liver Diseases and the International Liver Transplantation Society.

[17]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[21]  Sara Moccia,et al.  Confident texture-based laryngeal tissue classification for early stage diagnosis support , 2017, Journal of medical imaging.

[22]  K. Batts,et al.  Use of fatty donor liver is associated with diminished early patient and graft survival. , 1996, Transplantation.

[23]  S J Wigmore,et al.  Use of bioelectrical impedance analysis to assess liver steatosis. , 2009, Transplantation proceedings.

[24]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[25]  Max Q.-H. Meng,et al.  Texture analysis for ulcer detection in capsule endoscopy images , 2009, Image Vis. Comput..

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Lena Maier-Hein,et al.  Tissue classification for laparoscopic image understanding based on multispectral texture analysis , 2017, Journal of medical imaging.

[28]  Lena Maier-Hein,et al.  Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy , 2017, IEEE Transactions on Biomedical Engineering.

[29]  Russell H. Taylor,et al.  Surgical data science for next-generation interventions , 2017, Nature Biomedical Engineering.

[30]  Philippe Revel,et al.  Noninvasive assessment of macrovesicular liver steatosis in cadaveric donors based on computed tomography liver‐to‐spleen attenuation ratio , 2015, Liver transplantation : official publication of the American Association for the Study of Liver Diseases and the International Liver Transplantation Society.

[31]  Haishan Zeng,et al.  Accurate assessment of liver steatosis in animal models using a high throughput Raman fiber optic probe. , 2015, The Analyst.

[32]  Ming Yang,et al.  Large-scale image classification: Fast feature extraction and SVM training , 2011, CVPR 2011.

[33]  Barbara Bigliardi,et al.  Artificial Intelligence: A New Tool in Operating Room Management. Role of Machine Learning Models in Operating Room Optimization , 2019, Journal of Medical Systems.

[34]  B. Koneru,et al.  Hepatic steatosis and liver transplantation current clinical and experimental perspectives. , 2002, Transplantation.

[35]  M. Makuuchi,et al.  Living-donor liver transplantation: 12 years of experience in Asia , 2003, Transplantation.