Supervised domain adaptation of decision forests: Transfer of models trained in vitro for in vivo intravascular ultrasound tissue characterization

In this paper, we propose a supervised domain adaptation (DA) framework for adapting decision forests in the presence of distribution shift between training (source) and testing (target) domains, given few labeled examples. We introduce a novel method for DA through an error-correcting hierarchical transfer relaxation scheme with domain alignment, feature normalization, and leaf posterior reweighting to correct for the distribution shift between the domains. For the first time we apply DA to the challenging problem of extending in vitro trained forests (source domain) for in vivo applications (target domain). The proof-of-concept is provided for in vivo characterization of atherosclerotic tissues using intravascular ultrasound signals, where presence of flowing blood is a source of distribution shift between the two domains. This potentially leads to misclassification upon direct deployment of in vitro trained classifier, thus motivating the need for DA as obtaining reliable in vivo training labels is often challenging if not infeasible. Exhaustive validations and parameter sensitivity analysis substantiate the reliability of the proposed DA framework and demonstrates improved tissue characterization performance for scenarios where adaptation is conducted in presence of only a few examples. The proposed method can thus be leveraged to reduce annotation costs and improve computational efficiency over conventional retraining approaches.

[1]  P. Shankar Ultrasonic tissue characterization using a generalized Nakagami model , 2001, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[4]  Nassir Navab,et al.  Joint learning of ultrasonic backscattering statistical physics and signal confidence primal for characterizing atherosclerotic plaques using intravascular ultrasound , 2014, Medical Image Anal..

[5]  E. Tuzcu,et al.  Coronary Plaque Classification With Intravascular Ultrasound Radiofrequency Data Analysis , 2002, Circulation.

[6]  Sumit Chopra,et al.  DLID: Deep Learning for Domain Adaptation by Interpolating between Domains , 2013 .

[7]  Marta Mejail,et al.  Transfer Learning Decision Forests for Gesture Recognition , 2017, Gesture Recognition.

[8]  C. Gatta,et al.  Fusing in-vitro and in-vivo intravascular ultrasound data for plaque characterization , 2010, The International Journal of Cardiovascular Imaging.

[9]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[10]  Christophe G. Giraud-Carrier,et al.  Transfer Learning in Decision Trees , 2007, 2007 International Joint Conference on Neural Networks.

[11]  Nassir Navab,et al.  A new approach for improving coronary plaque component analysis based on intravascular ultrasound images. , 2010, Ultrasound in medicine & biology.

[12]  Elisa E. Konofagou,et al.  Challenges in Atherosclerotic Plaque Characterization With Intravascular Ultrasound (IVUS): From Data Collection to Classification , 2008, IEEE Transactions on Information Technology in Biomedicine.

[13]  Qiang Yang,et al.  Transfer Learning via Dimensionality Reduction , 2008, AAAI.

[14]  Nassir Navab,et al.  Confidence estimation in IVUS radio-frequency data with random walks , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[15]  Arna van Engelen,et al.  Multi-Center MRI Carotid Plaque Component Segmentation Using Feature Normalization and Transfer Learning , 2015, IEEE Transactions on Medical Imaging.

[16]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[17]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[18]  Nassir Navab,et al.  A State-of-the-Art Review on Segmentation Algorithms in Intravascular Ultrasound (IVUS) Images , 2012, IEEE Transactions on Information Technology in Biomedicine.

[19]  P. Bossuyt,et al.  The diagnostic odds ratio: a single indicator of test performance. , 2003, Journal of clinical epidemiology.

[20]  Joachim M. Buhmann,et al.  Agnostic Domain Adaptation , 2011, DAGM-Symposium.

[21]  Shashidhar Sathyanarayana,et al.  Characterisation of atherosclerotic plaque by spectral similarity of radiofrequency intravascular ultrasound signals. , 2009, EuroIntervention : journal of EuroPCR in collaboration with the Working Group on Interventional Cardiology of the European Society of Cardiology.

[22]  Sebastian Nowozin,et al.  Decision Jungles: Compact and Rich Models for Classification , 2013, NIPS.

[23]  Petia Radeva,et al.  Rayleigh Mixture Model for Plaque Characterization in Intravascular Ultrasound , 2011, IEEE Transactions on Biomedical Engineering.

[24]  Daoqiang Zhang,et al.  Domain Transfer Learning for MCI Conversion Prediction , 2015, IEEE Transactions on Biomedical Engineering.

[25]  H. Shimodaira,et al.  Improving predictive inference under covariate shift by weighting the log-likelihood function , 2000 .

[26]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[27]  Joachim Denzler,et al.  Learning with Few Examples by Transferring Feature Relevance , 2009, DAGM-Symposium.

[28]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[29]  Horst Bischof,et al.  Semi-Supervised Random Forests , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Peter Mountney,et al.  Real-time ultrasound transducer localization in fluoroscopy images by transfer learning from synthetic training data , 2014, Medical Image Anal..

[31]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[32]  Tevfik F Ismail,et al.  A histological and clinical comparison of new and conventional integrated backscatter intravascular ultrasound (IB-IVUS). , 2012, Circulation journal : official journal of the Japanese Circulation Society.

[33]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[34]  Amin Katouzian,et al.  Challenges in tissue characterization from backscattered intravascular ultrasound signals , 2007, SPIE Medical Imaging.

[35]  Søren Hauberg,et al.  Grassmann Averages for Scalable Robust PCA , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Daoqiang Zhang,et al.  Domain Transfer Learning for MCI Conversion Prediction , 2012, MICCAI.

[37]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[38]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[39]  Vincent Lemaire,et al.  Learning with few examples: An empirical study on leading classifiers , 2011, The 2011 International Joint Conference on Neural Networks.

[40]  P. O'Gara,et al.  Follow-up on ABIM maintenance of certification. , 2015, Journal of the American College of Cardiology.

[41]  Tinne Tuytelaars,et al.  Joint cross-domain classification and subspace learning for unsupervised adaptation , 2014, Pattern Recognit. Lett..

[42]  Nassir Navab,et al.  Iterative Self-Organizing Atherosclerotic Tissue Labeling in Intravascular Ultrasound Images and Comparison With Virtual Histology , 2012, IEEE Transactions on Biomedical Engineering.

[43]  Pascal Fua,et al.  Domain Adaptation for Microscopy Imaging , 2015, IEEE Transactions on Medical Imaging.

[44]  Hal Daumé,et al.  Frustratingly Easy Domain Adaptation , 2007, ACL.

[45]  Alexei A. Efros,et al.  Unbiased look at dataset bias , 2011, CVPR 2011.

[46]  Gerhard Widmer,et al.  Learning in the Presence of Concept Drift and Hidden Contexts , 1996, Machine Learning.

[47]  Gary S. Mintz,et al.  Clinical utility of intravascular imaging and physiology in coronary artery disease. , 2014, Journal of the American College of Cardiology.

[48]  Bradley E Treeby,et al.  Measurement of the ultrasound attenuation and dispersion in whole human blood and its components from 0-70 MHz. , 2011, Ultrasound in medicine & biology.

[49]  Andrew F. Laine,et al.  Methods in Atherosclerotic Plaque Characterization Using Intravascular Ultrasound Images and Backscattered Signals , 2011 .

[50]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[51]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[53]  Martin O Culjat,et al.  A review of tissue substitutes for ultrasound imaging. , 2010, Ultrasound in medicine & biology.

[54]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[55]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[56]  Marleen de Bruijne,et al.  Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols , 2015, IEEE Trans. Medical Imaging.

[57]  Barbara Caputo,et al.  Learning Categories From Few Examples With Multi Model Knowledge Transfer , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[59]  Sergio Escalera,et al.  Intravascular Ultrasound Tissue Characterization with Sub-class Error-Correcting Output Codes , 2009, J. Signal Process. Syst..

[60]  Ullrich Köthe,et al.  On Oblique Random Forests , 2011, ECML/PKDD.