Transfer Learning in Knowledge-Intensive Tasks: A Test in Healthcare Text Analytics

Transfer learning has been widely utilized in many machine learning applications. However, our literature review suggests that transfer learning, especially relational knowledge transfer learning, has been underutilized in healthcare analytics tasks. In this study, we identify and incorporate three different types of knowledge transfer approaches into a deep learning-based healthcare text analytics model. Our evaluation results suggest that the improved performance can be achieved by incorporating the three relational knowledge transfer learning approaches individually and in combined. This study provides an excellent starting point for studying different types of transfer learning approaches in detail.