Deep Transfer Learning For Abnormality Detection

Deep learning has proven to be effective in learning scenarios with massive training data. However, in many real applications (i.e., abnormality detection), there is a lack of sufficient data to achieve a good deep learning model. Considering the fact that collecting massive labeled training data for a new task is often expensive and time-consuming, it is critical to transfer and reuse the knowledge of the labeled data or simulation data to the new task. To tackle this issue, we propose a deep transfer learning method in this paper. On one hand, we pre-train a basic deep learning model with the related training data. Then, we treat the learning model as a starting point for the current problem to train the new deep learning model. On the other hand, we utilize the Generative Adversarial Nets (GAN) in the learning process to transfer knowledge from simulation data and further enhances the discriminative power of the model. Besides, we apply the proposed method to abnormality detection problem. Experiments in Bone X-Ray anomaly detection show that the proposed deep transfer model can significantly improve performance compared to the basic deep learning model.

[1]  Qihui Wu,et al.  A survey of machine learning for big data processing , 2016, EURASIP Journal on Advances in Signal Processing.

[2]  SongHengjie,et al.  Multi-instance multi-label distance metric learning for genome-wide protein function prediction , 2016 .

[3]  Qingyao Wu,et al.  Multi-instance multi-label distance metric learning for genome-wide protein function prediction , 2016, Comput. Biol. Chem..

[4]  Qingyao Wu,et al.  Multi-Instance Metric Transfer Learning for Genome-Wide Protein Function Prediction , 2017, Scientific Reports.

[5]  Hui Xiong,et al.  A Unified Framework for Metric Transfer Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[6]  Hua-Qing Min,et al.  Label transfer for joint recognition and segmentation of 3D object , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[7]  Doug Young Suh,et al.  Recursive Conditional Generative Adversarial Networks for Video Transformation , 2019, IEEE Access.

[8]  Yuhui Zheng,et al.  Recent Progress on Generative Adversarial Networks (GANs): A Survey , 2019, IEEE Access.

[9]  Aske Plaat,et al.  On the Impact of Data Set Size in Transfer Learning Using Deep Neural Networks , 2016, IDA.

[10]  Ke Zhou,et al.  Feature Selection and Transfer Learning for Alzheimer’s Disease Clinical Diagnosis , 2018, Applied Sciences.

[11]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[12]  Tomas E. Ward,et al.  Generative Adversarial Networks: A Survey and Taxonomy , 2019, ArXiv.

[13]  Ricard Gavaldà,et al.  Generating Synthetic but Plausible Healthcare Record Datasets , 2018, ArXiv.