Continual Active Learning for Efficient Adaptation of Machine Learning Models to Changing Image Acquisition

Imaging in clinical routine is subject to changing scanner protocols, hardware, or policies in a typically heterogeneous set of acquisition hardware. Accuracy and reliability of deep learning models suffer from those changes as data and targets become inconsistent with their initial static training set. Continual learning can adapt to a continuous data stream of a changing imaging environment. Here, we propose a method for continual active learning on a data stream of medical images. It recognizes shifts or additions of new imaging sources domains -, adapts training accordingly, and selects optimal examples for labelling. Model training has to cope with a limited labelling budget, resembling typical real world scenarios. We demonstrate our method on T1-weighted magnetic resonance images from three different scanners with the task of brain age estimation. Results demonstrate that the proposed method outperforms naive active learning while requiring less manual labelling.

[1]  Rahul Venkataramani,et al.  Towards Continuous Domain Adaptation For Medical Imaging , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[2]  Georgios Sakas,et al.  What is Wrong with Continual Learning in Medical Image Segmentation? , 2020, ArXiv.

[3]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[4]  Marc'Aurelio Ranzato,et al.  Gradient Episodic Memory for Continual Learning , 2017, NIPS.

[5]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[6]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[7]  Georg Langs,et al.  Dynamic memory to alleviate catastrophic forgetting in continuous learning settings , 2020, MICCAI.

[8]  Larry S. Davis,et al.  ACE: Adapting to Changing Environments for Semantic Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Bernhard Kainz,et al.  A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis , 2019, Medical Image Anal..

[10]  Daniel S. Marcus,et al.  OASIS-3: Longitudinal Neuroimaging, Clinical, and Cognitive Dataset for Normal Aging and Alzheimer Disease , 2019 .

[11]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[12]  Oleg S. Pianykh,et al.  Continuous Learning AI in Radiology: Implementation Principles and Early Applications. , 2020, Radiology.

[13]  Derek Hoiem,et al.  Learning without Forgetting , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Philipp Fürnstahl,et al.  Learn the new, keep the old: Extending pretrained models with new anatomy and images , 2018, MICCAI.

[15]  Mohammad Havaei,et al.  Continuous Domain Adaptation with Variational Domain-Agnostic Feature Replay , 2020, ArXiv.

[16]  Mark Jenkinson,et al.  Unlearning Scanner Bias for MRI Harmonisation in Medical Image Segmentation , 2020, MIUA.

[17]  Zongwei Zhou,et al.  Models Genesis , 2020, Medical Image Anal..

[18]  Ping Li,et al.  Very sparse stable random projections for dimension reduction in lα (0 <α ≤ 2) norm , 2007, KDD '07.

[19]  Axel Saalbach,et al.  Continual Learning for Domain Adaptation in Chest X-ray Classification , 2020, MIDL.