A Peer-to-peer Federated Continual Learning Network for Improving CT Imaging from Multiple Institutions

Deep learning techniques have been widely used in computed tomography (CT) but require large data sets to train networks. Moreover, data sharing among multiple institutions is limited due to data privacy constraints, which hinders the development of high-performance DL-based CT imaging models from multi-institutional collaborations. Federated learning (FL) strategy is an alternative way to train the models without centralizing data from multi-institutions. In this work, we propose a novel peer-to-peer federated continual learning strategy to improve low-dose CT imaging performance from multiple institutions. The newly proposed method is called peer-to-peer continual FL with intermediate controllers, i.e., icP2P-FL. Specifically, different from the conventional FL model, the proposed icP2P-FL does not require a central server that coordinates training information for a global model. In the proposed icP2P-FL method, the peer-to-peer federated continual learning is introduced wherein the DL-based model is continually trained one client after another via model transferring and inter institutional parameter sharing due to the common characteristics of CT data among the clients. Furthermore, an intermediate controller is developed to make the overall training more flexible. Numerous experiments were conducted on the AAPM low-dose CT Grand Challenge dataset and local datasets, and the experimental results showed that the proposed icP2P-FL method outperforms the other comparative methods both qualitatively and quantitatively, and reaches an accuracy similar to a model trained with pooling data from all the institutions.

[1]  Jianhua Ma,et al.  Semi-centralized federated learning network for low-dose CT imaging , 2023, Medical Imaging.

[2]  J. Duncan,et al.  Federated Transfer Learning for Low-Dose PET Denoising: A Pilot Study With Simulated Heterogeneous Data , 2023, IEEE Transactions on Radiation and Plasma Medical Sciences.

[3]  Yi Zhang,et al.  Hypernetwork-based Personalized Federated Learning for Multi-Institutional CT Imaging , 2022, ArXiv.

[4]  S. Avestimehr,et al.  Federated Learning of Generative Image Priors for MRI Reconstruction , 2022, IEEE Transactions on Medical Imaging.

[5]  H. Fu,et al.  Specificity-Preserving Federated Learning for MR Image Reconstruction , 2021, IEEE Transactions on Medical Imaging.

[6]  Chuhan Wu,et al.  Communication-efficient federated learning via knowledge distillation , 2021, Nature Communications.

[7]  Wei Liu,et al.  Decentralized Federated Learning: Balancing Communication and Computing Costs , 2021, IEEE Transactions on Signal and Information Processing over Networks.

[8]  Zoltán Nochta,et al.  An Approach for Peer-to-Peer Federated Learning , 2021, 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W).

[9]  Peter B. Walker,et al.  Federated Learning for Healthcare Informatics , 2019, Journal of Healthcare Informatics Research.

[10]  Tinne Tuytelaars,et al.  A Continual Learning Survey: Defying Forgetting in Classification Tasks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Natalia Díaz Rodríguez,et al.  Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges , 2019, Inf. Fusion.

[12]  Zhaoying Bian,et al.  Optimizing a Parameterized Plug-and-Play ADMM for Iterative Low-Dose CT Reconstruction , 2019, IEEE Transactions on Medical Imaging.

[13]  Spyridon Bakas,et al.  Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentation , 2018, BrainLes@MICCAI.

[14]  Jianhua Ma,et al.  Radon inversion via deep learning , 2018, Medical Imaging.

[15]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[16]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[17]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Zhaoying Bian,et al.  A Simple Low-Dose X-Ray CT Simulation From High-Dose Scan , 2015, IEEE Transactions on Nuclear Science.

[20]  Yi Zhang,et al.  Degradation of CT Low-Contrast Spatial Resolution Due to the Use of Iterative Reconstruction and Reduced Dose Levels. , 2015, Radiology.

[21]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .