Patient-Specific 3d Cellular Automata Nodule Growth Synthesis In Lung Cancer Without The Need Of External Data

We propose a novel patient-specific generative approach to simulate the emergence and growth of lung nodules using 3D cellular automata (CA) in computer tomography (CT). Our proposed method can be applied to individual images thus eliminating the need of external images that can contaminate and influence the generative process, a valuable characteristic in the medical domain. Firstly, we employ inpainting to generate pseudo-healthy representations of lung CT scans prior the visible appearance of each lung nodule. Then, for each nodule, we train a 3D CA to simulate nodule growth and progression using the image of that same nodule as a target. After each CA is trained, we generate early versions of each nodule from a single voxel until the growing nodule closely matches the appearance of the original nodule. These synthesized nodules are inserted where the original nodule was located in the pseudo-healthy inpainted versions of the CTs, which provide realistic context to the generated nodule. We utilize the simulated images for data augmentation yielding false positive reduction in a nodule detector. We found statistically significant improvements $(p \lt 0.001)$ in the detection of lung nodules.

[1]  Alexei A. Efros,et al.  Contrastive Learning for Unpaired Image-to-Image Translation , 2020, ECCV.

[2]  Michael Levin,et al.  Growing Neural Cellular Automata , 2020, Distill.

[3]  Anne E Carpenter,et al.  Artificial intelligence and cancer , 2020, Nature Cancer.

[4]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[5]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[6]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[7]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[8]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[9]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[10]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[11]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Jerry F. Magnan,et al.  Lung nodule malignancy classification using only radiologist-quantified image features as inputs to statistical learning algorithms: probing the Lung Image Database Consortium dataset with two statistical learning methods , 2016, Journal of medical imaging.

[14]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[15]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[16]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[17]  Stephen Wolfram,et al.  A New Kind of Science , 2003, Artificial Life.

[18]  G. Cooper The Development and Causes of Cancer , 2000 .