LV‐GAN: A deep learning approach for limited‐view optoacoustic imaging based on hybrid datasets

The optoacoustic imaging (OAI) methods are rapidly evolving for resolving optical contrast in medical imaging applications. In practice, measurement strategies are commonly implemented under limited-view conditions due to oversized image objectives or system design limitations. Data acquired by limited-view detection may impart artifacts and distortions in reconstructed optoacoustic (OA) images. We propose a hybrid data-driven deep learning approach based on generative adversarial network (GAN), termed as LV-GAN, to efficiently recover high quality images from limited-view OA images. Trained on both simulation and experiment data, LV-GAN is found capable of achieving high recovery accuracy even under limited detection angles less than 60° . The feasibility of LV-GAN for artifact removal in biological applications was validated by ex vivo experiments based on two different OAI systems, suggesting high potential of a ubiquitous use of LV-GAN to optimize image quality or system design for different scanners and application scenarios.

[1]  V. Ntziachristos,et al.  Multispectral optoacoustic tomography of muscle perfusion and oxygenation under arterial and venous occlusion: A human pilot study , 2020, Journal of biophotonics.

[2]  Chengxiang Wang,et al.  l0 gradient minimization for limited-view photoacoustic tomography. , 2019, Physics in medicine and biology.

[3]  Feng Gao,et al.  Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo , 2020, Photoacoustics.

[4]  Vasilis Ntziachristos,et al.  Sparsity-based acoustic inversion in cross-sectional multiscale optoacoustic imaging. , 2015, Medical physics.

[5]  Lihong V. Wang,et al.  Ultrasonic-heating-encoded photoacoustic tomography with virtually augmented detection view. , 2015, Optica.

[6]  Lihong V. Wang Multiscale photoacoustic microscopy and computed tomography. , 2009, Nature photonics.

[7]  Lihong V. Wang,et al.  Universal back-projection algorithm for photoacoustic computed tomography. , 2005 .

[8]  Sylvain Gigan,et al.  Improving visibility in photoacoustic imaging using dynamic speckle illumination. , 2013, Optics letters.

[9]  Yajing Liu,et al.  Photoacoustic Molecular Imaging: From Multiscale Biomedical Applications Towards Early-Stage Theranostics. , 2016, Trends in biotechnology.

[10]  Shuxia Guo,et al.  Deep learning a boon for biophotonics? , 2020, Journal of biophotonics.

[11]  Andreas Hauptmann,et al.  Model-Based Learning for Accelerated, Limited-View 3-D Photoacoustic Tomography , 2017, IEEE Transactions on Medical Imaging.

[12]  Xosé Luís Deán-Ben,et al.  Deep learning optoacoustic tomography with sparse data , 2019, Nature Machine Intelligence.

[13]  Leslie Ying,et al.  A New Deep Learning Network for Mitigating Limited-view and Under-sampling Artifacts in Ring-shaped Photoacoustic Tomography , 2020, Comput. Medical Imaging Graph..

[14]  Zhang Rui,et al.  l 0 gradient minimization for limited-view photoacoustic tomography , 2019 .

[15]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[16]  Tong Tong,et al.  Domain Transform Network for Photoacoustic Tomography from Limited-view and Sparsely Sampled Data , 2020, Photoacoustics.

[17]  D. Razansky,et al.  Dynamic particle enhancement in limited-view optoacoustic tomography. , 2015, Optics letters.

[18]  V. Ntziachristos,et al.  Model-based optoacoustic inversions with incomplete projection data. , 2011, Medical physics.

[19]  Jie Tian,et al.  Limited-view photoacoustic imaging based on an iterative adaptive weighted filtered backprojection approach. , 2013, Applied optics.

[20]  E. Rummeny,et al.  Multispectral Optoacoustic Tomography (MSOT) of Human Breast Cancer , 2017, Clinical Cancer Research.

[21]  Vasilis Ntziachristos,et al.  Real-time handheld multispectral optoacoustic imaging. , 2013, Optics letters.

[22]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[23]  Vasilis Ntziachristos,et al.  Advances in real-time multispectral optoacoustic imaging and its applications , 2015, Nature Photonics.

[24]  Vasilis Ntziachristos,et al.  Mesoscopic and macroscopic optoacoustic imaging of cancer. , 2015, Cancer research.

[25]  B T Cox,et al.  k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. , 2010, Journal of biomedical optics.

[26]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[27]  Vasilis Ntziachristos,et al.  Optoacoustic mesoscopy for biomedicine , 2019, Nature Biomedical Engineering.

[28]  A. Ozcan,et al.  Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning , 2018, Nature Biomedical Engineering.

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.