Deep Learning Enhanced Hyperspectral Fluorescence Lifetime Imaging

Acquiring dense high-dimensional optical data in biological applications remains a challenge due to the very low levels of light typically encountered. Single pixel imaging methodologies enable improved detection efficiency in such conditions but are still limited by relatively slow acquisition times. Here, we propose a Deep Learning framework, NetFLICS-CR, which enables fast hyperspectral lifetime imaging for in vivo applications at enhanced resolution, acquisition and processing speeds, without the need of experimental training datasets. NetFLICS-CR reconstructs intensity and lifetime images at 128×128 pixels over 16 spectral channels while reducing the current acquisition times from ∼2.5 hours at 50% compression to ∼3 minutes at 99% compression when using a single-pixel Hyperspectral Macroscopic Fluorescence Lifetime Imaging (HMFLI) system. The potential of the technique is demonstrated in silico, in vitro and in vivo through the monitoring of receptor-ligand interactions in mice liver and bladder and further imaging of intracellular drug delivery of the clinical drug Trastuzumab in live animals bearing HER2-positive breast tumor xenografts.