Fluorescence lifetime imaging (FLI) provides unique quantitative information in biomedical and molecular biology studies but relies on complex data-fitting techniques to derive the quantities of interest. Herein, we propose a fit-free approach in FLI image formation that is based on deep learning (DL) to quantify fluorescence decays simultaneously over a whole image and at fast speeds. We report on a deep neural network (DNN) architecture, named fluorescence lifetime imaging network (FLI-Net) that is designed and trained for different classes of experiments, including visible FLI and near-infrared (NIR) FLI microscopy (FLIM) and NIR gated macroscopy FLI (MFLI). FLI-Net outputs quantitatively the spatially resolved lifetime-based parameters that are typically employed in the field. We validate the utility of the FLI-Net framework by performing quantitative microscopic and preclinical lifetime-based studies across the visible and NIR spectra, as well as across the 2 main data acquisition technologies. These results demonstrate that FLI-Net is well suited to accurately quantify complex fluorescence lifetimes in cells and, in real time, in intact animals without any parameter settings. Hence, FLI-Net paves the way to reproducible and quantitative lifetime studies at unprecedented speeds, for improved dissemination and impact of FLI in many important biomedical applications ranging from fundamental discoveries in molecular and cellular biology to clinical translation.

Spectrally resolved fluorescence lifetime imaging1–3 and spatial multiplexing1,4,5 have offered information content and collection-efficiency boosts in microscopy, but efficient implementations for macroscopic applications are still lacking. An imaging platform based on time-resolved structured light and hyperspectral single-pixel detection has been developed to perform quantitative macroscopic fluorescence lifetime imaging (MFLI) over a large field of view (FOV) and multiple spectral bands simultaneously. The system makes use of three digital micromirror device (DMD)-based spatial light modulators (SLMs) to generate spatial optical bases and reconstruct N by N images over 16 spectral channels with a time-resolved capability (~40 ps temporal resolution) using fewer than N2 optical measurements. We demonstrate the potential of this new imaging platform by quantitatively imaging near-infrared (NIR) Förster resonance energy transfer (FRET) both in vitro and in vivo. The technique is well suited for quantitative hyperspectral lifetime imaging with a high sensitivity and paves the way for many important biomedical applications.

We introduce a simple new approach for time‐resolved multiplexed analysis of complex systems using near‐infrared (NIR) dyes, applicable to in vitro and in vivo studies. We show that fast and precise in vitro quantification of NIR fluorophores' short (subnanosecond) lifetime and stoichiometry can be done using phasor analysis, a computationally efficient and user‐friendly representation of complex fluorescence intensity decays obtained with pulsed laser excitation and time‐gated camera imaging. We apply this approach to the study of binding equilibria by Förster resonant energy transfer using two different model systems: primary/secondary antibody binding in vitro and ligand/receptor binding in cell cultures. We then extend it to dynamic imaging of the pharmacokinetics of transferrin engagement with the transferrin receptor in live mice, elucidating the kinetics of differential transferrin accumulation in specific organs, straightforwardly differentiating specific from nonspecific binding. Our method, implemented in a freely‐available software, has the advantage of time‐resolved NIR imaging, including better tissue penetration and background‐free imaging, but simplifies and considerably speeds up data processing and interpretation, while remaining quantitative. These advances make this method attractive and of broad applicability for in vitro and in vivo molecular imaging and could be extended to applications as diverse as image‐guided surgery or optical tomography.

Maintaining an intact tumor environment is critical for quantitation of receptor-ligand engagement in a targeted drug development pipeline. However, measuring receptor-ligand engagement in vivo and non-invasively in preclinical settings is extremely challenging. We found that quantitation of intracellular receptor-ligand binding can be achieved using whole-body macroscopic lifetime-based Förster Resonance Energy Transfer (FRET) imaging in intact, live animals bearing tumor xenografts. We determined that FRET levels report on ligand binding to transferrin receptors conversely to raw fluorescence intensity. FRET levels in heterogeneous tumors correlate with intracellular ligand binding but strikingly, not with ubiquitously used ex vivo receptor expression assessment. Hence, MFLI-FRET provides a direct measurement of systemic delivery, target availability and intracellular drug delivery in preclinical studies. Here, we have used MFLI to measure FRET longitudinally in intact and live animals. MFLI-FRET is well-suited for guiding the development of targeted drug therapy in heterogeneous tumors in intact, live small animals.

Rationale: Following an ever-increased focus on personalized medicine, there is a continuing need to develop preclinical molecular imaging modalities to guide the development and optimization of targeted therapies. Near-Infrared (NIR) Macroscopic Fluorescence Lifetime Förster Resonance Energy Transfer (MFLI-FRET) imaging offers a unique method to robustly quantify receptor-ligand engagement in live intact animals, which is critical to assess the delivery efficacy of therapeutics. However, to date, non-invasive imaging approaches that can simultaneously measure cellular drug delivery efficacy and metabolic response are lacking. A major challenge for the implementation of concurrent optical and MFLI-FRET in vivo whole-body preclinical imaging is the spectral crowding and cross-contamination between fluorescent probes. Methods: We report on a strategy that relies on a dark quencher enabling simultaneous assessment of receptor-ligand engagement and tumor metabolism in intact live mice. Several optical imaging approaches, such as in vitro NIR FLI microscopy (FLIM) and in vivo wide-field MFLI, were used to validate a novel donor-dark quencher FRET pair. IRDye 800CW 2-deoxyglucose (2-DG) imaging was multiplexed with MFLI-FRET of NIR-labeled transferrin FRET pair (Tf-AF700/Tf-QC-1) to monitor tumor metabolism and probe uptake in breast tumor xenografts in intact live nude mice. Immunohistochemistry was used to validate in vivo imaging results. Results: First, we establish that IRDye QC-1 (QC-1) is an effective NIR dark acceptor for the FRET-induced quenching of donor Alexa Fluor 700 (AF700). Second, we report on simultaneous in vivo imaging of the metabolic probe 2-DG and MFLI-FRET imaging of Tf-AF700/Tf-QC-1 uptake in tumors. Such multiplexed imaging revealed an inverse relationship between 2-DG uptake and Tf intracellular delivery, suggesting that 2-DG signal may predict the efficacy of intracellular targeted delivery. Conclusions: Overall, our methodology enables for the first time simultaneous non-invasive monitoring of intracellular drug delivery and metabolic response in preclinical studies.