Applications of Machine Learning in time-domain Fluorescence Lifetime Imaging: a Review

Abstract

Many medical imaging modalities have benefited from recent advances in Machine Learning (ML), specifically in deep learning, such as neural networks.
Computers can be trained to investigate and enhance medical imaging methods without using valuable human resources.
In recent years, Fluorescence Lifetime Imaging (FLIm) has received increasing attention from the ML community. 
FLIm goes beyond conventional spectral imaging, providing additional lifetime information, and could lead to optical histopathology supporting real-time diagnostics.
However, most current studies do not use the full potential of machine/deep learning models. As a developing image modality, FLIm data are not easily obtainable, which, coupled with an absence of standardisation, is pushing back the research to develop models which could advance automated diagnosis and help promote FLIm.

In this paper, we describe recent developments that improve FLIm image quality, specifically time-domain systems, and we summarise sensing, signal-to-noise analysis and the advances in registration and low-level tracking. We review the two main applications of ML for FLIm: lifetime estimation and image analysis through classification and segmentation. 
We suggest a course of action to improve the quality of ML studies applied to FLIm. 
Our final goal is to promote FLIm and attract more ML practitioners to explore the potential of lifetime imaging.

Pioglitazone Phases and Metabolic Effects in Nanoparticle-Treated Cells Analyzed via Rapid Visualization of FLIM Images

“…Fluorescence lifetime analysis (FLA) has demonstrated significant potential for noninvasive, real-time analysis across a diverse range of compounds and materials. Specifically within biomedicine, it has been applied in several key areas, like (i) measurement of intracellular biochemical parameters [1][2][3][4][5][6][7], (ii) resolving the physical state of encapsulated fluorescent drugs [8][9][10][11][12][13][14][15][16][17][18]; and (iii) biomedical diagnostics and neuroscience research [19][20][21][22][23][24][25][26][27].…”