Fully Integrated Time-Gated 3D Fluorescence Imager for Deep Neural Imaging

Choi, Jaebin; Taal, Adriaan J.; Meng, William; Pollmann, Eric H.; Stanton, John W.; Lee, Changhyuk; Moazeni, Sajjad; Moreaux, Laurent; Roukes, M. L.; Shepard, Kenneth L.

doi:10.1109/tbcas.2020.3008513

Cited by 13 publications

(2 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The advantages of our optical frontend design have relevance beyond intraoperative imaging. Other applications of fluorescence contact imaging include miniaturized implantable imagers for functional brain imaging in free-moving animals [33,45,46] and for in vivo monitoring of therapeutic response [47,48] as well as compact lab-on-chip devices for high-throughput molecular screening and diagnostics [49–52]. In particular, the versatility of our optical frontend allows for a highly transferrable sensor design: adapting a sensor to a new fluorescence application is as simple as epoxying on a new interference filter and changing the excitation source.…”

Section: Discussionmentioning

confidence: 99%

“…Hybrid filters combining absorption and interference filters can improve out-of-band rejection, but still retain the poor pass-band characteristics and limited versatility of absorption filters [30,31]. As an alternative, approaches that avoid conventional filters altogether have also been proposed, such as using on-chip nanoplasmonic structures [32] or time-resolved imaging [21,33], but rely on unconventional inorganic fluorophores with either sufficiently long Stokes shifts or long relaxation times, respectively, to achieve adequate rejection. Inorganic fluorophores lack precedence for FDA approval and are often large (10s-1000s of nm), potentially hindering biodistribution [34].…”

Section: Challenges In Lens-less Fluorescence Image Sensor Designmentioning

confidence: 99%

See 1 more Smart Citation

Multicolor fluorescence microscopy for surgical guidance using a chip-scale imager with a low-NA fiber optic plate and a multi-bandpass interference filter

Roschelle,

Rabbani,

Papageorgiou

et al. 2023

Preprint

View full text Add to dashboard Cite

In curative-intent cancer surgery, intraoperative fluorescence imaging of both diseased and healthy tissue can help to ensure successful removal of all gross and microscopic disease with minimal damage to neighboring critical structures, such as nerves. Current fluorescence-guided surgery (FGS) systems, however, rely on bulky and rigid optics that incur performance-limiting trade-offs between sensitivity and maneuverability. Moreover, many FGS systems are incapable of multiplexed imaging. As a result, clinical FGS is currently limited to millimeter-scale detection of a single fluorescent target. Here we present a scalable, lens-less fluorescence imaging chip, VISION, capable of highly sensitive and multiplexed detection within a compact form factor. Central to VISION is a novel optical frontend design combining a low-numerical-aperture fiber optic plate (LNA-FOP) and a multi-bandpass interference filter, which is directly integrated on a custom-designed image sensor. The LNA-FOP acts as a planar collimator to improve resolution and compensate for the angle-sensitivity of the interference filter, enabling high-resolution and multiplexed fluorescence imaging without lenses. We show VISION is capable of highly sensitive detection of tumor foci of less than 100 cells at near video framerates and, as proof of principle, can simultaneously visualize both tumor and nerves in ex vivo prostate tissue.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Challenges In Lens-less Fluorescence Image Sensor Designmentioning

confidence: 99%

Multicolor fluorescence microscopy for surgical guidance using a chip-scale imager with a low-NA fiber optic plate and a multi-bandpass interference filter

Roschelle,

Rabbani,

Papageorgiou

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

Scanning‐Driven Photon‐Counting 3D Imaging through Scattering Media Via Asynchronous Polarization Modulation

Liu,

Zhang,

Tian

2024

Laser & Photonics Reviews

View full text Add to dashboard Cite

Imaging through scattering media is widely studied in various applications including industrial inspection and autonomous driving. Most existing image sensors always suffer from the aliasing effect that generates a diffused image, leading to an extremely challenging problem in recovering targets of high quality, especially for 3D imaging. In this study, a scanning‐driven photon‐counting 3D imaging system through scattering media is proposed via asynchronous polarization modulation. To eliminate the aliasing effect, we utilize a point‐to‐point scanning strategy is used to illuminate the target and a photon‐counting detector to perceive weak echo signals passing through scattering media. Then, an asynchronous polarization‐modulated ranging method is proposed innovatively based on the Gamma pulse model to calculate the relative depth of the target for 3D imaging with the consideration of scattering media's difference. Therefore, the accuracy of the calculated depth and the generalization capability of the proposed method in real applications can be significantly improved. In addition, a time reshaping method is proposed to cope with the depth ambiguity caused by asynchronous measurements. In the experiment, a variety of strong scattering media is used to verify the excellent imaging capability of the proposed method.

show abstract

Integrated Neurophotonics: Toward Dense Volumetric Interrogation of Brain Circuit Activity—at Depth and in Real Time

Moreaux

Yatsenko

Sacher

et al. 2020

Neuron

Self Cite

View full text Add to dashboard Cite

Fully Integrated Time-Gated 3D Fluorescence Imager for Deep Neural Imaging

Cited by 13 publications

References 33 publications

Multicolor fluorescence microscopy for surgical guidance using a chip-scale imager with a low-NA fiber optic plate and a multi-bandpass interference filter

Multicolor fluorescence microscopy for surgical guidance using a chip-scale imager with a low-NA fiber optic plate and a multi-bandpass interference filter

Scanning‐Driven Photon‐Counting 3D Imaging through Scattering Media Via Asynchronous Polarization Modulation

Integrated Neurophotonics: Toward Dense Volumetric Interrogation of Brain Circuit Activity—at Depth and in Real Time

Contact Info

Product

Resources

About