High Speed Three Dimensional Tracking of Swimming Cell by Synchronous Modulation Between TeCE Camera and TAG Lens

Yamato, Kazuki; Chiba, Hiroyuki; Oku, Hiromasa

doi:10.1109/lra.2020.2969911

Cited by 9 publications

(6 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, external disturbances, noises, and imaging errors can produce inaccurate depth when the imaging field moves greatly. To alleviate this problem, some optimized template-matching criteria have been proposed based on template similarity score 137 , 138 , three frames 18 , and centroid coordinates 139 . With the depth information obtained, the microinjection efficiency is greatly improved, with experimental results showing that more than 1500 cells can be processed automatically within 1 hour 18 .…”

Section: Control Methodsmentioning

confidence: 99%

Advanced tools and methods for single-cell surgery

et al. 2022

View full text Add to dashboard Cite

Highly precise micromanipulation tools that can manipulate and interrogate cell organelles and components must be developed to support the rapid development of new cell-based medical therapies, thereby facilitating in-depth understanding of cell dynamics, cell component functions, and disease mechanisms. This paper presents a literature review on micro/nanomanipulation tools and their control methods for single-cell surgery. Micromanipulation methods specifically based on laser, microneedle, and untethered micro/nanotools are presented in detail. The limitations of these techniques are also discussed. The biological significance and clinical applications of single-cell surgery are also addressed in this paper.

show abstract

Section: Control Methodsmentioning

confidence: 99%

Advanced tools and methods for single-cell surgery

et al. 2022

View full text Add to dashboard Cite

show abstract

“…In a three-frame template matching method [151], a current source image was compared with Frames 1 and 3 to check if the micropipette touched and scratched the substrate, as illustrated in Figure 8b. In addition, the centroid coordinates of the cells in the central template are also compared with the surrounding frame to identify the paired target [152]. However, template matching has some drawbacks.…”

Section: Template Matchingmentioning

confidence: 99%

Advanced Biological Imaging for Intracellular Micromanipulation: Methods and Applications

et al. 2020

View full text Add to dashboard Cite

Intracellular micromanipulation assisted by robotic systems has valuable applications in biomedical research, such as genetic diagnosis and genome-editing tasks. However, current studies suffer from a low success rate and a large operation damage because of insufficient information on the operation information of targeted specimens. The complexity of the intracellular environment causes difficulties in visualizing manipulation tools and specimens. This review summarizes and analyzes the current development of advanced biological imaging sampling and computational processing methods in intracellular micromanipulation applications. It also discusses the related limitations and future extension, providing an important reference about this field.

show abstract

“…This technique moves the focusing lens group back and forth to capture multiple images at varying focus positions. Subsequently, focus measure algorithms are applied to select the sharpest image, resulting in the production of focused output [ 26 , 27 ]. However, this approach tends to yield an excessively low frame rate for tracking small, fast-moving objects, primarily due to the capture of numerous redundant images.…”

Section: Introductionmentioning

confidence: 99%

High-Magnification Object Tracking with Ultra-Fast View Adjustment and Continuous Autofocus Based on Dynamic-Range Focal Sweep

Zhang,

Shimasaki,

Ishii

et al. 2024

Sensors

View full text Add to dashboard Cite

Active vision systems (AVSs) have been widely used to obtain high-resolution images of objects of interest. However, tracking small objects in high-magnification scenes is challenging due to shallow depth of field (DoF) and narrow field of view (FoV). To address this, we introduce a novel high-speed AVS with a continuous autofocus (C-AF) approach based on dynamic-range focal sweep and a high-frame-rate (HFR) frame-by-frame tracking pipeline. Our AVS leverages an ultra-fast pan-tilt mechanism based on a Galvano mirror, enabling high-frequency view direction adjustment. Specifically, the proposed C-AF approach uses a 500 fps high-speed camera and a focus-tunable liquid lens operating at a sine wave, providing a 50 Hz focal sweep around the object’s optimal focus. During each focal sweep, 10 images with varying focuses are captured, and the one with the highest focus value is selected, resulting in a stable output of well-focused images at 50 fps. Simultaneously, the object’s depth is measured using the depth-from-focus (DFF) technique, allowing dynamic adjustment of the focal sweep range. Importantly, because the remaining images are only slightly less focused, all 500 fps images can be utilized for object tracking. The proposed tracking pipeline combines deep-learning-based object detection, K-means color clustering, and HFR tracking based on color filtering, achieving 500 fps frame-by-frame tracking. Experimental results demonstrate the effectiveness of the proposed C-AF approach and the advanced capabilities of the high-speed AVS for magnified object tracking.

show abstract

High Speed Three Dimensional Tracking of Swimming Cell by Synchronous Modulation Between TeCE Camera and TAG Lens

Cited by 9 publications

References 27 publications

Advanced tools and methods for single-cell surgery

Advanced tools and methods for single-cell surgery

Advanced Biological Imaging for Intracellular Micromanipulation: Methods and Applications

High-Magnification Object Tracking with Ultra-Fast View Adjustment and Continuous Autofocus Based on Dynamic-Range Focal Sweep

Contact Info

Product

Resources

About