Two-path 3D CNNs for calibration of system parameters for OCT-based motion compensation

Gessert, Nils; Gromniak, Martin; Schlüter, Matthias; Schlaefer, Alexander

doi:10.1117/12.2512823

Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling 2019

DOI: 10.1117/12.2512823

|View full text |Cite

Two-path 3D CNNs for calibration of system parameters for OCT-based motion compensation

Nils Gessert¹,

Martin Gromniak²,

Matthias Schlüter³

et al.

Help me understand this report

View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2020

Publication Types

Select...

Article1

Relationship

Self Cite1

Independent0

Authors

Journals

Cited by 1 publication

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Spatio-temporal deep learning methods for motion estimation using 4D OCT image data

et al. 2020

Self Cite

View full text Add to dashboard Cite

Purpose Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution that has been used for intraoperative imaging and also for motion estimation, for example, in the context of ophthalmic surgery or cochleostomy. Recently, motion estimation between a template and a moving OCT image has been studied with deep learning methods to overcome the shortcomings of conventional, feature-based methods. Methods We investigate whether using a temporal stream of OCT image volumes can improve deep learning-based motion estimation performance. For this purpose, we design and evaluate several 3D and 4D deep learning methods and we propose a new deep learning approach. Also, we propose a temporal regularization strategy at the model output. Results Using a tissue dataset without additional markers, our deep learning methods using 4D data outperform previous approaches. The best performing 4D architecture achieves an correlation coefficient (aCC) of 98.58% compared to 85.0% of a previous 3D deep learning method. Also, our temporal regularization strategy at the output further improves 4D model performance to an aCC of 99.06%. In particular, our 4D method works well for larger motion and is robust toward image rotations and motion distortions. Conclusions We propose 4D spatio-temporal deep learning for OCT-based motion estimation. On a tissue dataset, we find that using 4D information for the model input improves performance while maintaining reasonable inference times. Our regularization strategy demonstrates that additional temporal information is also beneficial at the model output.

show abstract

Spatio-temporal deep learning methods for motion estimation using 4D OCT image data

et al. 2020

Self Cite

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Two-path 3D CNNs for calibration of system parameters for OCT-based motion compensation

Cited by 1 publication

References 9 publications

Spatio-temporal deep learning methods for motion estimation using 4D OCT image data

Spatio-temporal deep learning methods for motion estimation using 4D OCT image data

Contact Info

Product

Resources

About