Visualization of Neuronal Structures in Wide-Field Microscopy Brain Images

Abstract

Wide-field microscopes are commonly used in neurobiology for experimental studies of brain samples. Available visualization tools are limited to electron, two-photon, and confocal microscopy datasets, and current volume rendering techniques do not yield effective results when used with wide-field data. We present a workflow for the visualization of neuronal structures in wide-field microscopy images of brain samples. We introduce a novel gradient-based distance transform that overcomes the out-of-focus blur caused by the inherent design of wide-field microscopes. This is followed by the extraction of the 3D structure of neurites using a multi-scale curvilinear filter and cell-bodies using a Hessian-based enhancement filter. The response from these filters is then applied as an opacity map to the raw data. Based on the visualization challenges faced by domain experts, our workflow provides multiple rendering modes to enable qualitative analysis of neuronal structures, which includes separation of cell-bodies from neurites and an intensity-based classification of the structures. Additionally, we evaluate our visualization results against both a standard image processing deconvolution technique and a confocal microscopy image of the same specimen. We show that our method is significantly faster and requires less computational resources, while producing high quality visualizations. We deploy our workflow in an immersive gigapixel facility as a paradigm for the processing and visualization of large, high-resolution, wide-field microscopy brain datasets.

Three‐dimensional microvascular network reconstruction from in vivo images with adaptation of the regional inhomogeneity in the signal‐to‐noise ratio

“…To compensate for the broadening effects, previous studies proposed deconvolution methods for 3D reconstruction of 2PLSM images. 47,48 However, the methods require preliminary knowledge of the axial PSFs and need to assume that the PSFs in the sample are uniform. In reality, the axial PSF in tissue is largely variable depending on the anatomical structures.…”

Improving the Usability of Virtual Reality Neuron Tracing with Topological Elements

“…Instead, we leverage the Morse-Smale complex to guide users when tracing through a volumetric representation. Boorboor et al [11] proposed a data processing and feature extraction pipeline, the output of which could be visualized in an immersive display wall visualization system implemented with Unity. Sicat et al [60] presented DXR, a Unity based toolkit for easily developing immersive visualization applications.…”

Interactive Volumetric Visual Analysis of Glycogen‐derived Energy Absorption in Nanometric Brain Structures

“…Recently Sarton et al [SCRL16] presented an approach for high capacity screening of slices based on a tool combining pyramidal images representation and 3D visualization on multi‐stereo display, in order to simulate virtual microscopy (VM). Finally, Borboor et al [BJA*19] proposed a workflow for the visualization of neuronal structures in wide‐field microscopy images of brain samples, which uses a gradient‐based distance transform and multi‐scale enhancement filters. Our system comprises a scalable volume rendering component extending the method presented by Hadwiger et al [HBJP12], and integrating an hybrid object‐based empty space skipping scheme [HAAB*18] and a data structure for hybrid culling of integer label data [BMA*19], in order to enable real‐time inspection of volumetric EM data together with label data and additional metadata.…”