Multisensory interface for 5D stem cell image volumes

Koerner, Michael M.; Wait, Eric; Winter, Mark; Bjornsson, Chris S.; Kokovay, Erzsebet; Wang, Yue; Goderie, Susan K.; Temple, Sally; Cohen, Andrew R.

doi:10.1109/embc.2014.6943806

Cited by 1 publication

(1 citation statement)

References 7 publications

(9 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By selectively placing different markers throughout a specimen, a researcher can construct detailed visual narratives of different biological processes based on the spectral variations throughout the data [2][3][4][5] . This approach, called multiplexing, allows for functional readout of multiple genetic functions spatially and temporally, a feature unique to fluorescence imaging.…”

Section: Use Of Spectral Information In Microscopymentioning

confidence: 99%

Sonification of hyperspectral fluorescence microscopy datasets

2016

View full text Add to dashboard Cite

Recent advances in fluorescence microscopy have yielded an abundance of high-dimensional spectrally rich datasets that cannot always be adequately explored through conventional three-color visualization methods. While computational image processing techniques allow researchers to derive spectral characteristics of their datasets that cannot be visualized directly, there are still limitations in how to best visually display these resulting rich spectral data. Data sonification has the potential to provide a novel way for researchers to intuitively perceive these characteristics auditorily through direct interaction with the raw multi-channel data. The human ear is well tuned to detect subtle differences in sound that could represent discrete changes in fluorescence spectra. We present a proof of concept implementation of a functional data sonification workflow for analysis of fluorescence microscopy data as an FIJI ImageJ plugin and evaluate its utility with various hyperspectral microscopy datasets. Additionally, we provide a framework for prototyping and testing new sonification methods and a mathematical model to point out scenarios where vision-based spectral analysis fails and sonification-based approaches would not. With this first reported practical application of sonification to biological fluorescence microscopy and supporting computational tools for further exploration, we discuss the current advantages and disadvantages of sonification over conventional spectral visualization approaches. We also discuss where further efforts in spectral sonification need to go to maximize its practical biological applications.

show abstract

Section: Use Of Spectral Information In Microscopymentioning

confidence: 99%