Limited time-resolution in microscopy is an obstacle to many biological studies. Despite recent advances in hardware, digital cameras have limited operation modes that constrain frame-rate, integration time, and color sensing patterns. In this paper, we propose an approach to extend the temporal resolution of a conventional digital color camera by leveraging a multi-color illumination source. Our method allows for the imaging of single-hue objects at an increased frame-rate by trading spectral for temporal information (while retaining the ability to measure base hue). It also allows rapid switching to standard RGB acquisition. We evaluated the feasibility and performance of our method via experiments with mobile resolution targets. We observed a time-resolution increase by a factor 2.8 with a threefold increase in temporal sampling rate. We further illustrate the use of our method to image the beating heart of a zebrafish larva, allowing the display of color or fast grayscale images. Our method is particularly well-suited to extend the capabilities of imaging systems where the flexibility of rapidly switching between high frame rate and color imaging are necessary.
Generalized sampling is a flexible framework for signal acquisition, which relaxes the need for ideal pre-filters. Nevertheless, implementation remains challenging for dynamic imaging applications because it requires simultaneously measuring multiple overlapping inner-products and because only positive signals (intensities) can be measured by cameras. We present a method to collect videos of monochromatic objects by projecting the incoming signal at each pixel in a temporal B-spline space of degree 0, 1, or 2 by using a conventional RGB camera and a modulated three-color light source for illumination. Specifically, we solve the basis function overlap problem by multiplexing the acquisition in different color ranges and use B-spline pieces (which are positive) as projection kernels of a biorthogonal projection-expansion bases pair. The steps to recover signal samples include spectral unmixing and inverse filtering. Reconstructions we obtained from simulated and experimentally-acquired microscopy data demonstrate the feasibility of our approach.
State-of-the-art acoustic models for Automatic Speech Recognition (ASR) are based on Hidden Markov Models (HMM) and Deep Neural Networks (DNN) and often require thousands of hours of transcribed speech data during training. Therefore, building multilingual ASR systems or systems on a language with few resources is a challenging task. Multilingual training and cross-lingual adaptation are potential solutions. However, context-dependent states modeling creates difficulties for multilingual and cross-lingual ASR because of the large increase in context dependent labels arising from the phone set mismatch.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.