We demonstrate a single-photon compressed imaging system based on single photon counting technology and compressed sensing theory. In order to cut down the measurement times and shorten the imaging time, a fast and efficient adaptive sampling method, suited for single-photon compressed imaging, is proposed. First, the pre-measured rough images are transformed into sparse bases as a priori information. Then a smart threshold matrix is designed by using large sparse coefficients of the rough image in sparse bases. The adaptive measurement matrix is obtained by modifying the original Gaussian random matrix with the specially designed threshold matrix. Building the adaptive measurement matrix requires only one level of sparse representation, which means that adaptive imaging can be achieved quickly with very little computation. The experimental results show that the reconstruction effect of the image measured using the adaptive measurement matrix is obviously superior than that of the Gaussian random matrix under different measurement times and different reconstruction algorithms.
This paper considers the problem of temporal video interpolation, where the goal is to synthesize a new video frame given its two neighbors. We propose Cross-Video Neural Representation (CURE) as the first video interpolation method based on neural fields (NF). NF refers to the recent class of methods for neural representation of complex 3D scenes that has seen widespread success and application across computer vision. CURE represents the video as a continuous function parameterized by a coordinate-based neural network, whose inputs are the spatiotemporal coordinates and outputs are the corresponding RGB values. CURE introduces a new architecture that conditions the neural network on the input frames for imposing space-time consistency in the synthesized video. This not only improves the final interpolation quality, but also enables CURE to learn a prior across multiple videos. Experimental evaluations show that CURE achieves the state-of-the-art performance on video interpolation on several benchmark datasets.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.