The optical transport of images through a multimode fibre remains an outstanding challenge with applications ranging from optical communications to neuro-imaging. State of the art approaches either involve measurement and control of the full complex field transmitted through the fibre or, more recently, training of artificial neural networks that however, are typically limited to image classes belong to the same class as the training data set. Here we implement a method that statistically reconstructs the inverse transformation matrix for the fibre. We demonstrate imaging at high frame rates, high resolutions and in full colour of natural scenes, thus demonstrating general-purpose imaging capability. Real-time imaging over long fibre lengths opens alternative routes to exploitation for example for secure communication systems, novel remote imaging devices, quantum state control processing and endoscopy.
Light scattered from multiple surfaces can be used to retrieve information of hidden environments. However, full three-dimensional retrieval of an object hidden from view by a wall has only been achieved with scanning systems and requires intensive computational processing of the retrieved data. Here we use a non-scanning, single-photon single-pixel detector in combination with a deep convolutional artificial neural network: this allows us to locate the position and to also simultaneously provide the actual identity of a hidden person, chosen from a database of people (N = 3). Artificial neural networks applied to specific computational imaging problems can therefore enable novel imaging capabilities with hugely simplified hardware and processing times.
Nonlinear waves have played a historical role in laying the foundations of the science of complexity. Recently, they have also allowed the development of a new reservoir computing paradigm: neuromorphic computing by waves. In these systems, the information transmission acts as the excitation of wave dynamics, whose evolution processes the information to perform complex tasks at low energy consumption. To enable nonlinear hydrodynamic waves to do computing, we designed the Aqua-Photonic-Advantaged Computing Machine by Artificial Neural Networks (Aqua-PACMANN), a system where wave propagation in shallow water is the leading physical phenomenon, and the presence of electronics can be reduced to a CCD camera in detection. We show the realization of an XNOR logic gate as proof of concept of the Aqua-PACMANN's architecture and pave the way to a new class of fluid dynamic neuromorphic computing.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.