We demonstrate an all optical nonlinear activation function device based on Ge/Si hybrid micro-ring resonator. Three different types of nonlinear function are realized with threshold below 1mW and they can work well beyond 5MHz.
Optical nonlinear activation function is an indispensable part of the optical neural network. While linear matrix computation has thrived in an integrated optical neural network, there are many challenges for nonlinear activation function on a chip such as large latency, high power consumption and high threshold. Here, we demonstrate that Ge/Si hybrid structure would be a qualified candidate owing to its property of CMOS-compatibility, low nonlinear threshold and compact footprint. Thanks to the strong thermal-optic effect of germanium in conjunction with micro-ring resonator, we experimentally demonstrate three different types of nonlinear function (Radial basis, Relu and ELU functions) with a lowest threshold of 0.74 mW among our measured nonlinear functions and they can work well with a repetition rate below 100 kHz. Simultaneous size shrinkage of germanium and resonance constraint inside germanium is proposed to speed up response time. Furthermore, we apply our measured nonlinear activation function to the task of classification of MNIST handwritten digit image dataset and improve the test accuracy from 91.8% to 94.8% with feedforward full-connected neural network containing three hidden layers. It proves that our scheme has potential in the future optical neural network.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.