Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision

Abstract

The priority of building hardware-oriented neural network models is growing steadily. The target goals for their development are the performance and energy efficiency of promising hardwaresoftware solutions. Simultaneously, for different classes of computing architectures of the computer, the optimal neural network models will differ. The most interesting from a practical point of view are applicationspecific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) and central processing units (CPUs). We have recently proposed a bipolar morphological network as a hardware-oriented model for these computer types, the computationally intensive parts of which use only maximum and addition. In this work, we present for the first time a theoretical assessment of the expressive power of a neural network consisting of BM neurons and show that it corresponds to the expressive power of the classical multilayer perceptron. In addition, we summarize the current results on the use of the bipolar morphological model in typical tasks of technical vision: image classification and semantic segmentation. We consider simple LeNet-5-like neural networks, as well as deeper ResNet and UNet architectures. We show that BM networks demonstrate accuracy that allows their practical use, with significantly higher performance in terms of a transistor budget for two (ASIC, FPGA) of the three architectures under consideration. The source code of the model and ResNet experiments are available at https://github.com/SmartEngines/bipolar-morphological-resnet.

DSMNN-Net: A Deep Siamese Morphological Neural Network Model for Burned Area Mapping Using Multispectral Sentinel-2 and Hyperspectral PRISMA Images

“…Topological operators are applied to images by morphological operators to recover or filter out specific structures [63,64]. Mathematical morphology operators are nonlinear image operators that are based on the image spatial structure [65][66][67].…”

Bipolar morphological YOLO network for object detection

“…Notable examples in this category are AdderNet [10] and ShiftAddNet [11]. An example of this approach is the bipolar morphological (BM) neuron [12][13][14].…”

Quantization method for bipolar morphological neural networks

“…Within the layer, positive and negative parts of input signal and filters are separated and processed by different pathways. Since the bipolar morphological neuron does not use multiplication, it demonstrates promising estimates for the hardware complexity and execution time for specialized FPGA and ASIC devices [13,14]. Such neurons, being organized into a convolutional neural network, are able to demonstrate recognition accuracy close to the accuracy of classical networks for a number of recognition problems [13,15].…”