Gauss–Seidel Extreme Learning Machines

Abstract

Extreme learning machines (ELM) were created to simplify the training phase of single-layer feedforward neural networks, where the input weights are randomly set and the only parameter is the number of neurons in the hidden layer. These networks are also known for one-shot training using Moore-Penrose pseudo-inverse. In this work, we propose Gauss-Seidel extreme learning machine (GS-ELM), an ELM based on Gauss-Seidel iterative method to solve linear equation systems. We performed tests considering databases with different characteristics and analysed its discrimination capabilities and memory consumption in comparison to the canonical ELM and the online sequential ELM. GS-ELM presented similar discrimination capabilities, but consuming significantly less memory, turning possible its application in low-memory systems and embedded solutions. Keywords Unorganized neural networks • Extreme learning machines • Random vector functional link networks • Numerical methods • Fast training neural networks * Wellington P. dos Santos