When Neural Network Computation Meets Evolutionary Computation: A Survey

Abstract

Abstract. Neural network (NN) and evolutionary computation (EC) are two of the most popular and important techniques in computational intelligence, which can be combined together to solve the complex real world problems. This paper represents a review of the researches that combined NN and EC. There are 3 main research focuses as follows. In the first research focus, EC algorithms have been widely used to optimize the structure and parameter of the NN, including weight, structure, learning rates, and others. In the second research focus, lots literatures have witnessed that EC based NNs are widespread in the applications such as classification, automatic control, prediction, and many other fields. These two kinds of researches into combining NN and EC are mainly focuses on using EC algorithms to optimize NN, to enhance the NN performance and the NN application ability. Our survey finds that particle swarm optimization is the most popular EC algorithm that the researchers choice to optimize NN in recent year, while genetic algorithm and differential evolution are also widely used. In the third research focus, there are also researches adopted NN as a tool to enhance the performance of EC algorithms. Although the literatures in this focus are not as many as the above two focuses, the existing results show that NN has great potential in enhancing EC algorithms. The survey shows that when NN and EC meet, combining them would result in an effective way to deal with the real world application. This interesting research topic has become more and more significant in the field of computer science and still has much room for development.