A modified BP network based on second order momentum term

Abstract

On the base of BP network introducing second order momentum term, this paper proposed a modified method of setting second order momentum factor. This method exploited full advantage of adding first order momentum term, and set plus-minus of second order momentum factor according to different situations of BP network on the error surface during training process. At the end of the paper, simulation experiments were made on BP network applying the new method by solving three benchmark problems: XOR, 3-Bit Parity and function approximation. The results of the experiments show that the new BP network has faster training speed and better training effect.