In this paper, based on the theoretical foundation of generative adversarial networks and knowledge related to audio enhancement and denoising, a generative adversarial network model and framework are established,and the function of SEGAN audio enhancement algorithm is selected to complete audio noise reduction, improve the purity of audio and realize the audio enhancement algorithm function. At the same time, the training data of the loss function of GAN is optimized from the mathematical principle and the audio enhancement algorithm is evaluated by the speech quality assessment index.This paper replicates SEGAN's audio enhancement generative adversarial network with good practical effects in noise containing frequency denoising and pure audio enhancement, and the enhanced speech of this research method has better auditory quality and intelligibility, and also has better stability compared with the original SEGAN network.