Noise reduction is one of the most important process used for signal processing in communication systems. The signal-to-noise ratio (SNR) is a key parameter for minimizing the bit error rate (BER). The inherent noise in millimeter-wave systems is mainly a combination of white and phase noise. Increasing the SNR can lead to reliability and performance improvements in wireless data transfer systems. To address this issue, we propose to use a recurrent neural network (RNN) with a long shortterm memory (LSTM) autoencoder architecture to achieve signal noise reduction. This design is based on a composite LSTM autoencoder with a single encoder layer and two decoder layers. A V-band receiver test bench is designed and fabricated to provide a high-speed wireless communication system. Constellation diagrams display the output signals measured for various random sequences of PSK and QAM modulated signals. The LSTM autoencoder is trained in real time using various noisy signals. The trained system is then used to reduce noise levels in the tested signals. The SNR of the designed receiver is of the order of 11.8 dB and it increases to 13.66 dB using the three-level LSTM autoencoder. Consequently, the proposed algorithm reduces the bit error rate from 10 8 to 10 11 . The performance of the proposed algorithm is comparable to other noise reduction strategies. Augmented denoised signals are fed into a ResNet-152 deep convolutional network to perform the final classification. The demodulation types are classified with an accuracy of 99.93%. This is confirmed by experimental measurements.