An Efficient ANN Interference Cancelation for High Order Modulation over Rayleigh Fading Channel

Abstract

High order modulation (HOM) presents a key challenge in increasing spectrum efficiency in 4G and upcoming 5G communication systems. In this paper, two non-linear adaptive equalizer techniques based on multilayer perceptron (MLP) and radial basis function (RBF) are designed and applied on HOM to optimize its performance despite its high sensitivity to noise and channel distortions. The artificial neural network’s (ANN) adaptive equalizer architectures and learning methods are simplified to avoid more complexity and to ensure greater speed in symbol decision making. They will be compared with the following popular adaptive filters: least mean square (LMS) and recursive least squares (RLS), in terms of bit error rate (BER) and minimum square error (MSE) with 16, 64, 128, 256, 512 and 1024 quadrature amplitude modulation (QAM). By that, this work will show the advantage that the MLP equalizer has, in most cases, over RBF and traditional linear equalizers.