SUMMARYA recursive algorithm based on the use of Gauss–Seidel iterations is introduced to adjust the parameters of a self‐tuning controller for minimum phase and a class of nonminimum phase discrete‐time systems. The proposed algorithm is called the Recursive Gauss–Seidel (RGS) algorithm and is used to update the controller parameters directly. The use of the RGS algorithm with a generalized minimum variance control law is also given for nonminimum phase systems, and a forgetting factor is used to track the time‐varying parameters. Furthermore, the overall stability of the closed‐loop system is proven by using the Lyapunov stability theory. Using computer simulations, the performance of the RGS algorithm is examined and compared with the widely used recursive least squares algorithm.Copyright © 2011 John Wiley & Sons, Ltd.