Recent advances in signal processing hardware has made possible the implementation of sophisticated algorithms. The Complex Block Conjugate Least Mean Square algorithm with Individual adaptation (CBCI-LMS) has recently been proposed and applied in adaptive filtering applications. This technique involves matrix inversion, which is computationally intensive. To improve the feasibility of the algorithm in practice, especially for high-order adaptive systems, this paper proposes two efficient implementations of the CBCI-LMS algorithm. The first efficient implementation applies an iterative matrix inversion lemma without any sacrifice in convergence speed and accuracy. The second method further simplifies the algorithm by using a diagonal matrix for approximation at the first iteration, at the expense of a few additional iterations to achieve convergence. Both of the simplified approaches effectively reduce the computational complexities of the CBCI-LMS algorithm.