In this paper we propose parallel loop filter (LPF) and Number Controlled Oscillator (NCO) of carrier tracking loop in all-digital parallel receiver (APRX), according to the theoretical derivation of LPF and NCO in serial receiver. The Monte Carlo simulation results show that, the acquisition time, phase error response performance and tracking range of parallel LPF and NCO are better than that of serial LPF and NCO, and the BER performance of the DPLL using parallel LPF and NCO is slightly better than that of the DPLL using serial LPF and NCO. Moreover, the parallel LPF and NCO can be used in parallel PSK and QAM demodulation receivers, and the parallel LPF can be also used in timing recovery of parallel receivers.