Recently, as the demand for tremendous spectral efficiency has increased, the massive multiple-input multiple-output (MIMO) system has attracted attention in the wireless communication system. In massive MIMO, the zero forcing (ZF) precoder provides optimal performance. However, the complexity for process of matrix inversion is burden in terms of practical implementation. Therefore, many researches for approximate inversion of channel matrix have been performed in order to reduce the complexity. The typical linear precoder based on approximate matrix inversion is the Gauss Seidel (GS) precoder. The GS precoder provides the similar precoded signals to ZF precoder with low complexity. However, the GS precoder does not adopt parallel implementation because of inner structure. Consequently, precoder for the GS iterative method spends a lot of times in order to estimate precoded signal. Therefore, this problem makes the GS precoder impractical. In this paper, the punctured GS (PGS) is proposed in order to mitigate the problem of parallel operation by modifying inner structure for the GS precoder. However, the performance for the PGS precoder is degraded due to modified inner structure. Therefore, the ordering PGS precoder which performance degradation due to modified inner structure is mitigated is additionally introduced. As a result, although the delay when precoded signal for the PGS precoder is obtained decreases than the GS precoder, the BER performance for the PGS precoder is degraded than the GS precoder. In contrast, the ordering PGS precoder provides improved BER performance with decrease of delay compared with the GS precoder.