A system with a three-degree-of-freedom (3-DOF) torsional dynamic model of a one-way clutch coupled with a spur gear pair is proposed. The one-way clutch is installed in front of the pinion and only allows the transmission of the torque from the engine. The torque is designed as a piecewise function while the inertia moment of the clutch is considered. The mesh time-varying stiffness of the teeth and gear backlash is seen nonlinear. In the analysis of the dynamic transmission error of the gear pair and twisted angle of the clutch, the torsional dynamic behaviour of the system is evaluated from 500 rpm to 45,000 rpm. To identify the effect of the parameter of a clutch on the dynamic response of the system, the effect of the torsion stiffness and damping ratio of the one-way clutch, including the inertia ratio of the clutch and pinion, is also analysed in this paper. The jump phenomenon, multi-jump occurrence, and subharmonic and harmonic resonance regions of the dynamic response system are observed.