Turbulence in three dimensions (3D) supports vortex stretching that has long been known to accomplish energy transfer to small scales. Moreover, net energy transfer from large-scale, forced, unstable flow-gradients to smaller scales is achieved by gradient-flattening instability. Despite such enforcement of energy transfer to small scales, it is shown here that the shear-flow-instability-supplied 3D-fluctuation energy is largely inverse-transferred from the fluctuation to the mean-flow gradient, and such inverse transfer is more efficient for turbulent fluctuations in 3D than in two dimensions (2D). The transfer is due to linearly stable eigenmodes that are excited nonlinearly. The stable modes, thus, reduce both the nonlinear energy cascade to small scales and the viscous dissipation rate. The vortex-tube stretching is also suppressed. Up-gradient momentum transport by the stable modes counters the instability-driven down-gradient transport, which also is more effective in 3D than in 2D (≈70% vs ≈50%). From unstable modes, these stable modes nonlinearly receive energy via zero-frequency fluctuations that vary only in the direction orthogonal to the plane of 2D shear flow. The more widely occurring 3D turbulence is thus inherently different from the commonly studied 2D turbulence, despite both saturating via stable modes.