We numerically study the rapid hardening and possible role of exhaustion of twinning in magnesium alloys under twinning dominated conditions, based on the large strain elastic visco-plastic self-consistent model. It is found that upon the exhaustion of the tensile twinning, further deformation requires the material to activate Prismatic and Pyramidal slips, which have relative high critical resolved shear stress (CRSS). However, the stress level at the exhaustion of the tensile twinning is not high enough to activate Prismatic and Pyramidal slips. Consequently, the imposed strain increments must mainly be accommodated by elastic deformations, and the strain hardening rate becomes a large fraction of the elastic modulus. Therefore, it can be concluded that the rapid hardening is a composite response more associated with elasticity of a large volume fraction of the material, than the dislocation-dislocation interactions normally held responsible for strain hardening of metals.