Polarimetry is an important noninvasive blood glucose measurement method and attracts extensive attention from researchers. However, one of the difficulties associated with polarimetry is the low concentration of blood glucose, which results in weak optical rotation signals. In this paper, we report a fast and accurate spatial polarization modulation system (SPMS) that can measure the low glucose concentration by analyzing a single digital image. In this system, the rotated polarizer gain mechanism (RPGM) is adopted to amplify the weak optical rotation signals. And in order to extract the optical rotation signals from the background more easily, a vortex phase difference retarder (VPDR) is employed to modulate the optical rotation signals, which is a specially designed birefringent crystal with a vortex phase difference along the azimuth angle. We have established the theoretical model of the SPMS by the Jones matrix theory, and both the simulation experiments with noise and without noise have shown that the SPMS has a resolution of 100mg/dl.