Eyes gather information and color forms an extremely important component of the information, more so in the case of animals to forage and navigate within their immediate environment. By using the ONIOM (QM/MM) method, we report a comprehensive theoretical analysis of the structure and molecular mechanism of spectral tuning of monkey-red and green-sensitive visual pigments. We show that, interaction of retinal with three hydroxyl-bearing amino acids near the β-ionone ring part of the retinal in opsin, A164S, F261Y and A269T, increases the electron delocalization, decreases the BLA of the retinal and leads to variation in the wavelength of maximal absorbance in the red- and green-sensitive visual pigments. Based on the analysis, we propose the “OH-site” rule for seeing red and green. This rule is also shown to account for the spectral shifts obtained from hydroxyl-bearing amino acids near the Schiff base in different visual pigments: at site 292 (A292S, A292Y, and A292T) in bovine and at site 111 (Y111) in squid opsins. Therefore, the OH-site rule is shown to be site-specific and not pigment-specific and thus can be used for tracking spectral shifts in any visual pigment.