We have grown Bi12GeO20 and Bi12SiO20 single crystals from melts with different GeO2 and SiO2 contents, respectively, to investigate the influence of an intrinsic defect, the antisite defect (Bi on Ge or Si site), on the light-induced charge transport. The optical absorption and the effective trap density of the crystals increase with decreasing GeO2 and SiO2 content in the melt. Furthermore, a variation of the photoconductivity is observed. Our results can be described by a one-center model with the antisite defect Bi3+/4+ on Ge or Si site as dominant photorefractive center.