The genetic effects of habitat fragmentation are complex and are influenced by both species traits and landscape features. For plants with strong seed or pollen dispersal capabilities, the question of whether the genetic erosion of an isolated population becomes stronger or is counterbalanced by sufficient gene flow across landscapes as the timescales of fragmentation increase has been less studied. In this study, we compared the population structure and genetic diversity of a distylous herb, Hedyotis chyrsotricha (Rubiaceae), in two contrasting island systems of southeast China. Based on RAD-Seq data, our results showed that populations from the artificially created Thousand-Island Lake (TIL) harbored significantly higher levels of genetic diversity than those from the Holocene-dated Zhoushan Archipelago (ZA) (π = 0.247 vs. 0.208, HO = 0.307 vs. 0.256, HE = 0.228 vs. 0.190), while genetic differences between island and mainland populations were significant in neither the TIL region nor the ZA region. A certain level of population substructure was found in TIL populations, and the level of gene flow among TIL populations was also lower than in ZA populations (m = 0.019 vs. 0.027). Overall, our comparative study revealed that genetic erosion has not become much stronger for the island populations of either the TIL or ZA regions. Our results emphasized that the matrix of water in the island system may facilitate the seed (fruit) dispersal of H. chrysotricha, thus maintaining population connectivity and providing ongoing resilience to the effects of habitat fragmentation over thousands of years.