Xanthomonas axonopodis pv. citri (Xac) is the causal agent of citrus bacterial canker (CBC) and is a serious problem worldwide. Like CBC, several important diseases in other fruits, such as mango, pomegranate, and grape, are also caused by Xanthomonas pathovars that display remarkable specificity toward their hosts. While citrus and mango diseases were documented more than 100 years ago, the pomegranate and grape diseases have been known only since the 1950s and 1970s, respectively. Interestingly, diseases caused by all these pathovars were noted first in India. Our genome-based phylogenetic studies suggest that these diverse pathogens belong to a single species and these pathovars may be just a group of rapidly evolving strains. Furthermore, the recently reported pathovars, such as those infecting grape and pomegranate, form independent clonal lineages, while the citrus and mango pathovars that have been known for a long time form one clonal lineage. Such an understanding of their phylogenomic relationship has further allowed us to understand major and unique variations in the lineages that give rise to these pathovars. Whole-genome sequencing studies including ecological relatives from their putative country of origin has allowed us to understand the evolutionary history of Xac and other pathovars that infect fruits.