The geological structure and history of mountains often cause highly complex patterns of evolution. The origin and diversity of the genus Triplophysa is considered to be closely associated with the rapid and persistent rise of the Qinghai-Tibet Plateau (QTP). Species of the genus are widely distributed in the QTP and adjacent regions, and are strongly adapted to its extreme environments. However, the Central Chinese Mountains (CCM), which are far apart from the QTP, also have many Triplophysa populations and yet their taxonomy, phylogeny and origin are unknown. We used three mitochondrial genes of 266 individuals from 29 sites in the CCM to shed light on the evolution of these Triplophysa populations. Phylogenetic analyses and species delimitation revealed seven distinct molecular operational taxonomic units (mOTUs) in the CCM, each with low genetic diversity. Molecular clock and biogeographic analyses suggested that vicariance events resulting from the rapid uplifting of the Qinling and Taihang Mountains initialized diversification in the Pliocene. During the early Pleistocene, dispersal events in the central parts of the Yellow River drainage altered genetic diversity and led to the currently observed biogeographic patterns. Our results suggest the presence of at least six species of Triplophysa in the CCM and more are likely to be discovered in the future.