The aim of this study was to determine the impacts of anthropogenic disturbances on compositions of prokaryote communites (CPCs) in Chaohu Lake and its three urban tributaries, in China. Prokaryotic diversity in Chaohu Lake and its tributaries was high, and prokaryotic communities showed lower richness in Nanfei River than in Zhegao River and Hangbu River, with waterbody nutrient levels negatively corresponding to prokaryotic diversity. Except for a few rare prokaryotes, or where classification was unclear, the prokaryotes were distributed into 13 phyla and 924 genera. The dominant prokaryotic phyla were Proteobacteria (31.51%), Bacteroidetes (26.50%), Cyanobacteria (19.05%), and Actinobacteria (10.71%). Redundancy analysis (RDA) results showed CPCs, as well as abundances of Proteobacteria, Actinobacteria, and Firmicutes to be primarily affected by the concentration of total phosphorus (TP). Furthermore, Cyanobacteria showed a significant correlation with the concentrations of total nitrogen (TN), nitrate (NO3) and ammonia nitrogen (NH4). pH was correlated with Planctomycetes, while Thermotogae was generally associated with water temperature (WT). These results suggest that trophic status could play an important role in shaping CPCs in both freshwater lakes and rivers. Ultimately, urbanization was found to cause the deterioration of water quality within Chaohu Lake and its tributaries.