Alkaline lakes are typical extreme environments inhabitant for a range of diverse microbial extremophiles. However, the large-scale distribution patterns, environmental adaptations, community assembly processes, and evolutionary dynamics of microbial communities, particularly those with different niches remain largely unexplored. In this study, we investigated the characteristics of microbial communities in terms of rare and abundant taxa within alkaline lake sediments in west and northwest China. We observed the community structure of abundant taxa varied significantly with geographical distance, while rare taxa remained unaffected by regional differences, supporting by the assembly process of abundant taxa influenced by diffusion limitation, a stochastic process, and rare taxa predominantly driven by heterogeneous selection as a deterministic process due to their broader environmental adaptability. Network analysis indicated that rare taxa as keystone species played a vital role in community interactions, contributing positively to community stability. From an evolutionary perspective, rare taxa were found to have higher specification and transition rate than abundant taxa, implying that rare taxa served as a genetic reservoir and potential candidates to become abundance taxa, and highlighting the crucial role of rare taxa in the maintenance of microbial diversity. These findings provide deeper insights into the dynamics of abundant and rare taxa in alkaline lake ecosystems and underscore the significant influence of rare taxa on microbial diversity and community stability, offering profound implications for ecosystem management and the conservation of biodiversity in alkaline lakes.