Global waste production is increasing rapidly, with the majority of waste destined for landfills. Microbial communities in landfills transform waste and generate methane in an environment unique from other built and natural environments. Previous work has largely considered landfill microbial diversity only at the phylum level, identifying complex and variable communities. The extent of shared organismal diversity across landfills or over time and at more precise levels of classification remains unknown. We used 16S rRNA gene amplicon and metagenomic sequencing to examine the taxonomic and functional diversity of the microbial communities inhabiting a Southern Ontario landfill. The diversity of microbial populations in leachate and groundwater samples was correlated with geochemical conditions to determine drivers of microbial heterogeneity. Across the landfill, 25 bacterial and archaeal phyla were present at >1% relative abundance within at least one landfill sample. The Patescibacteria, Bacteroidota, Firmicutes, and Proteobacteria had the highest relative abundances, with most other phyla present at low (<5%) abundance. Below the phylum level, very few populations were identified at multiple sites, with only 121 of 8,030 populations present at five or more sites. This indicates that, although phylum-level signatures are conserved, individual landfill microbial populations vary widely. Significant differences in geochemistry occurred across the leachate and groundwater wells sampled, with calcium, iron, magnesium, boron, meta and para xylenes, ortho xylenes, and ethylbenzene concentrations contributing most strongly to observed site differences. This study illustrates that leachate microbial communities are much more complex and diverse within landfills than previously reported, with implications for waste management best practices.