Marine and freshwater microbial communities are phylogenetically distinct and transitions between habitat types are thought to be infrequent. We compared the phylogenetic diversity of marine and freshwater microorganisms and identified specific lineages exhibiting notably high or low similarity between marine and freshwater ecosystems using a meta-analysis of 16S rRNA gene tag-sequencing datasets. As expected, marine and freshwater microbial communities differed in the relative abundance of major phyla and contained habitat-specific lineages; at the same time, however, many shared taxa were observed in both environments. Betaproteobacteria and Alphaproteobacteria sequences had the highest similarity between marine and freshwater sample pairs. Gammaproteobacteria and Alphaproteobacteria contained the highest number of Minimum Entropy Decomposition nodes shared by marine and freshwater samples. Shared nodes included lineages of the abundant alphaproteobacterial group SAR11 that have not previously been reported in 16S rRNA gene surveys of freshwater lakes. Our results suggest that shared taxa are numerous, but tend to occur sporadically and at low relative abundance in one habitat type, leading to an underestimation of transition frequency between marine and freshwater habitats. Lineages with a high degree of shared taxa or habitat-specific diversification represent targets for genome-scale investigations into microbial adaptations and evolutionary innovations. Rare taxa with abundances near or below detection, including lineages that appear to have crossed the salty divide relatively recently, may have novel adaptations enabling them to exploit opportunities for niche expansion when environments are disturbed or conditions change.ImportanceThe distribution of microbial diversity across environments yields insight into processes that create and maintain this diversity as well as potential to infer how communities will respond to future environmental changes. We integrated datasets from dozens of freshwater lake and marine samples to compare diversity across open water habitats differing in salinity. Our novel combination of sequence-based approaches revealed phyla and proteobacterial classes inferred to include more or less recent transitions across habitat types as well as specific lineages that are shared by marine and freshwater environments at the level of 16S rRNA sequence types. Our findings contribute to understanding the ecological and evolutionary controls on microbial distributions, and open up new questions regarding the plasticity and adaptability of particular lineages.