Bifidobacterium longum subsp. infantis (B. infantis) is one of few microorganisms capable of metabolizing human breast milk and is a pioneer colonizer in the guts of breastfed infants. One current challenge is differentiating B. infantis from its close relatives, B. longum and B. suis, by molecular methods. These two organisms are classified in the same species group as B. infantis but do not share the ability to metabolize human milk oligosaccharides (HMOs). Here, we compared HMO-metabolizing genes across different Bifidobacterium genomes to develop B. infantis specific primers and determine if they alone can be used to quickly characterize B. infantis with shotgun metagenomic sequencing data. We showed that B. infantis is uniquely identified by the presence of five HMO-metabolizing gene clusters, used this characterization to test for its prevalence in infants, and validated the results using the B. infantis-specific primers. By examining stool samples from a cohort of US children and pregnant women using shotgun metagenomic sequencing, we observed that only 18 of 204 (8.8%) of children under 2 years old harbored B. infantis. These results highlight the importance of developing and improving approaches to identify B. infantis. A more accurate characterization may provide insights into regional differences of B. infantis prevalence in infant gut microbiota.