Late Ordovician vertebrate faunas occur in clastic sedimentary units along the length of the Rocky Mountains from Colorado to Montana, and across the border into Canada. Most research has, however, been conducted on localities in the southern part of the outcrop belt, particularly the Harding Sandstone Formation of Colorado. Micropalaeontological sampling of the coeval South Piney Member (Winnipeg Formation) in the Bighorn Mountains of Wyoming has revealed an abundant vertebrate fauna. The vertebrate assemblage includes a low-abundance fauna of 13 conodont taxa that together indicate an undatus Chronozone age (midMohawkian; mid-Caradoc; Late Ordovician). The pteraspidomorphs Astraspis desiderata Walcott and Eriptychius americanus Walcott are also present together with one new taxon, Eleochera glossa gen. et sp. nov., which is interpreted as a derived stem-gnathostome on the basis of its scale histology and morphology. The fauna bears a strong similarity to that of the Harding Sandstone but is of lower diversity. In particular, it lacks the fine-grained, deeper water component of the Harding Sandstone that contains, inter alia, thelodonts and stem-chondrichthyans.