Soon after whales originated from small terrestrial artiodactyl ancestors, basal stem forms (archaeocetes) came to inhabit more specialized aquatic ecologies and underwent a tremendous adaptive radiation that culminated in the adoption of a fully aquatic lifestyle. This adaptive strategy is first documented by the geographically widespread extinct family Basilosauridae. Here we report a new basilosaurid genus and species, Tutcetus rayanensis, from the middle Eocene of Fayum, Egypt. This new whale is not only the smallest known basilosaurid, but it is also one of the oldest records of this family from Africa. Tutcetus allows us to further test hypotheses regarding basilosaurids’ early success in the aquatic ecosystem, which lasted into the latest Eocene, and their ability to outcompete amphibious stem whales and opportunistically adapt to new niches after they completely severed their ties to the land. Tutcetus also significantly expands the size range of the basilosaurids and reveals new details about their life histories, phylogeny, and paleobiogeography.