The push for a semiconductor-based quantum information technology has renewed interest in the spin states and optical transitions of shallow donors in silicon, including the donor bound exciton transitions in the near-infrared and the Rydberg, or hydrogenic, transitions in the mid-infrared. The deepest group V donor in silicon, bismuth, has a large zero-field ground state hyperfine splitting, comparable to that of rubidium, upon which the now-ubiquitous rubidium atomic clock time standard is based. Here we show that the ground state hyperfine populations of bismuth can be read out using the mid-infrared Rydberg transitions, analogous to the optical readout of the rubidium ground state populations upon which rubidium clock technology is based. We further use these transitions to demonstrate strong population pumping by resonant excitation of the bound exciton transitions, suggesting several possible approaches to a solid-state atomic clock using bismuth in silicon, or eventually in enriched 28Si.