Elderly humans show decreased humoral immunity to pathogens and vaccines, yet the effects of aging on B cells are not fully known. Chronic viral infection by cytomegalovirus (CMV) is implicated as a driver of clonal T cell proliferations in some aging humans, but whether CMV or Epstein-Barr virus (EBV) infection contributes to alterations in the B cell repertoire with age is unclear. We have used high-throughput DNA sequencing of immunoglobulin heavy chain (IGH) gene rearrangements to study the B cell receptor repertoires over two successive years in 27 individuals ranging in age from 20 to 89 years. Some features of the B cell repertoire remain stable with age, but elderly subjects show increased numbers of B cells with long CDR3 regions, a trend toward accumulation of more highly mutated IgM and IgG immunoglobulin genes, and persistent clonal B cell populations in the blood. Seropositivity for CMV or EBV infection alters B cell repertoires, regardless of the individual's age: EBV infection correlates with the presence of persistent clonal B cell expansions, while CMV infection correlates with the proportion of highly mutated antibody genes. These findings isolate effects of aging from those of chronic viral infection on B cell repertoires, and provide a baseline for understanding human B cell responses to vaccination or infectious stimuli.