IgM responses are well known to occur early postinfection and tend to be short-lived, which has suggested that this Ig does not significantly contribute to long-term immunity. In this study, we demonstrate that chronic infection with the intracellular bacterium Ehrlichia muris elicits a protective, long-term IgM response. Moreover, we identified a population of CD138highIgMhigh B cells responsible for Ag-specific IgM production in the bone marrow. The IgM-secreting cells, which exhibited characteristics of both plasmablasts and plasma cells, contributed to protection against fatal ehrlichial challenge. Mice deficient in activation-induced cytidine deaminase, which produce only IgM, were protected against fatal ehrlichial challenge infection. The IgM-secreting cells that we have identified were maintained in the bone marrow in the absence of chronic infection, as antibiotic-treated mice remained protected against challenge infection. Our studies identify a cell population that is responsible for the IgM production in the bone marrow, and they highlight a novel role for IgM in the maintenance of long-term immunity during intracellular bacterial infection.