One of the most remarkable chromatin remodeling processes occurs during spermiogenesis, the post-meiotic phase of sperm development during which histones are replaced with sperm-specific protamines to repackage the genome into the highly compact chromatin structure of mature sperm. Here we identify Chromodomain helicase DNA binding protein 5 (Chd5) as a master regulator of the histone-to-protamine chromatin remodeling process. Chd5 deficiency leads to defective sperm chromatin compaction and male infertility in mice, mirroring the observation of low CHD5 expression in testes of infertile men. Chd5 orchestrates a cascade of molecular events required for histone removal and replacement, including histone 4 (H4) hyperacetylation, histone variant expression, nucleosome eviction, and DNA damage repair. Chd5 deficiency also perturbs expression of transition proteins (Tnp1/Tnp2) and protamines (Prm1/2). These findings define Chd5 as a multi-faceted mediator of histone-to-protamine replacement and depict the cascade of molecular events underlying chromatin remodeling during this process of extensive chromatin remodeling.