Human cytomegalovirus (HCMV) is a widespread human pathogen that causes asymptomatic infection in healthy individuals but poses a serious threat to immunocompromised patients. During the late phase of HCMV infection, the viral capsid is transported to the cytoplasmic viral assembly center (cVAC), where it is enclosed by the tegument protein layer and the viral envelope. The cVAC consists of circularly arranged vesicles from the -Golgi and endosomal networks. The HCMV gene UL35 encodes ppUL35 and its shorter form, ppUL35A. We have previously shown that the UL35 gene is involved in HCMV assembly, but it is unknown how UL35 proteins regulate viral assembly. Here we show that sorting nexin 5 (SNX5), a component of the retromer and part of the retrograde transport pathway, interacts with UL35 proteins. Expression of wild-type proteins but not mutants defective in SNX5 binding resulted in the cellular redistribution of the cation-independent mannose-6-phosphate receptor (CI-M6PR), indicating that UL35 proteins bind and negatively regulate SNX5 to modulate cellular transport pathways. Furthermore, binding of UL35 proteins to SNX5 was required for efficient viral replication and for transport of the most abundant HCMV glycoprotein B (gB; gpUL55) to the cVAC. These results indicate that ppUL35 and ppUL35A control the localization of the essential gB through the regulation of a retrograde transport pathway. Thus, this work is the first to define a molecular interaction between a tegument protein and a vesicular transport factor to regulate glycoprotein localization. Human cytomegalovirus is ubiquitously present in the healthy population, but reactivation or reinfection can cause serious, life-threatening infections in immunocompromised patients. For completion of its lytic cycle, human cytomegalovirus induces formation of an assembly center where mature virus particles are formed from multiple viral proteins. Viral glycoproteins use separate vesicular pathways for transport to the assembly center, which are incompletely understood. Our research identified a viral structural protein which affects the localization of one of the major glycoproteins. We could link this change in glycoprotein localization to an interaction of the structural protein with a cellular protein involved in regulation of vesicle transport. This increases our understanding of how the virus intersects into cellular regulatory pathways to enhance its own replication.