While the benefits of early antiretroviral therapy (ART) initiation in perinatally infected infants are well documented, early ART initiation is not always possible in postnatal pediatric HIV infections, which account for the majority of pediatric HIV cases worldwide. The timing of onset of ART initiation is likely to affect the size of the latent viral reservoir established, as well as the development of adaptive immune responses, such as the generation of neutralizing antibody responses against the virus. How these parameters impact the ability of infants to control viremia and the time to viral rebound after ART interruption is unclear. To gain insight into the dynamics, we utilized mathematical models to investigate the effect of time of ART initiation via latent reservoir size and autologous virus neutralizing antibody responses in delaying viral rebound when treatment is interrupted. We used an infant nonhuman primate Simian/Human Immunodeficiency Virus (SHIV) infection model that mimics breast milk HIV transmission in human infants. Infant Rhesus macaques (RMs) were orally challenged with SHIV.C.CH505 375H dCT and either given ART at 4-7 days post-infection (early ART condition), at 2 weeks post-infection (intermediate ART condition), or at 8 weeks post-infection (late ART condition). These infants were then monitored for up to 60 months post-infection with serial viral load and immune measurements. We develop a stochastic mathematical model to investigate the joint effect of latent reservoir size, the autologous neutralizing antibody potency, and CD4+ T cell levels on the time to viral rebound and control of post-rebound viral loads. We find that the latent reservoir size is an important determinant in explaining time to viral rebound by affecting the growth rate of the virus. The presence of neutralizing antibodies also can delay rebound, but we find this effect for high potency antibody responses only.