Our understanding of innate immune responses in human rectal mucosal tissues (RM) and their contributions to promoting or restricting HIV transmission is limited. We defined the RM composition of innate and innate-like cell subsets, including plasmacytoid dendritic cells; CD1c + myeloid DCs; neutrophils; macrophages; natural killer cells (NK); Marginal Zone-like B cells (MZB); γδ T cells; and mucosal-associated invariant T cells in RM from 69 HIV-negative men by flow cytometry. Associations between these cell subsets and HIV-1 replication in ex vivo RM explant challenge experiments revealed an inverse correlation between RM-NK and p24 production, in contrast to a positive association between RM-MZB and HIV replication. Comparison of RM and blood-derived MZB and NK illustrated qualitative and quantitative differences between tissue compartments. Additionally, 22 soluble molecules were measured in a subset of explant cultures (n = 26). Higher production of IL-17A, IFN-γ, IL-10, IP-10, GM-CSF, sFasL, Granzyme A, Granzyme B, Granulysin, and Perforin following infection positively correlated with HIV replication. These data show novel associations between MZB and NK cells and p24 production in RM and underscore the importance of inflammatory cytokines in mucosal HIV infection, demonstrating the likely critical role these innate immune responses play in early mucosal HIV replication in humans.