The generation of polyfunctional CD8+ T cells, in response to vaccination or natural infection, has been associated with improved protective immunity. However, it is unclear whether the maintenance of polyfunctionality is related to particular cellular phenotypic characteristics. To determine whether the cytokine expression profile is linked to the memory differentiation stage, we analyzed the degree of polyfunctionality of HIV-specific CD8+ T cells within different memory subpopulations in 20 ART-naïve HIV-1 infected individuals at approximately 34 weeks post infection. These profiles were compared with CMV-specific CD8+ T cell responses in HIV-uninfected controls and in individuals chronically infected with HIV. Our results showed that the polyfunctional abilities of HIV-specific CD8+ T cells differed according to their memory phenotype. Early-differentiated cells (CD45RO+CD27+) exhibited a higher proportion of cells positive for three or four functions (p<0.001), and a lower proportion of mono-functional cells (p<0.001) compared to terminally-differentiated (CD45RO−CD27−) HIV-specific CD8+ T cells. The majority of terminally-differentiated HIV-specific CD8+ T cells were mono-functional (median 69% [IQR: 57–83]), producing predominantly CD107a or MIP1β. Moreover, proportions of HIV-specific mono-functional CD8+ T cells positively associated with proportions of terminally-differentiated HIV-specific CD8+ T cells (p=0.019, r=0.54). In contrast, CMV-specific CD8+ T cell polyfunctional capacities were similar across all memory subpopulations, with terminally- and early-differentiated cells endowed with comparable polyfunctionality. Overall, these data show that the polyfunctional abilities of HIV-specific CD8+ T cells are influenced by the stage of memory differentiation, which is not the case for CMV-specific responses.