Introduction: Semantic and phonemic verbal fluency tasks are the most used verbal fluency versions to evaluate dementia patients, while unconstrained and action fluencies have been poorly investigated in aging. This study aimed to evaluate if the factors diagnosis, age, and reading and writing habits can predict the performance of four types of verbal fluency in healthy elderly (HE), mild cognitive impairment (MCI), and Alzheimer’s disease (AD) participants. Method: Eighty participants were included in this study (21 mild AD, 32 MCI, and 27 HE). The participants performed a reading and writing habits questionnaire, neuropsychological evaluation, and semantic, phonemic, unconstrained, and action verbal fluency tasks. Diagnosis, age, and reading and writing habits were entered as predictors in a stepwise linear regression model for each of the four verbal fluency tasks. Results: The stepwise procedure eliminated age for all models as being nonsignificant. Unconstrained and semantic verbal fluency were better predicted by the diagnosis followed by reading and writing habits. On the other hand, phonemic and action verbal fluency were better predicted by reading and writing habits followed by diagnosis. Conclusion: Reading and writing habits contributed to the prediction of all verbal fluency tasks, highlighting their role in cognitive function. The sensitivity of these verbal fluency tasks to sociocultural and clinical factors should be considered in the neuropsychological assessment.