Perceptually categorizing a face to its racial belonging may have important consequences on interacting with people. However, race categorical perception (CP) has been scarcely investigated nor its developmental pathway. In this study, we tested the neurolinguistics rewiring hypothesis, stating that language acquisition modulates the brain processing of social perceptual categories. Accordingly, we investigated the electrophysiological correlates of race CP in a group of adults and children between 3 and 5 years of age. For both groups we found a greater modulation of the N400 connected with the processing of between category boundaries (i.e., faces belonging to different race groups) than within-category boundaries (i.e., different faces belonging to the same race group). This effect was the same in both adults and children, as shown by the comparable between-group amplitude of the differential wave (DW) elicited by the between-category faces. Remarkably, this effect was positively correlated with racial-labels acquisition, but not with age, in children. Finally, brain source analysis revealed the activation of a more modularized cortical network in adults than in children, with unique activation of the left superior temporal gyrus (STG) and the inferior frontal gyrus (IFG), which are areas connected to language processing. These are the first results accounting for an effect of language in rewiring brain connectedness when processing racial categories.