Prior work has shown that whether or not someone is similar to the self influences person memory—a type of self-reference effect for others. In this study, we were interested in understanding the neural regions supporting the generation of impressions and subsequent memory for targets who vary in similarity to the self. Participants underwent fMRI scanning while forming positive or negative impressions of face-behavior pairs. We tested participants’ memory for their generated impressions, and then back-sorted the impression trials (encoding) into different levels of self-similarity (high, medium, low) using a self-similarity post-test that came after recognition. Extending prior behavioral work, our data confirmed our hypothesis that memory would be highest for self-similar others and lowest for self-dissimilar others. Dorsal anterior cingulate cortex (dACC) activity increased with self-similarity (high > medium > low) to targets, regardless of later memory for them. An analysis of regions supporting impression memory revealed a double dissociation within medial temporal lobe regions: for similar others, amygdala recruitment supported memory, whereas for dissimilar others, hippocampal activation supported memory. These results suggest that self-similarity influences evaluation and memory for targets, but also affects the underlying neural resources engaged when thinking about others who vary in self-similarity.