Background Previous eye-tracking studies provide preliminary evidence for a hypersensitivity to negative, potentially threatening interpersonal cues in borderline personality disorder (BPD). From an etiological point of view, such interpersonal threat hypersensitivity might be explained by a biological vulnerability along with a history of early life adversities. The objective of the current study was to investigate interpersonal threat hypersensitivity and its association with adverse childhood experiences (ACE) in patients with BPD employing eye-tracking technology. Methods We examined a sample of 46 unmedicated, adult female patients with BPD and 25 healthy female volunteers, matched on age and intelligence, with a well-established emotion classification paradigm with angry, fearful, happy, and neutral facial expressions. ACE were assessed retrospectively with the Childhood Trauma Questionnaire. Results Patients as compared to healthy volunteers reflexively directed their gaze more quickly towards the eyes of emotional and neutral faces and did not adapt their fixation patterns according to the facial expression presented. Misclassifying emotional and neutral faces as angry correlated positively with the patients’ self-reported ACE. Conclusions Building on and extending earlier findings, our results are likely to suggest a visual hypervigilance towards the eyes of emotional and neutral facial expressions and a childhood trauma-related anger bias in patients with BPD. Given the lack of a clinical control group, the question whether these findings are specific for BPD has to remain open. Thus, further research is needed to elucidate the specificity of altered visual attention allocation and the role of ACE in anger recognition in patients with BPD.