Presentation in Self-Posted Facial Images Can Expose Sexual Orientation: Implications for Research and Privacy

Abstract

Recent research has found that facial recognition algorithms can accurately classify people’s sexual orientations using naturalistic facial images, highlighting a severe risk to privacy. This article tests whether people of different sexual orientations presented themselves distinctively in photographs, and whether these distinctions revealed their sexual orientation. I found significant differences in self-presentation. For example, gay individuals were on average more likely to wear glasses compared to heterosexual individuals in images uploaded to the dating website. Gay men also uploaded brighter images compared to heterosexual men. To further test how some of these differences drove the classification of sexual orientation, I employed image augmentation or modification techniques. To evaluate whether the image background contributed to classifications, I progressively masked images until only a thin border of image background remained in each facial image. I found that even these pixels classified sexual orientations at rates significantly higher than random chance. I also blurred images, and found that merely three numbers representing the brightness of each color channel classified sexual orientations. These findings contribute to psychological research on sexual orientation by highlighting how people chose to present themselves differently on the dating website according to their sexual orientations, and how these distinctions were used by the algorithm to classify sexual orientations. The findings also expose a privacy risk as they suggest that do-it-yourself data-protection strategies, such as masking and blurring, cannot effectively prevent leakage of sexual orientation information. As consumers are not equipped to protect themselves, the burden of privacy protection should be shifted to companies and governments.

How you look is who you are: The appearance reveals character lay theory increases support for facial profiling.

“…Finally, whereas the physiognomic beliefs scale is focused only on the face, the appearance reveals character lay theory scale incorporates other aspects of appearance, such as body shape/size, hairstyle, and clothes. This is an important distinction as recent research suggests that the inference of specific character traits from appearance may also be influenced by factors other than the face (Gelman et al, 2018; Wang, in press). Thus, our construct taps a much more general belief than the physiognomic beliefs scale across three dimensions.…”

“…However, asking people to think about appearance more broadly would lead them to think of other salient features of appearance that are under the individual’s control (e.g., hair, clothes), and may not activate self-presentation concerns to the same extent. Third, despite the terminology, facial profiling algorithms do not just take individuals’ faces as their input—they take all aspects of the person’s appearance visible in the person’s photograph, including the face and several extrafacial characteristics (e.g., Wang, in press).…”