Selfies as Duplex Non-verbal Communication: Human—Media Interaction, Human—Human Interaction, Case Study, and Research Manifesto

Abstract

Using conceptual tools from semiotics, proxemics, and sensorimotor neuroscience, we propose a duplex model for understanding selfies as non-verbal communication involving an interplay between two layers of interaction: human-media (semiotically primary) and human-human (secondary). We suggest that this approach has promise as a tool for understanding this newborn form of human social behavior and its social, psychological, and neural underpinnings. To support our claim, we do several things. We offer a definition of selfies and outline our model. We review the existing literature on selfies as non-verbal communication to show that there is evidence bearing on our theoretical framework. We present a case study documenting how a combination of image analysis and kinematic measurement can be used to compare taker-smartphone interactions during selfie-taking with image features that play a role in the virtual interaction between the selfie-taker and his or her viewers. Our results support the feasibility of our approach and reveal a sex-related effect on the composition of selfies matching a related difference in the kinematic markers that describe the taker-smartphone interaction. Finally, we discuss outstanding questions in understanding selfies as duplex non-verbal communication and conclude by inviting further research on this topic.

Face masks modulate non-verbal communication in selfies, but do not affect beauty ratings

“…It is generally believed that wearing face masks impacts interpersonal communication in various ways (Mheidly, Fare, Zalzale & Fares, 2020), although the current literature on the issue features mixed results. We studied how face masks may impact the composition of sel es, conceived as a novel mean of non-verbal communication and self-presentation within digital media (Bruno, Uccelli, Pisu et al, 2020). Our results complement those of numerous studies published within the last two years on in-person communication while wearing masks, and clarify some contradictions in the literature.…”

“…In this paper, we purport to extend assessments of the effect of masks on interpersonal interactions to non verbal communication through digital media. Speci cally, we have investigated mask effects on how individuals compose sel es, individual self-portraits taken with a mobile device digital camera by amateur photographers (Bruno, Uccelli, Pisu et al, 2020). Over the last decade, there has been a continuous increase in the use of sel es in online interactions, by posting on media such as Facebook, Instagram, Snapchat, or Tinder, or by sharing on an individual basis with friends or loved ones via emails, text messages, or chats.…”

Utilizing Instagram Data to Identify Usage Patterns Associated With Schizophrenia Spectrum Disorders

“…Although not specifically explored here, an important question for future research would be to assess differences in face count throughout illness progression and exacerbation as symptoms, and social interactions, fluctuate over time. Further, prior work has demonstrated the significance of posting self-portraits (selfies, for example) as a non-verbal tool of communicating intention from sender to receiver (61). Accordingly, future work should consider exploring potential differences in the use of selfies, as well as other metrics such as the face to background distribution, facial angle, and facial expressions in individuals diagnosed with SSD.…”

Nonverbal communication in selfies posted on Instagram: Another look at the effect of gender on vertical camera angle

“…Selfies are a novel form of non-verbal communication: by choosing specific poses or by manipulating other pictorial features in the images, selfie-takers are assumed to provide non-verbal social and emotional signals to potential viewers [4]. In a recent paper, Bruno, Uccelli, Pisu, Belluardo & De Stefani [5] proposed that these signals may be conceptualized, within the two dimensional framework of the picture, as analogous to the non-verbal signals that we use in face-to-face communication. In face-to-face interactions, individuals control interpersonal distance, body posture, and facial expressions to modulate the quality of the exchange on dimensions such as approach-avoidance, intimacy-social distance, or positive-negative affect.…”

“…A better understanding of the potential role of selfies in interpersonal communication has theoretical and practial implications. At the theoretical level, assessments of the association between communicative intent and compositional choices represent a test of the predictions of current theories of non-verbal communication in selfies [ 5 ]. Practically, such assessment may provide useful in designing systems for automatically extracting user information from posted self portraits [ 32 , 33 ], for applications aimed at health-related behavior modification [ 34 – 36 ], and for medical applications implementing internet-based patient monitoring [ 37 – 39 ].…”