Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas

Haimson, Oliver L.; Delmonaco, Daniel; Nie, Peipei; Wegner, Andrea

doi:10.1145/3479610

Cited by 100 publications

(39 citation statements)

References 52 publications

(68 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This requires a much greater investment in good quality moderationsomething which even non-adult platforms currently struggle with -but which must be implemented if platforms are not to continue to marginalize the vulnerable. This issue in online sex work exactly mirrors the problems discussed in social media content moderation by Díaz and Hecht-Felella [148], Haimson et al [55], Schoenbeck et al [117] and many other scholars.…”

Section: Implications For Digital Experience and Designsupporting

confidence: 68%

Risk, Resilience and Reward: Impacts of Shifting to Digital Sex Work

Hamilton¹,

Barakat²,

Redmiles³

2022

Preprint

View full text Add to dashboard Cite

Workers from a variety of industries rapidly shifted to remote work at the onset of the COVID-19 pandemic. While existing work has examined the impact of this shift on office workers, little work has examined how shifting from in-person to online work affected workers in the informal labor sector. We examine the impact of shifting from in-person to online-only work on a particularly marginalized group of workers: sex workers. Through 34 qualitative interviews with sex workers from seven countries in the Global North, we examine how a shift to online-only sex work impacted:(1) working conditions, (2) risks and protective behaviors, and (3) labor rewards. We find that online work offers benefits to sex workers' financial and physical well-being. However, online-only work introduces new and greater digital and mental health risks as a result of the need to be publicly visible on more platforms and to share more explicit content. From our findings we propose design and platform governance suggestions for digital sex workers and for informal workers more broadly, particularly those who create and sell digital content.

show abstract

Section: Implications For Digital Experience and Designsupporting

confidence: 68%

Risk, Resilience and Reward: Impacts of Shifting to Digital Sex Work

Hamilton¹,

Barakat²,

Redmiles³

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Simpson and Semaan (2021) argued based on interviews with LGBTQ+ TikTok users that, while the platform did in some cases reaffirm their identities by showing them relevant personalized recommendations, the algorithms tended to promote normative representations of those identities, e.g., "mainstream" lesbian content. Oliver L. Haimson et al (2021b) found, based on user self-reports, that transgender users experienced disproportionately high levels of content removal, and Caplan and Gillespie (2020) referenced a number of cases in which LGBTQ+ users felt they had been targeted by YouTube's moderation algorithms because of their identities. Yet despite an extensive literature on conflicts, perhaps the most common form of interaction between users and platforms is a lack thereof.…”

Section: Despite the Relative Dearth Of Studies Specifically On Volun...mentioning

confidence: 99%

“…Though a very different problem, hate and harassment have proven similarly difficult for platforms to define in different contexts; language indicative of racism or homophobia in one context may have been co-opted to be humorous or even friendly when used within the targeted groups. While various platforms have attempted to find universal, contextagnostic responses to such problems, their attempts have consistently failed to achieve the desired results (Gillespie 2018;Oliver L. Haimson et al 2021b). Community-based platforms that rely on volunteer moderators can allow users some leeway to define these lines within their own communities, partially addressing the challenge of moderating content differently in different contexts.…”

mentioning

confidence: 99%

Pride and Professionalization in Volunteer Moderation: Lessons for Effective Platform-User Collaboration

Seering¹,

Dym²,

Kaufman³

et al. 2022

jots

View full text Add to dashboard Cite

While most moderation actions on major social platforms are performed by either the platforms themselves or volunteer moderators, it is rare for platforms to collaborate directly with moderators to address problems. This paper examines how the group-chatting platform Discord coordinated with experienced volunteer moderators to respond to hate and harassment toward LGBTQ+ communities during Pride Month, June 2021, in what came to be known as the "Pride Mod" initiative. Representatives from Discord and volunteer moderators collaboratively identified and communicated with targeted communities, and volunteers temporarily joined servers that requested support to supplement those servers' existing volunteer moderation teams. Though LGBTQ+ communities were subject to a wave of targeted hate during Pride Month, the communities that received the requested volunteer support reported having a better capacity to handle the issues that arose. This paper reports the results of interviews with 11 moderators who participated in the initiative as well as the Discord employee who coordinated it. We show how this initiative was made possible by the way Discord has cultivated trust and built formal connections with its most active volunteers, and discuss the ethical implications of formal collaborations between for-profit platforms and volunteer users.

show abstract

“…Cheney-Lippold (2011), on the other hand, speaks of the "soft power" of algorithms to refer to their influence on the existential possibilities of individuals. Many empirical pieces of research highlight the authority of algorithms in the fields in which they are applied (Haimson et al, 2021;Graham & Rodriguez, 2021;Gorwa et al, 2020;Campbell-Verduyn et al, 2017). Among these, we can mention Ma and Kou (2021) research in which emerges that the algorithm underlying the moderation of YouTube's content can orient not only the individual and collective action of YouTubers but also their feelings of insecurity and precariousness.…”

Section: Emerging Features Of Socio-digital Objectsmentioning

confidence: 99%

Traces and Algorithms as Socio-digital Objects

Amaturo

Falco

2022

Frontiers in Sociology and Social Research

View full text Add to dashboard Cite

The growing masses of digital traces generated by the datafication process make the algorithms that manage them increasingly central to contemporary society.There is widespread agreement in considering traces and algorithms as complex objects that intertwine social and material practices with their own cultural, historical, and institutional nature (Halford et al., 2010).Accordingly, given this strong intertwining between the social world and the digital world that is formed by material and technological objects, it becomes possible to consider the algorithms and traces as socio-digital objects. For this reason, this article aims to identify the features that allow us to frame them as socio-digital objects starting from concepts borrowed from the actor-network theory (Latour and Woolgar 1879). In particular, we will first discuss opacity, authority and autonomy concepts and then see how those features emerge in digital geographical traces.

show abstract

Disproportionate Removals and Differing Content Moderation Experiences for Conservative, Transgender, and Black Social Media Users: Marginalization and Moderation Gray Areas

Abstract: Transgender refers to people whose current gender is diferent than their gender assigned at birth, including non-binary trans people. We shorten transgender to "trans" for the remainder of this paper.

Cited by 100 publications

References 52 publications

Risk, Resilience and Reward: Impacts of Shifting to Digital Sex Work

Risk, Resilience and Reward: Impacts of Shifting to Digital Sex Work

Pride and Professionalization in Volunteer Moderation: Lessons for Effective Platform-User Collaboration

Traces and Algorithms as Socio-digital Objects

Contact Info

Product

Resources

About