Algorithmic pollution: Making the invisible visible

Abstract

In this paper, we focus on the growing evidence of unintended harmful societal effects of automated algorithmic decision-making (AADM) in transformative services (e.g., social welfare, healthcare, education, policing and criminal justice), for individuals, communities and society at large. Drawing from the long-established research on social pollution, in particular its contemporary ‘pollution-as-harm’ notion, we put forward a claim - and provide evidence - that these harmful effects constitute a new type of digital social pollution, which we name ‘algorithmic pollution’. Words do matter, and by using the term ‘pollution’, not as a metaphor or an analogy, but as a transformative redefinition of the digital harm performed by AADM, we seek to make it visible and recognized. By adopting a critical performative perspective, we explain how the execution of AADM produces harm and thus performs algorithmic pollution. Recognition of the potential for unintended harmful effects of algorithmic pollution, and their examination as such, leads us to articulate the need for transformative actions to prevent, detect, redress, mitigate, and educate about algorithmic harm. These actions, in turn, open up new research challenges for the information systems community.

Looking Ahead: Business Intelligence & Analytics Research in the Post-Pandemic New Normal

“…(E) Responsible deployment of BI&A in different contexts: New opportunities created by BI&A in the post-pandemic new normal are often linked to improved efficiency and job automation made possible by automated algorithmic decision-making using analytics and big data. At the same time, there is a growing awareness of the associated unintended harmful effects for individuals, organizations and society at large [1,38,43]. When coupled with automated decision making, the consequences of BI&A, in particular predictive analytics applied to datafied humans [19], go beyond commonly-discussed privacy and security [40].…”

Exploring the role of AI algorithmic agents: The impact of algorithmic decision autonomy on consumer purchase decisions

“…In addition, when the algorithm becomes a pure executor, there may be great problems in the practice of algorithm decision-making, because the past data may be outdated, and people’s preference characteristics may change over time. However, the algorithm decision-making that blindly implements “poor historical data” will strengthen the past shortcomings and accumulate the adverse effects of bias disadvantages ( Marjanovic et al, 2021 ), reflecting the non-intelligence of algorithmic decisions that do not change iteratively with the environment. Based on SDT, when AI algorithms have low decision autonomy, they are characterized as mechanical, rigid, and inflexible, and will only do standardized and repetitive tasks according to a set procedure ( Longoni et al, 2019 ).…”

“…On the one hand, scholars argue that sophisticated algorithms allow online marketers to offer just the right product or service that not only alleviates consumers’ search costs but also alleviates the trade-off of difficult choices and increases the utility they derive from their choices. On the other hand, scholars have argued that algorithmic decision-making can undermine consumers’ sense of autonomy and may be harmful to consumers’ well-being ( André et al, 2018 ), and even cause algorithmic pollution ( Marjanovic et al, 2021 ). This kind of decision-making based solely on interest-based algorithmic recommendations limits users’ access to diverse information and ties them to the “echo chamber” built by AI algorithms.…”

Digital Technology Usage and Associated Socio-Technological Challenges during COVID-19 Pandemic

“…Material response, behavioural change, and human capacity have been proven to be remedies for tackling the pandemic [7]. Instead of automating human decision-making, the role of AI technologies would be to augment and enhance human intelligence and advance decision-making processes above and beyond what is possible by either humans or machines on their own [30]. In addition, marriages, birthday celebrations, family functions, and many other functions are all played out across the online platforms.…”