As government pressure on major technology companies builds, both firms and legislators are searching for technical solutions to difficult platform governance puzzles such as hate speech and misinformation. Automated hash-matching and predictive machine learning tools-what we define here as algorithmic moderation systems-are increasingly being deployed to conduct content moderation at scale by major platforms for user-generated content such as Facebook, YouTube and Twitter. This article provides an accessible technical primer on how algorithmic moderation works; examines some of the existing automated tools used by major platforms to handle copyright infringement, terrorism and toxic speech; and identifies key political and ethical issues for these systems as the reliance on them grows. Recent events suggest that algorithmic moderation has become necessary to manage growing public expectations for increased platform responsibility, safety and security on the global stage; however, as we demonstrate, these systems remain opaque, unaccountable and poorly understood. Despite the potential promise of algorithms or 'AI', we show that even 'well optimized' moderation systems could exacerbate, rather than relieve, many existing problems with content policy as enacted by platforms for three main reasons: automated moderation threatens to (a) further increase opacity, making a famously non-transparent set of practices even more difficult to understand or audit, (b) further complicate outstanding issues of fairness and justice in large-scale sociotechnical systems and (c) re-obscure the fundamentally political nature of speech decisions being executed at scale.

As government pressure on major technology companies builds, both firms and legislators are searching for technical solutions to difficult platform governance puzzles such as hate speech and misinformation. Automated hash-matching and predictive machine learning tools -what we define here as algorithmic moderation systems -are increasingly being deployed to conduct content moderation at scale by major platforms for user-generated content such as Facebook, YouTube and Twitter. This article provides an accessible technical primer on how algorithmic moderation works; examines some of the existing automated tools used by major platforms to handle copyright infringement, terrorism and toxic speech; and identifies key political and ethical issues for these systems as the reliance on them grows. Recent events suggest that algorithmic moderation has become necessary to manage growing public expectations for increased platform responsibility, safety and security on the global stage; however, as we demonstrate, these systems remain opaque, unaccountable and poorly understood. Despite the potential promise of algorithms or 'AI', we show that even 'well optimized' moderation systems could exacerbate, rather than relieve, many existing problems with content policy as enacted by platforms for three main reasons: automated moderation threatens to (a) further increase opacity, making a famously non-transparent set of practices even more difficult to understand or audit, (b) further complicate outstanding issues of fairness and justice in large-scale sociotechnical systems and (c) re-obscure the fundamentally political nature of speech decisions being executed at scale.

Algorithmic governance as a key concept in controversies around the emerging digital society highlights the idea that digital technologies produce social ordering in a specific way.Starting with the origins of the concept, this paper portrays different perspectives and objects of inquiry where algorithmic governance has gained prominence ranging from the public sector to labour management and ordering digital communication. Recurrent controversies across all sectors such as datafication and surveillance, bias, agency and transparency indicate that the concept of algorithmic governance allows to bring objects of inquiry and research fields that had not been related before into a joint conversation. Short case studies on predictive policy and automated content moderation show that algorithmic governance is multiple, contingent and contested. It takes different forms in different contexts and jurisdictions, and it is shaped by interests, power, and resistance.

Standard-Nutzungsbedingungen:Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Zwecken und zum Privatgebrauch gespeichert und kopiert werden.Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich machen, vertreiben oder anderweitig nutzen.Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, gelten abweichend von diesen Nutzungsbedingungen die in der dort genannten Lizenz gewährten Nutzungsrechte. Terms of use: Documents in Christian Katzenbach and Kirsten GollatzAlexander von Humboldt Institute for Internet and Society, Germany AbstractFollowing recent theoretical contributions, this article suggests a new approach to finding the governance in Internet governance. Studies on Internet governance rely on contradictory notions of governance. The common understanding of governance as some form of deliberate steering or regulation clashes with equally common definitions of Internet governance as distributed modes of ordering. Drawing on controversies in the broader field of governance and regulation studies, we propose to resolve this conceptual conundrum by grounding governance in mundane activities of coordination. We define governance as reflexive coordination -focusing on those 'critical moments', when routine activities become problematic and need to be revised, thus, when regular coordination itself requires coordination. Regulation, in turn, can be understood as targeted public or private interventions aiming to influence the behaviour of others. With this distinction between governance and regulation, we offer a conceptual framework for empirical studies of doing Internet governance.

How to integrate artificial intelligence (AI) technologies in the functioning and structures of our society has become a concern of contemporary politics and public debates. In this paper, we investigate national AI strategies as a peculiar form of co-shaping this development, a hybrid of policy and discourse that offers imaginaries, allocates resources, and sets rules. Conceptually, the paper is informed by sociotechnical imaginaries, the sociology of expectations, myths, and the sublime. Empirically we analyze AI policy documents of four key players in the field, namely China, the United States, France, and Germany. The results show that the narrative construction of AI strategies is strikingly similar: they all establish AI as an inevitable and massively disrupting technological development by building on rhetorical devices such as a grand legacy and international competition. Having established this inevitable, yet uncertain, AI future, national leaders proclaim leadership intervention and articulate opportunities and distinct national pathways. While this narrative construction is quite uniform, the respective AI imaginaries are remarkably different, reflecting the vast cultural, political, and economic differences of the countries under study. As governments endow these imaginary pathways with massive resources and investments, they contribute to coproducing the installment of these futures and, thus, yield a performative lock-in function.

Visions of the future are omnipresent in current debates about the digital transformation. This introductory article and the full special issue are concerned with the function, power, and performativity of future visions and how they relate to the making and governing of digital technology. Revisiting existing concepts, we particularly discuss and advance the concept of sociotechnical imaginaries. In difference to ephemeral visions and partisan ideas, imaginaries are collectively held and institutionally stabilized. Nonetheless, we hold that they are multiple, contested, and commodified rather than monolithic, linear visions of future trajectories enacted by state actors. Introducing and summarizing the articles of the special issue, we conclude that imaginaries are increasingly dominated by technology companies that not only take over the imaginative power of shaping future society, but also partly absorb public institutions’ ability to govern these very futures with their rhetoric, technologies, and business models.

This special issue makes an argument for, and illustrates, the applicability of a science and technology studies (STS) informed approach to internet governance research. The conceptual framework put forward in this editorial and the articles composing this issue add to the mainstream internet governance scholarship by unpacking macro questions of politics and power. They do so through the analysis of the mundane and taken-for-granted practices and discourses that constitute the design, regulation, maintenance, and use of both technical and institutional arrangements of internet governance. Together, this body of work calls to rethink how we conceptualise both internet and governance.

Presently, we are witnessing an intense debate about technological advancements in artificial intelligence(AI) research and its deployment in various societal domains and contexts. In this context, media andcommunications is one of the most prominent and contested fields. Bots, voice assistants, automated (fake)news generation, content moderation and filtering – all of these are examples of how AI and machinelearning are transforming the dynamics and order of digital communication.On 20 March 2018 the Alexander von Humboldt Institute for Internet and Society together with the non-governmental organisation Access Now hosted the one-day expert workshop “The turn to AI in governingcommunication online”. International experts from academia, politics, civil society and business gathered inBerlin to discuss the complex socio-technical questions and issues concerning subjects such as artificialintelligence technologies, machine learning systems, the extent of their deployment in content moderationand the range of approaches to understanding the status and future impact of AI systems for governingsocial communication on the internet.This workshop report summarises and documents the authors’ main takeaways from the discussions. Thediscussions, comments and questions raised and responses from experts also fed into the report. The reporthas been distributed among workshop participants. It is intended to contribute current perspectives to thediscourse on AI and the governance of communication.