The ethical agency of AI developers

Abstract

Public and academic discourse about the ethics of artificial intelligence, machine learning, and data science has largely focused on the algorithms and the companies deploying them. Little attention has been paid to the ethical agency of the developers. This study is the first of its kind that centers developers in the ethical environment. Semi-structured interviews with 40 developers about the ethics of being a developer revealed more than 20 themes, 3 of which are the subject of this paper: ethics in the occupational ecosystem, developer ethical agency, and the characteristics of an ethical developer. These themes reveal significant gaps between how developers perceive themselves and the reality of their work experiences. Their ethical agency is likewise variable. They have some authority to intervene for ethical reasons in systems they work on, but they often do not realize just how many ethical decisions they make. Nonetheless, this study reveals a growing ethical wisdom in this community, one that needs to be surfaced and nurtured by engaging with developers.

The Ethics of Electronic Tracking Devices in Dementia Care: An Interview Study with Developers

“…While developers have responsibilities related to professionalism (e.g., quality control, informed consent) and risk management (e.g., anticipate and pre-empt introducing harms), moral responsibility mainly rests on how these tools are used. This view is echoed in recent research on the ethical agency of artificial intelligence developers (Griffin, Green, & Welie, 2023 ). This concept that technology is neutral, having no built-in tendency to be good or bad, and its ethical impact arising from how it is used, is known in the philosophy of technology literature as the neutrality thesis (Morrow, 2014 ).…”

Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teams

“…They ask for tools that fit into their resource constraints, as ML practices outside of big tech may not have the bandwidth to carry out some of the responsible AI investigations of larger companies [29]. Finally, technologists require structures for discussing and reflecting on the ethical implications of their work [10,16,24,28]. Conflicts between values themselves and between different professionals will arise naturally, so to address this organisations will need to "(...) mobilize resources to create safe spaces and encourage explicit disagreements among practitioners positively [and] enable them to constantly question RAI values (...)" [59, p.13].…”

“…As the importance of the data and AI industry grows, the work of these teams has an increasing impact on society. Recent studies [10,24,46] of data science, machine learning and artificial intelligence practitioners have shown that ethical decision-making is part of the everyday technical design choices practitioners have to make, but they are not always aware of it. In fact, discussing values outside of the technical remit of performance and considering societal needs has often been neglected in the field of AI [9].…”

“…One proposed solution to bring more ethical sensitivity into the field is to educate technologists via discussions about ethics [10,24]. Ethical roleplay has been extensively studied in the context of university education, including in computer science [51].…”

How generative artificial intelligence has blurred notions of authorial identity and academic norms in higher education, necessitating clear university usage policies

“…Artificial intelligence's (AI) growing popularity is evident in its uptake amongst major technology conglomerates. For example, Google have announced the introduction of GenAI chatbots into its productivity tools Gmail, Sheets and Docs (Kurian, 2023). Moreover, Microsoft are reportedly investing $3bn into OpenAI (Bass, 2023) introducing GenAI features into their ubiquitous Microsoft Office programmes, which are used by most students in their university work (Kelly, 2023).…”