The Ethics of Psychological Artificial Intelligence: Clinical Considerations

Abstract

Psychological artificial intelligence has a growing research base but often overlooks ethical considerations. Drawing from a review of the literature, the experiences of three counselor educators, and an industry insider, this article names six issues relevant to psychological artificial intelligence. The clinical implications of each issue are discussed, some at the national level, some at the practice level. Suggestions for the counseling profession, with an emphasis on prevention, are offered.

A Call to Action on Assessing and Mitigating Bias in Artificial Intelligence Applications for Mental Health

“…Or what if an algorithm gets a diagnosis or prediction wrong? Applying AI to clinical-psychological problems requires researchers and developers to carefully consider issues such as privacy and confidentiality; harm prevention; risk and emergency monitoring and response; the development and adoption of regulatory frameworks for AI use; the identification and prevention of the misapplication of algorithms developed; an understanding of the implications of replacing established services; respect and protection of autonomy; transparency in building and applying algorithms; and understanding the long-term implications of algorithmic use and misuse (e.g., Fiske et al, 2019; Fulmer et al, 2021; Noor, 2020).…”

Artificial intelligence (AI) in psychology: a commentary on AI’s emerging role and the ensuing conversation

“…This could lead to job displacement, necessitating the development of new skills. However, AI disruption may boost productivity and reduce costs while possibly worsening economic inequality, which would require much ethical consideration (Ahmed et al, 2022;Campbell et al, 2022;Dwivedi et al, 2021Dwivedi et al, , 2023Fulmer et al, 2021;Russell & Norvig, 2021).…”

“…Furthermore, AI is being used to develop and deliver personalised treatment plans for individuals with mental health conditions. Chatbots and virtual agents can provide automated therapy and support, including cognitive-behavioural therapy (CBT), in a cost-effective and scalable manner that has been proven to be effective (Fulmer et al, 2018(Fulmer et al, , 2021. However, some authors have raised concerns about the use of AI therapeutics without sufficient research into ethical safeguards (Al Hanai et al, 2018;Fitzpatrick et al, 2017;Fulmer et al, 2018Fulmer et al, , 2021Luxton, 2015).…”

“…Chatbots and virtual agents can provide automated therapy and support, including cognitive-behavioural therapy (CBT), in a cost-effective and scalable manner that has been proven to be effective (Fulmer et al, 2018(Fulmer et al, , 2021. However, some authors have raised concerns about the use of AI therapeutics without sufficient research into ethical safeguards (Al Hanai et al, 2018;Fitzpatrick et al, 2017;Fulmer et al, 2018Fulmer et al, , 2021Luxton, 2015). While the integration of AI in mental health treatment, such as automated therapy through chatbots, might have the potential to offer a cost-effective and scalable solution for developing countries, ethical concerns, including the need for refined regulations to define 'psychological acts' and ethical standards in cyberspace (such as confidentiality, anonymity, and safe recordkeeping), could be addressed to ensure public safety and ethical safeguards in AI therapeutics.…”

“…AI is revolutionising academic research, content creation, teaching and learning, and even professional psychological services, at an unprecedented rate because of technological advancements. This brief commentary explores the possibilities and challenges that AI presents for South African academics, authors, researchers, and practitioners in the field of psychology (Fulmer et al, 2021; Luxton, 2014; Popenici & Kerr, 2017; S. V. Singh & Hiran, 2022; Sutton, 2023).…”