Impact of explainable artificial intelligence assistance on clinical decision-making of novice dental clinicians

Abstract

Objective Despite artificial intelligence (AI) being used increasingly in healthcare, implementation challenges exist leading to potential biases during the clinical decision process of the practitioner. The interaction of AI with novice clinicians was investigated through an identification task, an important component of diagnosis, in dental radiography. The study evaluated the performance, efficiency, and confidence level of dental students on radiographic identification of furcation involvement (FI), with and without AI assistance. Materials and Methods Twenty-two third- and 19 fourth-year dental students (DS3 and DS4, respectively) completed remotely administered surveys to identify FI lesions on a series of dental radiographs. The control group received radiographs without AI assistance while the test group received the same radiographs and AI-labeled radiographs. Data were appropriately analyzed using the Chi-square, Fischer’s exact, analysis of variance, or Kruskal–Wallis tests. Results Performance between groups with and without AI assistance was not statistically significant except for 1 question where tendency was to err with AI-generated answer (P < .05). The efficiency of task completion and confidence levels was not statistically significant between groups. However, both groups with and without AI assistance believed the use of AI would improve the clinical decision-making. Discussion Dental students detecting FI in radiographs with AI assistance had a tendency towards over-reliance on AI. Conclusion AI input impacts clinical decision-making, which might be particularly exaggerated in novice clinicians. As it is integrated into routine clinical practice, caution must be taken to prevent overreliance on AI-generated information.

Barriers and Facilitators of Artificial Intelligence in Family Medicine: An Empirical Study With Physicians in Saudi Arabia

“…More than two-thirds of the participants used AI assistants, with the majority among them using them more than ten times in the previous month indicating gradual penetration of AI assistants in family medicine. Similar results were identified in other studies focusing on specialties like cardiology and other healthcare departments on the use of AI assistants in clinical decision-making [ 27 - 30 ]. The results from the survey analysis have indicated various barriers and facilitators, which had a differential impact on the participants.…”

Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting

“…Furthermore, even though the difference in initial trust between novice and expert readers was not significant (adjusted p, 0.439; RBC, 0.15), the difference in final trust was instead significant (adjusted p, 0.009; RBC, 0.54), with the novice readers reporting, on average, a higher final trust than the expert ones. This is in line with previous studies in the field of human-AI interaction [23,24,41,42], which showed how novice readers are more willing to accept the support of an AI-based system, and better appreciate its output. An explanation for this widely reported observation can be traced back to the literature in the Theory of Technological Dominance (TTD) [39], in which a previous finding from Noga and Arnold [43] identified user expertise as one of the main determinants of dominance and reliance, of which trust is a determinant.…”

Artificial intelligence‐assisted full‐mouth radiograph mounting in dental education

“…It has been demonstrated in similar studies that clinicians' behaviors change towards favoring AI when it is involved. 16,17 Prior research has noted that novice clinical practitioners often exhibit an over-reliance on AI. In this present study, a parallel over-reliance on AI was observed among the participating students.…”