Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study

Abstract

Background ChatGPT is a conversational large language model that has the potential to revolutionize knowledge acquisition. However, the impact of this technology on the quality of education is still unknown considering the risks and concerns surrounding ChatGPT use. Therefore, it is necessary to assess the usability and acceptability of this promising tool. As an innovative technology, the intention to use ChatGPT can be studied in the context of the technology acceptance model (TAM). Objective This study aimed to develop and validate a TAM-based survey instrument called TAME-ChatGPT (Technology Acceptance Model Edited to Assess ChatGPT Adoption) that could be employed to examine the successful integration and use of ChatGPT in health care education. Methods The survey tool was created based on the TAM framework. It comprised 13 items for participants who heard of ChatGPT but did not use it and 23 items for participants who used ChatGPT. Using a convenient sampling approach, the survey link was circulated electronically among university students between February and March 2023. Exploratory factor analysis (EFA) was used to assess the construct validity of the survey instrument. Results The final sample comprised 458 respondents, the majority among them undergraduate students (n=442, 96.5%). Only 109 (23.8%) respondents had heard of ChatGPT prior to participation and only 55 (11.3%) self-reported ChatGPT use before the study. EFA analysis on the attitude and usage scales showed significant Bartlett tests of sphericity scores (P<.001) and adequate Kaiser-Meyer-Olkin measures (0.823 for the attitude scale and 0.702 for the usage scale), confirming the factorability of the correlation matrices. The EFA showed that 3 constructs explained a cumulative total of 69.3% variance in the attitude scale, and these subscales represented perceived risks, attitude to technology/social influence, and anxiety. For the ChatGPT usage scale, EFA showed that 4 constructs explained a cumulative total of 72% variance in the data and comprised the perceived usefulness, perceived risks, perceived ease of use, and behavior/cognitive factors. All the ChatGPT attitude and usage subscales showed good reliability with Cronbach α values >.78 for all the deduced subscales. Conclusions The TAME-ChatGPT demonstrated good reliability, validity, and usefulness in assessing health care students’ attitudes toward ChatGPT. The findings highlighted the importance of considering risk perceptions, usefulness, ease of use, attitudes toward technology, and behavioral factors when adopting ChatGPT as a tool in health care education. This information can aid the stakeholders in creating strategies to support the optimal and ethical use of ChatGPT and to identify the potential challenges hindering its successful implementation. Future research is recommended to guide the effective adoption of ChatGPT in health care education.

ChatGPT Usage and Attitudes are Driven by Perceptions of Usefulness, Ease of Use, Risks, and Psycho-Social Impact: A Study among University Students in the UAE

“…The ndings of this study revealed that 85% of the participating university students have already used ChatGPT. An early study conducted during February-March 2023 among university students in health schools in Jordan reported that only 11% used ChatGPT at the time (Sallam et al 2023a). A subsequent multinational study that involved university students in ve Arab countries (Iraq, Kuwait, Egypt, Lebanon, and Jordan) during April-August 2023 reported ChatGPT usage at a rate of 25% (Abdaljaleel et al 2024).…”

“…This study adopted a validated survey instrument based on the technology acceptance model (TAM) and speci cally tailored to measure the attitude towards ChatGPT among university students (Sallam et al 2023a). The survey instrument validity was con rmed in a recently published multinational study among university students in ve Arab countries (Abdaljaleel et al 2024).…”

“…Understanding the factors driving the AI adoption into higher education can inform the development of effective implementation strategies (Kamalov et al 2023 A comprehensive framework for assessment of the determinant of adopting a novel technology can be based on the Technology Acceptance Model (TAM) (Davis 1989;Marangunić and Granić 2015;Bagozzi et al 1992). Based on TAM, a recently developed and validated instrument termed "TAME-ChatGPT" described several factors as drivers of the attitude to ChatGPT and its usage among university students (Sallam et al 2023a). These factors include the perceived usefulness, behavioral and cognitive factors, general perceived risks and the perceived risks of use, the perceived ease of use, anxiety, attitude to technology and social in uence (Sallam et al 2023a).…”

“…Based on TAM, a recently developed and validated instrument termed "TAME-ChatGPT" described several factors as drivers of the attitude to ChatGPT and its usage among university students (Sallam et al 2023a). These factors include the perceived usefulness, behavioral and cognitive factors, general perceived risks and the perceived risks of use, the perceived ease of use, anxiety, attitude to technology and social in uence (Sallam et al 2023a).…”

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice Questions

“…This research endeavor is necessary to guide the ethical, responsible, and productive use of AI to enhance higher education guided by a robust scienti c evidence [14,16,17]. The relevance of the quest to meticulously examine the bene ts and challenges of AI in higher education is also important in light of the current evidence showing that a substantial number of university students are already using AI chatbots [18][19][20][21][22].…”