ChatGPT, a language-learning model chatbot, has garnered considerable attention for its ability to respond to users’ questions. Using data from 14 countries and 186 institutions, we compare ChatGPT and student performance for 28,085 questions from accounting assessments and textbook test banks. As of January 2023, ChatGPT provides correct answers for 56.5 percent of questions and partially correct answers for an additional 9.4 percent of questions. When considering point values for questions, students significantly outperform ChatGPT with a 76.7 percent average on assessments compared to 47.5 percent for ChatGPT if no partial credit is awarded and 56.5 percent if partial credit is awarded. Still, ChatGPT performs better than the student average for 15.8 percent of assessments when we include partial credit. We provide evidence of how ChatGPT performs on different question types, accounting topics, class levels, open/closed assessments, and test bank questions. We also discuss implications for accounting education and research.
This study tests whether economic value added (EVA) as a performance evaluation metric incentivizes public administrators to increase the performance of public organizations. It utilizes data from Wind Info Database (WIND) and finds that the adoption of EVA as a performance evaluation metric incentivizes public administrators to increase the overall efficiency of the public organizations under study. The study suggests that public administrators make prudent investment and operating decisions after the adoption of EVA as their performance evaluation metric, thereby increasing the overall organizational performance. Using 2274 firm-year observations for the period from 2009 to 2010 in China, this paper uses first-difference change analysis methodology that takes care of firm-level unobservable heterogeneities and addresses endogeneity concerns, thereby producing robust results. The change analysis setting has been used in prior studies to find the effect of certain treatment (e.g., Lyons et al. 2001; Kerr et al. 2006; Pal and Pohit 2014). Lyons et al. (2001) argue that the change analysis focuses on studying differences before and after services (i.e., the presence and absence of treatment) that are received. In our research design, the treatment is adoption of EVA by the SASAC, which occurred in year 2010.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.