Despite the importance placed on professional skepticism by the accounting profession and regulators, the failure of auditors to exercise an appropriate level of skepticism continues to be a global issue. We experimentally test a potential barrier to skepticism. We find that outcome knowledge biases supervisors' evaluations of skeptical behavior. Holding a staff member's skeptical judgments and acts constant, superiors on the engagement team evaluate the staff's skeptical behavior based on whether the staff's investigation of an issue ultimately identifies a misstatement. Our evidence suggests that evaluators penalize auditors who employ an appropriate level of skepticism, but do not identify a misstatement. Although consultation with their superiors while exercising skepticism improved staff auditors' performance evaluations, consultation did not effectively mitigate the outcome effect on their evaluations. Last, we observe that auditors in the field anticipate that their superiors will be influenced by outcome knowledge when they evaluate their skeptical behavior. Collectively, our results depict an evaluation system that may inadvertently discourage skepticism among auditors in the field. Data Availability: Contact the authors.
It is an open question whether auditors have credible incentives to exercise professional skepticism. We focus on costly skepticism: skepticism that is appropriate and generates incremental costs, but does not identify a misstatement. Costly skepticism is typically not rewarded by audit supervisors. We theorize and find that rewarding costly skepticism may backfire and decrease skepticism on subsequent audit tasks where evidential red flags are present. We reason that auditors interpret the reward as a non-credible, better-than-expected outcome, leading auditors to view subsequent tasks from a risk-averse gain frame. As a result, auditors self-interestedly seek to avoid the risks and effort of exercising additional skepticism. This effect decreases auditors' sensitivity to red flags and auditors' willingness to inform their manager about severe red flags, compromising audit quality. Encouragingly, auditors who have experienced a history of rewards for costly skepticism are more motivated to exercise skepticism. A survey finds that audit supervisors are likely to reward costly skepticism when their own supervisors encourage the behavior and promote consultation within the engagement team. Overall, our results suggest firms may benefit from a culture shift emphasizing credible rewards for costly skepticism, but that firms currently may not "get what they reward."
In this research note, we replicate Brazel, Jackson, Schaefer, and Stewart's (2016) study of how auditors evaluate skeptical behavior. Like the original study, we find that evaluators reward audit staff who exercise appropriate levels of skepticism and identify a misstatement (positive outcome). However, when no misstatement is identified (negative outcome), evaluators penalize staff who exercise appropriate levels of skepticism. One factor causing this outcome effect may be that exercising skepticism typically causes budget overages due to additional testing. Hence, we examine whether formally attributing the budget overage to skeptical judgments and actions in the audit budget file reduces outcome effects. However, while replicating the initial effect across three separate studies, we have been unable to reduce this effect. Thus, it is clear that the outcome effect in this context is very robust. Data Availability: Contact the authors.
ChatGPT, a language-learning model chatbot, has garnered considerable attention for its ability to respond to users’ questions. Using data from 14 countries and 186 institutions, we compare ChatGPT and student performance for 28,085 questions from accounting assessments and textbook test banks. As of January 2023, ChatGPT provides correct answers for 56.5 percent of questions and partially correct answers for an additional 9.4 percent of questions. When considering point values for questions, students significantly outperform ChatGPT with a 76.7 percent average on assessments compared to 47.5 percent for ChatGPT if no partial credit is awarded and 56.5 percent if partial credit is awarded. Still, ChatGPT performs better than the student average for 15.8 percent of assessments when we include partial credit. We provide evidence of how ChatGPT performs on different question types, accounting topics, class levels, open/closed assessments, and test bank questions. We also discuss implications for accounting education and research.
In three experiments, we find that rewarding professional skepticism can backfire and decrease skepticism on future audit tasks where red flags are present. We focus on rewards for costly skepticism: skepticism that is ex ante appropriate but generates incremental ex post costs and does not identify a misstatement. Auditors interpret a reward for costly skepticism as a better-than-expected outcome and view subsequent tasks from a risk-averse gain frame. As a result, auditors seek to avoid the downside risk of skeptical action, which decreases auditors' sensitivity to red flags and their willingness to communicate severe red flags to their managers, compromising audit quality. However, we also find that a supervisor consistently rewarding costly skepticism decreases auditors' risk aversion and increases their skepticism. In sum, auditors believe skeptical action has downside risk. A cultural shift towards credible, consistent rewards for appropriate skepticism likely helps ensure that rewards have their intended effect.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.