Multiple-choice questions (MCQs) evaluate factual knowledge in medical education and have a high reliability, if performed appropriately. However, many MCQs contain formal errors leading to reduced validity. The authors developed a Web application capable of recognizing and eliminating five frequent contraindicated practices in MCQs: negative stem, unfocused stem, cueing words, longest item ¼ right item flaw, and stem/item similarities. The authors used simple string algorithms and dynamic comparisons with keywords. The system was successfully validated with a sample of approximately 800 continuous medical education (CME) questions, showing that our system automatically detects 60% of all formal didactic errors. Flaws not detected by the software can easily be avoided using quick manuals on item wording or clear instruction to the authors. The authors conclude that it is feasible to improve the quality of MCQs by designing a Web application that is capable of detecting common flaws by simple string operations.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.