Using the Angoff method to set a standard on mock exams for the Korean Nursing Licensing Examination

Abstract

Purpose: This study explored the possibility of using the Angoff method, in which panel experts determine the cut score of an exam, for the Korean Nursing Licensing Examination (KNLE). Two mock exams for the KNLE were analyzed. The Angoff standard setting procedure was conducted and the results were analyzed. We also aimed to examine the procedural validity of applying the Angoff method in this context.Methods: For both mock exams, we set a pass-fail cut score using the Angoff method. The standard setting panel consisted of 16 nursing professors. After the Angoff procedure, the procedural validity of establishing the standard was evaluated by investigating the responses of the standard setters.Results: The descriptions of the minimally competent person for the KNLE were presented at the levels of general and subject performance. The cut scores of first and second mock exams were 74.4 and 76.8, respectively. These were higher than the traditional cut score (60% of the total score of the KNLE). The panel survey showed very positive responses, with scores higher than 4 out of 5 points on a Likert scale.Conclusion: The scores calculated for both mock tests were similar, and were much higher than the existing cut scores. In the second simulation, the standard deviation of the Angoff rating was lower than in the first simulation. According to the survey results, procedural validity was acceptable, as shown by a high level of confidence. The results show that determining cut scores by an expert panel is an applicable method.

Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers

“…A correct distribution of core clinical content is required, and the balance between reliability and core clinical presentations should be guaranteed to ensure desirable item numbers. The standard setting for CBT, including the modified Angoff, modified Ebel, and Hofstee methods, should be implemented soon, instead of using a cut score to ensure a success rate of 60% [ 7 , 8 ]. It is necessary to maintain a consistent passing rate regardless of item difficulties.…”

Development of examination objectives based on nursing competency for the Korean Nursing Licensing Examination: a validity study

“…There was a study on the standard setting of the Korean Nursing Licensing Examination using Angoff method [ 13 ]. For this high-stakes examination, the classification of nursing problems is also essential to set the cut score because the performance level description of the overall exam and each subject is the basic step.…”

Comparing the cut score for the borderline group method and borderline regression method with norm-referenced standard setting in an objective structured clinical examination in medical school in Korea

“…This is an important issue for educational administrators as well as medical educators. However, there are few studies on standard setting and most of the studies were about comparison of test-centered standard setting method such as Angoff, Ebel in medical and nursing education of Korea [7,8,9]. Performance assessment is an important part of the medical profession.…”