Standard Setting in Student Assessment by Criterion Referenced Evaluation

안덕선,; 임형,

doi:10.3946/kjme.2001.13.1.41

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Subsequently, standard setting has become an essential part of performance or skill tests in other professions such as dentistry and nursing [3,4]. However, empirical studies of these issues have rarely been carried out for written exams although theoretical suggestions have been made [5,6].…”

Section: Introductionmentioning

confidence: 99%

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

Yim¹

2018

Korean J Med Educ

View full text Add to dashboard Cite

PurposeThe purpose of this study was to apply alternative standard setting methods for the Korean Medical Licensing Examination (KMLE), a criterion-referenced written examination, and to compare them to the conventional cut score used on the KMLE.MethodsThe process and results of criterion-referenced standard settings (i.e., the modified-Angoff and bookmark methods) were evaluated. The ratio of passing and failing examinees determined using these alternative standard setting methods was compared to the results of the conventional criteria. Additionally, the external, internal and procedural evaluation of these methods were reviewed.ResultsThe modified-Angoff method yielded the highest cut score, followed sequentially by the conventional method and the bookmark method. The classification agreement between the modified-Angoff and bookmark methods was 0.720 measured by Cohen’s κ coefficient. The intra-panelist classification consistency of modified-Angoff method was higher than bookmark method. However, the inter-panelist classification consistency was vice versa. The standard setting panelists’ survey results showed that the procedures of both methods were satisfactory, but panelists had more confidence in the results of the modified-Angoff method.ConclusionThe modified-Angoff method showed results that were more similar to those of the conventional method. Both new methods showed very high concordance with the conventional method, as well as with each other. The modified-Angoff method was considered feasible for adoption on the KMLE. The standard setting panelists responded positively to the modified-Angoff method in terms of its practical applicability, despite certain advantages of the bookmark method.

show abstract

Section: Introductionmentioning

confidence: 99%

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

Yim¹

2018

Korean J Med Educ

View full text Add to dashboard Cite

show abstract

Standard Setting in Student Assessment by Criterion Referenced Evaluation

Cited by 1 publication

References 0 publications

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

Contact Info

Product

Resources

About