Evaluating the Use of MCQ as an Assessment Method in a Medical School for Assessing Medical Students in the Competence-Based Curriculum

Purwoko, Mitayani; Mundijo, Trisnawati

doi:10.22146/jpki.35544

Cited by 4 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another research found by Purwoko and Mundijo (2018) was in line with aforementioned studies above. They carried out the research focused on the medical students in Indonesia.…”

Section: Introductionsupporting

confidence: 88%

Item Analysis of Multiple-Choice Questions: An Assessment of Young Learners

Marsevani

2022

ERJEE

View full text Add to dashboard Cite

Although English has been taught for decades in Indonesia, the quality of multiple-choice question given to young learners was hardly examined. To touch on the issue, this study aims at determining the quality of 10 multiple-choice questions (MCQs) in a public elementary school in terms of difficulty level (P), discrimination power (D), and distractor efficiency (DE). This study employed a cross-sectional study to obtain information and evaluate MCQs in the students’ tests. It was found the multiple-choice items were efficient in which 80% of them have acceptable difficulty and 20% of them were fairly easy (P 70%). The discrimination index of 8 (80%) items was excellent and 2 of the MCQs were good. Among 40 distractors, 32 (80%) of them were functional distractors while 8 of them were non-functional distractors (NFDs). It can be concluded that most of the difficulty index was acceptable, the items discrimination power was good. In terms of distractor efficiency, two items were completely inefficient. Furthermore, MCQs that are considered poor should be revised, re-tested, and reviewed before incorporating them into the future test. This study hopefully encourages teachers to identify poorly developed MCQs and to improve their quality.

show abstract

“…Another research found by Purwoko and Mundijo (2018) was in line with aforementioned studies above. They carried out the research focused on the medical students in Indonesia.…”

Section: Introductionsupporting

confidence: 88%

Item Analysis of Multiple-Choice Questions: An Assessment of Young Learners

Marsevani

2022

ERJEE

View full text Add to dashboard Cite

show abstract

“…(1) Furthermore, the enlightening changes in our understanding of how learning itself works have motivated the medical fraternity across the globe to explore techniques such as Self Directed Learning (SDL), Problem Based Learning (PBL), and Objective Assessment via Single Option Correct -Multiple Option Questions (SOC-MCQs) in the last few years. (2)(3)(4)(5). Learning augmented with such methods has consistently been more effective than traditional methods.…”

Section: Introductionmentioning

confidence: 99%

The Schema Method: Using Quantified Learning to Innovate, Augment, Assess and Analyze Learning in Medicine

Sebin¹,

Doda²,

Balamani³

2022

Preprint

View full text Add to dashboard Cite

Introduction The predominant method of learning Medicine at its core has remained unchanged for decades. This stagnancy creates a need for making learning more effective, insightful, and quantified. 'Schema' achieves this through e-learning, active feedback, and quantified learning by granulating the medical curriculum into specific subtopics selected based on the crucial knowledge that a competent medical learner must possess, hereafter referred to as 'yield'. The aim of this particular study is a multidimensional competency analysis of medical students in solving clinical scenario-based MCQs pertaining to vertically integrated topics derived from the 'Schema'. Methods A retrospective study was conducted by analyzing the user data of a leading e-learning platform for medical students. For the purposes of this study, twenty such 'high-yield' Schema topics were shortlisted as being the most crucial knowledge areas. Students' performance in solving a fixed set of SOC-MCQs of these Schema topics was used to gauge their competence. Performance variation over five years (2018-2022) was also analyzed to study the changing patterns in topic-specific performance. Results A total of 20 Schema topics were shortlisted, consisting of 128 MCQs. The number of participants solving each Single Option Correct Multiple Choice Question (SOC-MCQ) ranged from 60,080 to 2,06,672. A significant improvement in the Net Delta was observed in 9 topics. Performance in other topics showed either no significant change or a significant downtrend. Conclusion Significant performance uptrend (ND = 128%) was observed in Anaphylaxis, Basic Lifesaving Skills, ST-Elevated Myocardial Infarction, Glasgow Coma Scale, Sub Dural Hemorrhage & Syndromic management of Sexually Transmitted Infections, most of which are either acute or emergency conditions. A significant downtrend in performance was seen in Schema topics such as Asthma management, Hypertension management, Diabetic Ketoacidosis, and Subarachnoid hemorrhage that pertain to chronic conditions. Several hypotheses for these findings can be derived, the subjective validities and collective impacts of which ought to be explored in more in-depth and broader studies in the future.

show abstract