A Modified Medical Education Research Study Quality Instrument (MMERSQI) developed by Delphi consensus

Abstract

Background The Medical Education Research Study Quality Instrument (MERSQI) is widely used to appraise the methodological quality of medical education studies. However, the MERSQI lacks some criteria which could facilitate better quality assessment. The objective of this study is to achieve consensus among experts on: (1) the MERSQI scoring system and the relative importance of each domain (2) modifications of the MERSQI. Method A modified Delphi technique was used to achieve consensus among experts in the field of medical education. The initial item pool contained all items from MERSQI and items added in our previous published work. Each Delphi round comprised a questionnaire and, after the first iteration, an analysis and feedback report. We modified the quality instruments’ domains, items and sub-items and re-scored items/domains based on the Delphi panel feedback. Results A total of 12 experts agreed to participate and were sent the first and second-round questionnaires. First round: 12 returned of which 11 contained analysable responses; second-round: 10 returned analysable responses. We started with seven domains with an initial item pool of 12 items and 38 sub-items. No change in the number of domains or items resulted from the Delphi process; however, the number of sub-items increased from 38 to 43 across the two Delphi rounds. In Delphi-2: eight respondents gave ‘study design’ the highest weighting while ‘setting’ was given the lowest weighting by all respondents. There was no change in the domains’ average weighting score and ranks between rounds. Conclusions The final criteria list and the new domain weighting score of the Modified MERSQI (MMERSQI) was satisfactory to all respondents. We suggest that the MMERSQI, in building on the success of the MERSQI, may help further establish a reference standard of quality measures for many medical education studies.

Effectiveness of undergraduate medical students training on LGBTQIA + people health: a systematic review and meta-analysis

“…5-point rating scale as follows: “1 = very uncomfortable,” to “5 = very comfortable.” Pre/ Post session All medical students 2018–20 ( n = 152) How comfortable are you talking to patients about issues related to sexuality? ‘Very confident’ - TG 29% [ 22 , 36 ]/ 68%[59,77]; LGBT 49% [ 41 , 57 ]/ 84%[77,91]; How comfortable are you discussing with patients? Medical Transition 22% [ 15 , 28 ]/ 57% [ 48 , 67 ].…”

“…The quality of the studies was assessed by two reviewers, using the Medical Education Research Study Quality Instrument (MERSQI) [ 40 , 41 ]. The MERSQI was developed to appraise methodological quality in medical education research and is suitable, reliable and simple to use.…”

Educational Research on Medical Residency Programs in Chile: A Scoping Review and Analysis of the Impact of the New Accreditation Policy

“…This step was essential to de ne the research question and appropriately review the data found. The second part employed a six-step approach to scoping reviews (10), which included appraising the methodological quality of the articles using the modi ed Medical Education Research Study Quality Instrument (MMERSQI) (11) and the CNA-Chile criteria for medical specialty programs (7). At least two independent researchers conducted each step of the analysis.…”

Investigating the advantages and disadvantages of electronic logbooks for education goals promotion in medical sciences students: A systematic review

“…Evaluation of the studies quality was carried out using MERSQI (Medical Education Research Study Quality Instrument) Study quality was assessed using the Medical Education Research Quality Instrument (MERSQI) for quantitative studies, which is a validated tool widely used in education research. 22 , 23 This quality assessment tool comprises six domains: “study design,” “sampling,” “type of data,” “validity of evaluation instrument,” “data analysis,” and “outcomes.” The minimum score within five of the domains is = 1, and the maximum score across all domains is = 3. Accordingly, MERSQI scores range from 5 to 18.…”