The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review

Humphrey‐Murto, Susan; Varpio, Lara; Wood, Timothy J.; Gonsalves, Carol; Ufholz, Lee‐Anne; Mascioli, Kelly; Wang, Carol; Foth, Thomas

doi:10.1097/acm.0000000000001812

Cited by 370 publications

(383 citation statements)

References 26 publications

Supporting

Mentioning

351

Contrasting

Unclassified

Order By: Relevance

“…11 Canada Protective Detail (PMPD), Royal Canadian Mounted Police (RCMP), Ottawa, Canada. 12 International Medicine, Inova Health System, Merrifield, USA.…”

Section: Acknowledgementsmentioning

confidence: 99%

“…This can serve as the basis of conferences and other continuing education modules or even fellowship training. In order to create an appropriate curriculum, the Delphi methodology has been used to develop a consensus-driven curriculum for medical training in a variety of fields [10][11][12][13][14].We sought to create an expertdriven consensus curriculum in DM using a modified Delphi methodology and present the results herein.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A dignitary medicine curriculum developed using a modified Delphi methodology

Mulhim

Darling²,

Sarin

et al. 2020

Int J Emerg Med

View full text Add to dashboard Cite

Background: Dignitary medicine is an emerging field of training that involves the specialized care of diplomats, heads of state, and other high-ranking officials. In an effort to provide guidance on training in this nascent field, we convened a panel of experts in dignitary medicine and using the Delphi methodology, created a consensus curriculum for training in dignitary medicine. Methods: A three-round Delphi consensus process was performed with 42 experts in the field of dignitary medicine. Predetermined scores were required for an aspect of the curriculum to advance to the next round. The scores on the final round were used to determine the components of the curriculum. Scores below the threshold to advance were dropped in the subsequent round. Results: Our panel had a high degree of agreement on the required skills needed to practice dignitary medicine, with active practice in a provider's baseline specialty, current board certification, and skills in emergency care and resuscitation being the highest rated skills dignitary medicine physicians need. Skills related to vascular and emergency ultrasound and quality improvement were rated the lowest in the Delphi analysis. No skills were dropped from consideration. Conclusions: The results of our work can form the basis of formal fellowship training, continuing medical education, and publications in the field of dignitary medicine. It is clear that active medical practice and knowledge of resuscitation and emergency care are critical skills in this field, making emergency medicine physicians well suited to practicing dignitary medicine.

show abstract

“…11 Canada Protective Detail (PMPD), Royal Canadian Mounted Police (RCMP), Ottawa, Canada. 12 International Medicine, Inova Health System, Merrifield, USA.…”

Section: Acknowledgementsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A dignitary medicine curriculum developed using a modified Delphi methodology

Mulhim

Darling²,

Sarin

et al. 2020

Int J Emerg Med

View full text Add to dashboard Cite

show abstract

“…In the academic brainstorming session, the researchers had a mean age of 28.66 ± 5.82 (24)(25)(26)(27)(28)(29)(30)(31)(32)(33)(34)(35)(36)(37)(38)(39)(40) years and a mean professional experience of 4.76 ± 2.38 (2)(3)(4)(5)(6)(7)(8) years. Their discussion was based on the importance of the instrument items for dispensing.…”

Section: Academic Brainstormingmentioning

confidence: 99%

“…The Delphi technique was selected to perform the content validation of the instrument, 24,25 following the Recommendations for the Conducting and Reporting of Delphi Studies (CREDES). 26…”

Section: The Delphi Techniquementioning

confidence: 99%

Development and content validation of an instrument to document the dispensing of prescribed medicines

et al. 2019

View full text Add to dashboard Cite

Summary What is known and objective Qualified dispensing is fundamental for the promotion of the rational use of medicines. Documentation is an indicator of quality and one of the essential steps in the care process. However, in Brazil, there are no models of clinical documentation applicable to dispensing practices. Thus, the objective of this study was to develop and validate an instrument to document the dispensing process of prescribed medicines. Methods A methodological development study was carried out from February 2017 to October 2017 in two stages, which were (i) the development of the instrument and (ii) content validation of the proposed instrument. The development phase comprised three stages, which were (i) the elaboration of the prototype based on a previously performed systematic review, (ii) academic brainstorming and (iii) a pre‐Delphi consensus. The content validation process was performed using the Delphi technique. The instrument was sent to 40 experts with experience in dispensing, and the consensus among them was calculated using the content validity index (CVI). The study was approved by the Ethics Committee, and all participants signed an informed consent document detailing the terms of the study. Results In the development stage, three versions of the instrument were generated, which were the prototype, version 1 (changed after academic brainstorming) and version 2 (changed after the pre‐Delphi). In the content validation process of version 2 of the instrument, 23 experts returned their evaluation in the first round of the Delphi process and 17 in the second. All the items obtained a CVI >0.83, which resulted in the validation of the instrument. The final instrument comprised the following sections: general information, the identification of technical and legal problems of prescriptions, the conduct for the resolution of the technical and legal problems of prescriptions, medication dispensed, suspected drug‐related problems, verbal guidance, written guidance, referral and the referral result. What is new and conclusion The developed and validated instrument presents the main variables that should be documented during the dispensing process.

show abstract

“…The initial Delphi round was piloted with 3 nonpanelist members. 8 In the first round, panelists were asked to rate each item on necessity of inclusion using a 7-point scale (1, unnecessary to include, to 7, definitely must include). In addition, panelists could offer suggestions on each element and generate additional items.…”

Section: Modified Delphi Exercisementioning

confidence: 99%

Development of a Simulation-Based Interprofessional Teamwork Assessment Tool

Bismilla

Boyle

Mangold

et al. 2019

Journal of Graduate Medical Education

View full text Add to dashboard Cite

Background The Accreditation Council for Graduate Medical Education (ACGME) Milestone projects required each specialty to identify essential skills and develop means of assessment with supporting validity evidence for trainees. Several specialties rate trainees on a milestone subcompetency related to working in interprofessional teams. A tool to assess trainee competence in any role on an interprofessional team in a variety of scenarios would be valuable and suitable for simulation-based assessment.Objective We developed a tool for simulation settings that assesses interprofessional teamwork in trainees.Methods In 2015, existing tools that assess teamwork or interprofessionalism using direct observation were systematically reviewed for appropriateness, generalizability, adaptability, ease of use, and resources required. Items from these tools were included in a Delphi method with multidisciplinary pediatrics experts using an iterative process from June 2016 to January 2017 to develop an assessment tool.Results Thirty-one unique tools were identified. A 2-stage review narrowed this list to 5 tools, and 81 items were extracted. Twenty-two pediatrics experts participated in 4 rounds of Delphi surveys, with response rates ranging from 82% to 100%. Sixteen items reached consensus for inclusion in the final tool. A global 4-point rating scale from novice to proficient was developed.Conclusions A novel tool to assess interprofessional teamwork for individual trainees in a simulated setting was developed using a systematic review and Delphi methodology. This is the first step to establish the validity evidence necessary to use this tool for competency-based assessment. MethodsOur team included simulation experts from pediatric emergency medicine, pediatric hospital medicine, and graduate medical education from 7 institutions across

show abstract

The Use of the Delphi and Other Consensus Group Methods in Medical Education Research: A Review

Abstract: Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Cited by 370 publications

References 26 publications

A dignitary medicine curriculum developed using a modified Delphi methodology

A dignitary medicine curriculum developed using a modified Delphi methodology

Development and content validation of an instrument to document the dispensing of prescribed medicines

Development of a Simulation-Based Interprofessional Teamwork Assessment Tool

Contact Info

Product

Resources

About