Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016

Self Cite

Background: Research abstracts are submitted for presentation at scientific conferences; however, criteria for judging abstracts are variable. We sought to develop two rigorous abstract scoring rubrics for education research submissions reporting (1) quantitative data and (2) qualitative data and then to collect validity evidence to support score interpretation. Methods:We used a modified Delphi method to achieve expert consensus for scoring rubric items to optimize content validity. Eight education research experts participated in two separate modified Delphi processes, one to generate quantitative research items and one for qualitative. Modifications were made between rounds based on item scores and expert feedback. Homogeneity of ratings in the Delphi process was calculated using Cronbach's alpha, with increasing homogeneity considered an indication of consensus. Rubrics were piloted by scoring abstracts from 22 quantitative publications from AEM Education and Training "Critical Appraisal of Emergency Medicine Education Research" (11 highlighted for excellent methodology and 11 that were not) and 10 qualitative publications (five highlighted for excellent methodology and five that were not). Intraclass correlation coefficient (ICC) estimates of reliability were calculated.Results: Each rubric required three rounds of a modified Delphi process. The resulting quantitative rubric contained nine items: quality of objectives, appropriateness of methods, outcomes, data analysis, generalizability, importance to medical education, innovation, quality of writing, and strength of conclusions (Cronbach's α for the third round = 0.922, ICC for total scores during piloting = 0.893). The resulting qualitative rubric contained seven items: quality of study aims, general methods, data collection, sampling, data analysis, writing quality, and strength of conclusions (Cronbach's α for the third round = 0.913, ICC for the total scores during piloting = 0.788).

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Leveling the field: Development of reliable scoring rubrics for quantitative and qualitative medical education research abstracts

Jordan

Hopson

Molins

et al. 2021

Self Cite

“…External funding has been shown to be a crucial step toward the maturation of successful investigators and increasing the knowledge base complexity of publications . One series of articles evaluating EM education research found that the number of funded studies increased from 16% in 2014 to 20% in 2015, although this declined to 11% in 2016 . We conducted a review of all publications from 2018 and 2019 in AEM Education and Training and found that 34% of original manuscripts had reported some form of funding.…”

Section: Advances In Medical Education Scholarshipmentioning

confidence: 94%

“…In the years since the conference, our field has seen significant growth in education research training opportunities, EM specialty‐specific venues for publishing education scholarship, and prominence of EM education research leaders in national medical education arenas . The topics pursued by EM education researchers have also evolved substantially since 2012 in response to programmatic changes such as the Accreditation Council for Graduate Medical Education (ACGME) milestones project and the influences of novel modalities for education, assessment, and evaluation …”

Section: Specific Objectives Of the 2012 Academic Emergency Medicine mentioning

confidence: 99%

See 1 more Smart Citation

Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What’s Next?

Gottlieb

Chan

Clarke

et al. 2019

Self Cite

In 2012, the Society for Academic Emergency Medicine convened a consensus conference on the state of medical education research with goals of defining and advancing a future research agenda. Since that time, emergency medicine (EM) education research has grown significantly. A task force of EM education experts was assembled and sought to understand the current state of EM education research and future directions. Among the advances are increases in medical education fellowships, advanced degree and certification programs, faculty development programs, publication venues, and funding. These findings are discussed in light of the prior objectives from the 2012 consensus conference, and recommendations for future directions are provided.From the

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016

Dubosh

Jordan

Yarris

et al. 2018

Self Cite

Objectives: The objectives were to critically appraise the emergency medicine (EM) medical education literature published in 2016 and review the highest-quality quantitative and qualitative studies. Methods: A search of the English language literature in 2016 querying MEDLINE, Scopus, Education ResourcesInformation Center (ERIC), and PsychInfo identified 510 papers related to medical education in EM. Two reviewers independently screened all of the publications using previously established exclusion criteria. The 25 top-scoring quantitative studies based on methodology and all six qualitative studies were scored by all reviewers using selected scoring criteria that have been adapted from previous installments. The top-scoring articles were highlighted and trends in medical education research were described.