The revised Approved Instructional Resources score: An improved quality evaluation tool for online educational resources

Grock, Andrew; Jordan, Jaime; Zaver, Fareen; Colmers, Isabelle N.; Krishnan, Keeth; Chan, Teresa M.; Thoma, Brent; Alexander, Charlotte; Alkhalifah, Mohammed; Almehlisi, Abdulaziz; Alqahtani, Saeed; Anderson, Scott; Anderson, Shelaina; Andrews, Colin; Andruko, Jocelyn; Antony, Nikytha; Aryal, Diptesh; Backus, Barbra E.; Baird, Jennifer; Baker, Andrew; Batty, Sarah; Baylis, Jared; Beaumont, Braeden; Belcher, Chris; Benavides, Brent; Benham, Michael D.; Botta, Julian; Pelletier, Elyse Berger; Bouchard, Nicholas; Brazil, Victoria; Brumfield, Emily; Bryson, Anthony; Bunchit, Wisarut; Butler, Kat; Buzikievich, Lindy; Calcara, David; Carey, Rob; Carrillo, Maria Rosa; Carroll, Stephen; Lyons, Casey; Cassidy, Louise; Challen, Kirsty; Chan, Kathryn; Chaplin, Tim; Chatham-Zvelebil, Natasha; Chen, Eric; Chen, Lucy; Chhabra, Sushant; Chin, Alvin; Chochi, Eric; Choudhri, Tina; Christensen, Jeremy; Connors, Kimberly; Coppersmith, Veronica; Cosgrove, Abby; Costello, Gregory; Cullison, Kevin; D’Alessandro, Andrew; Wit, Kerstin de; Decock, Marie; Delbani, Rayan; Denq, William; Deutscher, Julianna; Devine, Brendan; Dorsett, Maia; Duda, Taylor; Dueweke, Justin; Dunphy, Teresa; Dyer, Sean; Eastley, Karthryn T.; Edmonds, Marcia L.; Edwards, Ken; Ehrman, Robert R.; Elkhalidy, Youness; Fedor, Preston; Ficiur, Brian; Flynn, Caley; Fraser, Bill; Fu, Meagan; Fukakusa, James; Funk, Eric; Gaco, Damjan; Gawlik, Viktor; Ghaffarian, Kenn; Gharahbaghian, Laleh; Griffith, Andrew; Griffith, Phil; Gronowski, Tanner; Grossman, Cathy; Gucwa, Jaroslaw; Gupta, Pawan Kumar; Gustafson, Alexandra; Guy, Andrew; Haas, Mary R.; Haciski, Stanislaw; Hajdinjak, Emina; Hall, Andrew K.; Hammock, Regina; Hansel, Jan; Hart, Alexander; Hattin, Larissa; Herb, Brandon; Hilbert, Sue Lin; Hill, Jeff; Hill, Jesse; Ho, Amy; House, Emily; House, Nina; Huang, Simon; Huffman, James L.; Inboriboon, Pholaphat Charles; Ireland, Alex; Jamal, Ali; Jamil, Mohammad Ali; Jansen, Victor; Jarou, Zach; Jia, Vivian; Johnston, Levi; Kalnow, Drew; Kapur, Puneet; Kelly, Seth; Kelson, Kyle; Kent, William; Khakhkhar, Rishi; Khurana, Jaasmit; Kilp, Ashley; Knapp, Scott; Köhler, Sebastian; Kruhlak, Ivanna; Lalani, Nadim; Lam, Samantha; Lank, Patrick M.; Laurie, Zander; Lea, Kristina; Leber, Ernest; Lee, Ching-Hsing; Lenes, Haakon; Lenora, Nilantha; Leontowicz, Jesse; Lien, Kelly; Lin, Michelle; Lin, Ying‐Chun; Little, Andrew; Liu, Harry; Liu, Ivy; Liu, Steve; Louka, Stephanie; Lovell, Elise; Lowe, David; Lubberdink, Ashley; Luc, Jessica G.Y.; Hsiang, Sheng; MacLeod, Hugh; Mancuso, Nick; Maneshi, Anali; May, Jesse; Mayo, John; McDonnell, Mike; McLellan, Susan; McQuarrie, Carolyn; Mead, Therese; Meeuwisse, Cory; Meloy, Patrick; Menzies, Perry J. C.; Messman, Anne; Miazga, Stephen; Mills, Logan; Mix, Allan; Montag, Steve; Moore, Brendan; Morgenstern, Justin; Mott, Sarah; Mukherj, P.; Mulla, Ali; Nandalal, Sheena; Nikel, Taylor; Nood, Julia; Nugent, Sean; Oakland, Morgan; Oberholzer, Werner; Otugo, Onyeka; Oyedokun, Taofiq Segun; Pardhan, Alim; Patel, Kinjal; Paterson, Quinten S.; Patocka, Catherine; Patterson, Christine; Pearlman, James; Pelletier-Bui, Alexis; Phan, Marc; Poonja, Zafrina; Powell, Aubrey; Premkumar, Kamini; Prosen, Gregor; Puri, Vishal; Quaife, Tanis; Raffel, Ryan; Raja, Ali S.; Ramunno, Randi; Rang, Louise; Rannazzisi, Suzanne; Regan, Shauna; Rezaie, Salim R.; Ridderikhof, Milan L; Rogers, Vanessa; Roh, Christine; Rosenberg, Keith; Roure, Marina; Rudinsky, Sherri L; Rudner, Joshua; Saleh, Adeeb; Sanderson, Will; Scheirer, Owen; Schofield, Paul N.; Schunk, Paul; Schwarz, Evan S.; Shahrabadi, Parisa; Shappell, Eric; Sheffield, Julia; Singh, Manpreet; Singson, Hector C.; Slessor, Dave; Smith, Sam; Sneath, Paula; Sobehart, Robert; Spearing, Kerry; Stempien, James; Sternard, Britni; Stratton, Tara; Stuart, Katherine; Stuntz, Bob; Susalla, Michael; Sweeney, Colleen; Swisher, Loice; Swoboda, Henry; Syed, Shahbaz; Taira, Taku; Tambe, Nikhil; Tang, Richard; Targonsky, Elisha; Taylor, A.G.; Taylor, Rachel; Taylor, Todd B.; Ting, Paxton; Tiwald, Gerhard; Tran, Evelyn; Tran, Kelvin; Trickovic, Jason; Trinquero, Paul; Tyagi, Aaron; Umana, Manrique; Vallance, Patrick; Berg, Patricia van den; Diepen, Kelly van; Vargas, Luis; Verbeek, René; Viggers, Sandra; Vlodaver, Zlata; Wagner, M; Walji, Noorin; Walter, Joe; Wan, Miranda; Wang, Rachel; Wanner, Gregory K.; Warawa, Wyatt; Ward, Mike; Weekes, Jennifer; Weersink, Kristen; Weessies, Cara; Whalen-Browne, Anna; Whiteside, Brian; Willis, Matthew; Wilmer, Jonas; Wong, Nelson; Woodcroft, Mark; Woods, Rob; Yau, Lawrence; Yee, Jessica; Yeh, Calvin H.; Yurkiw, Katherine; Zozula, Alexander

doi:10.1002/aet2.10601

Cited by 5 publications

(2 citation statements)

References 24 publications

(63 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are several other tools in existence for the evaluation of FOAM 23–30 . The rMETRIQ score is a more recent tool developed but has yet to be formally assessed for validity and reliability, though initial testing indicates improved reliability 16 .…”

Section: Discussionmentioning

confidence: 99%

“…13,14 There are several other tools in existence for the evaluation of FOAM. [23][24][25][26][27][28][29][30] The rMETRIQ score is a more recent tool developed but has yet to be formally assessed for validity and reliability, though initial testing indicates improved reliability. 16 In addition, we continued to use a high-quality designation (rMETRIQ ≥ 16) as was done in prior SOAR reviews.…”

Section: Limitationsmentioning

confidence: 99%

See 1 more Smart Citation

SAEM systematic online academic resource (SOAR) review: Gastrointestinal illnesses

Zhao,

Tom,

Patel

et al. 2024

AEM Education and Training

Self Cite

View full text Add to dashboard Cite

Background and ObjectivesFree open access medical education (FOAM) has become an essential tool for emergency medicine (EM) education and can be valuable to clinicians as a point‐of‐care resource. The development of the revised Medical Education Translational Resources Impact and Quality (rMETRIQ) tool provides a standardized means of quality assessment. Previous entries of the Society for Academic Emergency Medicine systematic online academic resource (SOAR) series have focused on renal, endocrine, and sickle cell disorders. In this iteration, we strive to identify, curate, and describe FOAM topics specific to acute gastrointestinal (GI) illnesses.MethodsWe searched 389 keywords across 11 GI topics that were modified from the 2019 Model of the Clinical Practice of EM (EM Model) using the search engine Google FOAM and within the top 50 websites listed on Academic Life in Emergency Medicine's Social Media Index. The sites underwent preliminary screening to eliminate resources that were not relevant to EM or GI illnesses. Identified resources were evaluated with the rMETRIQ tool by five board‐certified EM physicians who received rMETRIQ tool rater training.ResultsAfter duplicates of the initial 39,505 resources were eliminated, 8059 remained. Primary screening resulted in a final 1202 resources. The most common categories were large bowel (18%), small bowel (13%), stomach (11%), esophagus (11%), biliary (11%), and liver (10%). Many resources covered multiple topics and subtopics. The final mean intraclass correlation coefficient among the five physicians was 0.95 (95% CI 0.92–0.98) for rMETRIQ scoring. We identified 256 sites considered “high quality” with a rMETRIQ score of 16 or higher as designated in prior reviews.ConclusionsThis iteration of the SOAR review resulted in the highest number of high‐quality resources compared to other SOAR reviews, with 21% of resources thus far scoring ≥ 16. A final list of high‐quality resources can guide trainees, educator recommendations, and FOAM authors.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Limitationsmentioning

confidence: 99%

SAEM systematic online academic resource (SOAR) review: Gastrointestinal illnesses

Zhao,

Tom,

Patel

et al. 2024

AEM Education and Training

Self Cite

View full text Add to dashboard Cite

show abstract

FOAM authorship: Who's teaching our learners?

Grock,

Fan,

Berger

et al. 2024

AEM Education and Training

View full text Add to dashboard Cite

BackgroundFree open‐access medical education (FOAM) is extremely popular among learners and educators despite lacking the traditional peer review process. Despite the potential for inaccurate, low‐quality, or biased content, little has been published describing FOAM authors.MethodsWe performed a cross‐sectional analysis of 12 months of content from the top 25 blogs in the 2020 Social Media Index from August 2020–2021. We recorded the number of posts per site and descriptive characteristics of authors, including gender affiliation, conflicts of interest (COI) statements, and type of practice (academic, community, or hybrid).ResultsWe identified 2141 posts by 1001 authors. More than half were produced by six websites: EM Docs (266), Life in the Fast Lane (232), EMCrit (188), ALiEM (185), Don't Forget the Bubbles (181), and Rebel EM (174). Most content (1680 posts, 78.5%) lacked a COI statement. Authors were mostly academic (89%), mostly held MD degrees (67.4%), and were mostly men (59.7%). Geographically, most FOAM authors reside in the United States (59.5%), Canada (22.42%), or the United Kingdom (9.4%).ConclusionsOf all the posts in the top 25 sites in 2020, more than half came from six sites, and authors were largely North American men in academics with MD degrees. Learners, content creators, and educators should consider the ways in which a more diverse authorship pool might bring value to the FOAM educational experience.

show abstract

European Network for Optimization of Veterinary Antimicrobial Therapy (Enovat) Guidelines for Antimicrobial Use in Canine Acute Diarrhoea

Jessen,

Scahill,

Singleton

et al. 2024

Preprint

View full text Add to dashboard Cite

The revised Approved Instructional Resources score: An improved quality evaluation tool for online educational resources

Cited by 5 publications

References 24 publications

SAEM systematic online academic resource (SOAR) review: Gastrointestinal illnesses

SAEM systematic online academic resource (SOAR) review: Gastrointestinal illnesses

FOAM authorship: Who's teaching our learners?

European Network for Optimization of Veterinary Antimicrobial Therapy (Enovat) Guidelines for Antimicrobial Use in Canine Acute Diarrhoea

Contact Info

Product

Resources

About