Offline Digital Education for Postregistration Health Professions: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

284

230

Background Blended learning, which combines face-to-face learning and e-learning, has grown rapidly to be commonly used in education. Nevertheless, the effectiveness of this learning approach has not been completely quantitatively synthesized and evaluated using knowledge outcomes in health education. Objective The aim of this study was to assess the effectiveness of blended learning compared to that of traditional learning in health education. Methods We performed a systematic review of blended learning in health education in MEDLINE from January 1990 to July 2019. We independently selected studies, extracted data, assessed risk of bias, and compared overall blended learning versus traditional learning, offline blended learning versus traditional learning, online blended learning versus traditional learning, digital blended learning versus traditional learning, computer-aided instruction blended learning versus traditional learning, and virtual patient blended learning versus traditional learning. All pooled analyses were based on random-effect models, and the I2 statistic was used to quantify heterogeneity across studies. Results A total of 56 studies (N=9943 participants) assessing several types of learning support in blended learning met our inclusion criteria; 3 studies investigated offline support, 7 studies investigated digital support, 34 studies investigated online support, 8 studies investigated computer-assisted instruction support, and 5 studies used virtual patient support for blended learning. The pooled analysis comparing all blended learning to traditional learning showed significantly better knowledge outcomes for blended learning (standardized mean difference 1.07, 95% CI 0.85 to 1.28, I2=94.3%). Similar results were observed for online (standardized mean difference 0.73, 95% CI 0.60 to 0.86, I2=94.9%), computer-assisted instruction (standardized mean difference 1.13, 95% CI 0.47 to 1.79, I2=78.0%), and virtual patient (standardized mean difference 0.62, 95% CI 0.18 to 1.06, I2=78.4%) learning support, but results for offline learning support (standardized mean difference 0.08, 95% CI –0.63 to 0.79, I2=87.9%) and digital learning support (standardized mean difference 0.04, 95% CI –0.45 to 0.52, I2=93.4%) were not significant. Conclusions From this review, blended learning demonstrated consistently better effects on knowledge outcomes when compared with traditional learning in health education. Further studies are needed to confirm these results and to explore the utility of different design variants of blended learning.

Section: Discussionsupporting

confidence: 93%

Blended Learning Compared to Traditional Learning in Medical Education: Systematic Review and Meta-Analysis

Vallée¹,

Blacher²,

Cariou³

et al. 2020

284

230

“…Digital education encompasses a broad spectrum of didactic interventions characterized by their technological content, learning objectives/outcomes, measurement tools, learning approaches, and delivery settings. Digital education includes online digital education, offline digital education, massive open online courses, learning management systems, mobile digital education (mobile learning or m-learning), serious games and gamification, augmented reality, virtual reality, or virtual patient (VP) [14-17].…”

Section: Introductionmentioning

confidence: 99%

Effectiveness of Digital Education on Communication Skills Among Medical Students: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Kyaw¹,

Posadzki²,

Paddock³

et al. 2019

Self Cite

139

104

BackgroundEffective communication skills are essential in diagnosis and treatment processes and in building the doctor-patient relationship.ObjectiveOur aim was to evaluate the effectiveness of digital education in medical students for communication skills development. Broadly, we assessed whether digital education could improve the quality of future doctors’ communication skills.MethodsWe performed a systematic review and searched seven electronic databases and two trial registries for randomized controlled trials (RCTs) and cluster RCTs (cRCTs) published between January 1990 and September 2018. Two reviewers independently screened the citations, extracted data from the included studies, and assessed the risk of bias. We also assessed the quality of evidence using the Grading of Recommendations, Assessment, Development, and Evaluations assessment (GRADE).ResultsWe included 12 studies with 2101 medical students, of which 10 were RCTs and two were cRCTs. The digital education included online modules, virtual patient simulations, and video-assisted oral feedback. The control groups included didactic lectures, oral feedback, standard curriculum, role play, and no intervention as well as less interactive forms of digital education. The overall risk of bias was high, and the quality of evidence ranged from moderate to very low. For skills outcome, meta-analysis of three studies comparing digital education to traditional learning showed no statistically significant difference in postintervention skills scores between the groups (standardized mean difference [SMD]=–0.19; 95% CI –0.9 to 0.52; I2=86%, N=3 studies [304 students]; small effect size; low-quality evidence). Similarly, a meta-analysis of four studies comparing the effectiveness of blended digital education (ie, online or offline digital education plus traditional learning) and traditional learning showed no statistically significant difference in postintervention skills between the groups (SMD=0.15; 95% CI –0.26 to 0.56; I2=86%; N=4 studies [762 students]; small effect size; low-quality evidence). The additional meta-analysis of four studies comparing more interactive and less interactive forms of digital education also showed little or no difference in postintervention skills scores between the two groups (SMD=0.12; 95% CI: –0.09 to 0.33; I2=40%; N=4 studies [893 students]; small effect size; moderate-quality evidence). For knowledge outcome, two studies comparing the effectiveness of blended online digital education and traditional learning reported no difference in postintervention knowledge scores between the groups (SMD=0.18; 95% CI: –0.2 to 0.55; I2=61%; N=2 studies [292 students]; small effect size; low-quality evidence). The findings on attitudes, satisfaction, and patient-related outcomes were limited or mixed. None of the included studies reported adverse outcomes or economic evaluation of the interventions.ConclusionsWe found low-quality evidence showing that digital education is as effective as traditional learning in medical students’ communication...

“…Digital education can be further characterized by specific pedagogies and instructional methods, contexts of provision, and technical affordances of hardware and software [16]. It includes, but is not limited to, offline and online digital education [17-19], serious gaming and gamification [20], massive open online courses, virtual reality [21], virtual patient simulations [22], and mobile digital education [23] (Multimedia Appendix 1) [24-28].…”

Section: Introductionmentioning

confidence: 99%

Health Professions Digital Education on Antibiotic Management: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Kyaw¹,

Car²,

Galen³

et al. 2019

Self Cite

Background Inappropriate antibiotic prescription is one of the key contributors to antibiotic resistance, which is managed with a range of interventions including education. Objective We aimed to summarize evidence on the effectiveness of digital education of antibiotic management compared to traditional education for improving health care professionals’ knowledge, skills, attitudes, and clinical practice. Methods Seven electronic databases and two trial registries were searched for randomized controlled trials (RCTs) and cluster RCTs published between January 1, 1990, and September 20, 2018. There were no language restrictions. We also searched the International Clinical Trials Registry Platform Search Portal and metaRegister of Controlled Trials to identify unpublished trials and checked the reference lists of included studies and relevant systematic reviews for study eligibility. We followed Cochrane methods to select studies, extract data, and appraise and synthesize eligible studies. We used random-effect models for the pooled analysis and assessed statistical heterogeneity by visual inspection of a forest plot and calculation of the I2 statistic. Results Six cluster RCTs and two RCTs with 655 primary care practices, 1392 primary care physicians, and 485,632 patients were included. The interventions included personal digital assistants; short text messages; online digital education including emails and websites; and online blended education, which used a combination of online digital education and traditional education materials. The control groups received traditional education. Six studies assessed postintervention change in clinical practice. The majority of the studies (4/6) reported greater reduction in antibiotic prescription or dispensing rate with digital education than with traditional education. Two studies showed significant differences in postintervention knowledge scores in favor of mobile education over traditional education (standardized mean difference=1.09, 95% CI 0.90-1.28; I2=0%; large effect size; 491 participants [2 studies]). The findings for health care professionals’ attitudes and patient-related outcomes were mixed or inconclusive. Three studies found digital education to be more cost-effective than traditional education. None of the included studies reported on skills, satisfaction, or potential adverse effects. Conclusions Findings from studies deploying mobile or online modalities of digital education on antibiotic management were complementary and found to be more cost-effective than traditional education in improving clinical practice and postintervention knowledge, particularly in postregistration settings. There is a lack of evidence on the effectiveness of other digital education modalities such as virtual reality or serious games. Future studies should also include health care professionals working in settings other than primary care and low- and middle-income countries. Clinical Trial PROSPERO CRD42018109742; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=109742