Usability of Learning Moment: Features of an E-learning Tool That Maximize Adoption by Students

Abstract

Introduction: E-learning is widely used in medical education. To maximize the potential of E-learning tools, every effort should be made to encourage adoption by optimizing usability. We created Learning Moment (LM), a web-based application that integrates principles of asynchronous learning and learning portfolios into a platform on which students can document and share learning experiences that occur during clinical work. We sought to evaluate the usability of LM and identify features that optimize adoption by users. Methods: We implemented LM in August 2016 at a busy, urban, tertiary care emergency department that hosts an emergency medicine residency, robust third and fourth year medical student clerkships as well as a physician assistant student rotation. We conducted a single-center, mix-methods study using the System Usability Scale (SUS) questionnaire and qualitative interviews. We sent e-mail invitations with subsequent reminders to all students who rotated in our emergency medicine clerkship from August 2016 to April 2017 to complete the SUS questionnaire anonymously and to participate in qualitative interviews. We employed purposive sampling to recruit students who used LM during their rotation to participate in our qualitative interviews. We conducted semi-structured interviews with 13 participants (10 individual interviews and one 3-person group interview) between January and March 2017 using an ethnographic approach and utilized a general inductive method to analyze and code for potential themes. Results: Thirty of the seventy students invited to participate completed the SUS questionnaire (Response rate of 42.8%). The mean SUS score is 80.9 (SD 18.2, 80% CI 76.5 – 85.3). The internal consistency of the responses achieved the Cronbach’s Alpha of 0.95. The participants stressed the importance of the following in the adoption of LM: maximal simplicity and usability, compatibility with learning preferences, and department-wide acceptance and integration. Conclusion: The overall perceived usability of LM was high. Our qualitative data revealed important implications for future designers to maximize adoption: include target users in every step of the design and development process to maximize simplicity and usability; build features that cater to a diversity of learning preferences; involve the entire department and find ways to incorporate the tool into the educational infrastructure and daily workflow.

The Relationship Between Family Support and e-Learning Engagement in College Students: The Mediating Role of e-Learning Normative Consciousness and Behaviors and Self-Efficacy

“…Web-based learning is an accessible and effective learning method that educators and students use to supplement or replace traditional learning, especially during the outbreak of the COVID-19. In recent years, a large number of studies have reported that e-learning has been widely used in various disciplines, such as clinical medical education ( Aloia and Vaporciyan, 2019 ; Grabowski et al, 2020 ; Tretter et al, 2020 ), nursing education ( Sinclair et al, 2016 ; Voutilainen et al, 2017 ; Kim and Park, 2019 ), and higher education ( Chu et al, 2019 ; He and Yusop, 2020 ; Zhang et al, 2020 ). Therefore, the advantages of e-learning, such as flexibility in learning, convenience in enabling learners to review subjects, and more vivid and authentic displays of cases, are also recognized by educators and learners ( Fagö-Olsen et al, 2020 ).…”

Learning without Borders: Asynchronous and Distance Learning in the Age of COVID-19 and Beyond

“…Usability of these systems can vary ( 18 ), and excess time spent navigating the LMS can be a deterrent to use. Some educators have gone so far as to create their own LMS to meet learners’ needs of simplicity and usability ( 19 ).…”

Mock Oral Board Examinations via Web‐based Video Teleconferencing in the Era of COVID‐19

“…The SUS is a 10‐item tool for the measurement of the usability of digital tools 15 . It is used extensively in multiple industries, including medical education, due to the reliability of results even with small sample sizes 16 . Surveys were voluntary, anonymous, and distributed electronically using Survey Monkey.…”

“…15 It is used extensively in multiple industries, including medical education, due to the reliability of results even with small sample sizes. 16 Surveys were voluntary, anonymous, and distributed electronically using Survey Monkey. Data were analyzed using descriptive statistics, and internal consistency of the SUS was analyzed using Cronbach's alpha.…”