Smartphones as Multimodal Communication Devices to Facilitate Clinical Knowledge Processes: Randomized Controlled Trial

Abstract

BackgroundDespite the widespread use and advancements of mobile technology that facilitate rich communication modes, there is little evidence demonstrating the value of smartphones for effective interclinician communication and knowledge processes.ObjectiveThe objective of this study was to determine the effects of different synchronous smartphone-based modes of communication, such as (1) speech only, (2) speech and images, and (3) speech, images, and image annotation (guided noticing) on the recall and transfer of visually and verbally represented medical knowledge.MethodsThe experiment was conducted from November 2011 to May 2012 at the University Hospital Basel (Switzerland) with 42 medical students in a master’s program. All participants analyzed a standardized case (a patient with a subcapital fracture of the fifth metacarpal bone) based on a radiological image, photographs of the hand, and textual descriptions, and were asked to consult a remote surgical specialist via a smartphone. Participants were randomly assigned to 3 experimental conditions/groups. In group 1, the specialist provided verbal explanations (speech only). In group 2, the specialist provided verbal explanations and displayed the radiological image and the photographs to the participants (speech and images). In group 3, the specialist provided verbal explanations, displayed the radiological image and the photographs, and annotated the radiological image by drawing structures/angle elements (speech, images, and image annotation). To assess knowledge recall, participants were asked to write brief summaries of the case (verbally represented knowledge) after the consultation and to re-analyze the diagnostic images (visually represented knowledge). To assess knowledge transfer, participants analyzed a similar case without specialist support.ResultsData analysis by ANOVA found that participants in groups 2 and 3 (images used) evaluated the support provided by the specialist as significantly more positive than group 1, the speech-only group (group 1: mean 4.08, SD 0.90; group 2: mean 4.73, SD 0.59; group 3: mean 4.93, SD 0.25; F 2,39=6.76, P=.003; partial η2=0.26, 1–β=.90). However, significant positive effects on the recall and transfer of visually represented medical knowledge were only observed when the smartphone-based communication involved the combination of speech, images, and image annotation (group 3). There were no significant positive effects on the recall and transfer of visually represented knowledge between group 1 (speech only) and group 2 (speech and images). No significant differences were observed between the groups regarding verbally represented medical knowledge.ConclusionsThe results show (1) the value of annotation functions for digital and mobile technology for interclinician communication and medical informatics, and (2) the use of guided noticing (the integration of speech, images, and image annotation) leads to significantly improved knowledge gains for visually represented knowledge. This is particularly valuable in situ...

A balancing act: a phenomenological exploration of medical students' experiences of using mobile devices in the clinical setting

“…Research findings show that students situate their learning by taking the opportunities to gather information as the need arises, evolving into an anytime, anywhere culture. 8 29 This situational opportunistic learning has been reported by others exploring the use of mobile devices in higher education. 27 These authors commented on the necessity of social interactions and learning being critical components of situational learning.…”

“…In medical education, the use of mobile devices has been shown to encourage student learning in, as well as beyond and across the individual situations. 8 Others have shown that although the access to information is rapid, there is a tendency to overuse or even become over-dependent in using mobile devices; this may be inhibiting the internalisation of knowledge, thus leading to the potential for superficial learning. 2 Furthermore, in that study, the participants anticipated that mobile devices would replace the use of traditional textbooks, and that their use would soon be a part of routine clinical care.…”

What clinicians think about smartphones for healthcare communication

“…[31] Multimodal communication facilitated through smartphones connections transfers speech and image at the same time and enhances information recall. [32] Text messaging through the smartphones enhances the speed of message interactions and decreases the need for person-to-person contacts. [33] Whilst the possibilities offered by smartphones for healthcare are promising, it is important to be wary of possible pitfalls.…”

Use of Smartphone-Based Head-Mounted Display Devices to View a Three-Dimensional Dissection Model in a Virtual Reality Environment: Pilot Questionnaire Study

“…Older cell phone types have been replaced by the now ubiquitous smartphones, and we have recently entered an era in which everyone owns at least one of these extremely useful and convenient devices. Many advanced functions of these smartphones are being considered for their potential and/or availability for use in actual medical settings [14,15]. Smartphone and tablet apps for educational use have been developed and are becoming more available.…”