TutAR: Semi-Automatic Generation of Augmented Reality Tutorials for Medical Education

Eckhoff, Daniel; Sandor, Christian; Kalkoten, Denis; Eck, Ulrich; Lins, Christian; Hein, Andreas

doi:10.1109/ismar-adjunct.2018.00131

Cited by 12 publications

(4 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Mobile AR applications have been used to guide tourists [9], to assist disabled people [10], and to help blind people navigate indoor spaces [11]. Eckhoff et al [12] developed TutAR as a medical education tool that takes video and hand motions as input and generates a 3D animated hand. Indoor navigation applications have been developed for tasks such as food delivery through robots using deep learning and micro-electromechanical systems (MEMS) sensors [13,14].…”

Section: Related Workmentioning

confidence: 99%

Mobile augmented reality system for object detection, alert, and safety

Sharma¹,

Engel²

2023

View full text Add to dashboard Cite

The versatility and performance of mobile devices has increased greatly in recent years, allowing users to perform more tasks in daily life. While mobile devices and applications provide many benefits for users, some of the most significant are locationbased, including point-of-use tools, navigation, and alert systems. This paper presents a prototype of a cross-platform mobile augmented reality (AR) application with the core purpose of finding a better means to keep a campus community secure and connected. This mobile AR application consists of four core functionalities -an events system, a policing system, a directory system, and a notification system. The events system keeps the community up to date on events that are happening or will soon be happening on campus. The policing system allows the community to stay in arms reach of campus resources that help them to stay secure. The directory system serves as a one-stop shop for campus resources, ensuring that staff, faculty, and students will have a convenient and efficient means of accessing pertinent information on the campus departments. This paper demonstrates how augmented reality (AR) visualizations could be used to supplement existing emergency communications for alert and safety in built spaces. This work highlights the ability to provide evacuation information in a multileveled space in 3D form using AR technology. Specifically, the paper describes the design and implementation of the proposed mobile AR application and reports the results of the pilot study conducted to evaluate perceived ease-of-use and usability. results from this pilot study show that the mobile AR application was helpful in identifying nearest exits, is relatively easy to use, and is useful for navigation and evacuation.

show abstract

Section: Related Workmentioning

confidence: 99%

Mobile augmented reality system for object detection, alert, and safety

Sharma¹,

Engel²

2023

View full text Add to dashboard Cite

show abstract

“…As we explained in our related work section, there is little reference on how to design the AR content for an educational curriculum, as most classroom implementations were done using an empirical approach and typically focused on how to integrate AR into the classroom, rather than how to customize the AR content itself. Thus, we decided to approach the design with an emergent coding approach (Blair, 2015), in which we clustered the types of microskills we could recognize in AR: (1) Perceptual, which refers to the time specific knowledge designed to attract the attention of the user and deliver visual information (Hoffmann et al, 2008;Kishishita et al, 2014;Lee et al, 2019;Rusch et al, 2013;Schwerdtfeger & Klinker, 2008;Steinberger et al, 2011;Volmer et al, 2018;Waldner et al, 2014); (2) Cognitive, which refers to the time specific knowledge to generate and collect information from the users' working memory (Beheshti et al, 2017;Cai et al, 2014;Chan et al, 2013;Kapp et al, 2019;Knierim et al, 2018;Prilla, 2019;Strzys et al, 2017); (3) Motor, which refers to the time specific knowledge to properly perform an operation or process (Bhattacharya & Winer, 2019;Eckhoff et al, 2018;Gavish et al, 2015;Mohr et al, 2017;Wang et al, 2016;Webel et al, 2013;Westerfield et al, 2015). In Table 1, we go into further detail on the educational purposes for each type of microskill and guides on how to translate it into AR in terms of content design.…”

Section: Design Microskills In An Ar Environmentmentioning

confidence: 99%

Towards modeling of human skilling for electrical circuitry using augmented reality applications

Villanueva

Liu

Kitaguchi

et al. 2021

Int J Educ Technol High Educ

View full text Add to dashboard Cite

Augmented reality (AR) is a unique, hands-on tool to deliver information. However, its educational value has been mainly demonstrated empirically so far. In this paper, we present a modeling approach to provide users with mastery of a skill, using AR learning content to implement an educational curriculum. We illustrate the potential of this approach by applying this to an important but pervasively misunderstood area of STEM learning, electrical circuitry. Unlike previous cognitive assessment models, we break down the area into microskills—the smallest segmentation of this knowledge—and concrete learning outcomes for each. This model empowers the user to perform a variety of tasks that are conducive to the acquisition of the skill. We also provide a classification of microskills and how to design them in an AR environment. Our results demonstrated that aligning the AR technology to specific learning objectives paves the way for high quality assessment, teaching, and learning.

show abstract

“…The creation of tutorials for software has traditionally been completed by either user demonstration [3,7,13,28] or crowdsourcing [12,20]. Tutorials generated by demonstration usually require tracing a user's interaction flow while recording a screencast video of the user interface.…”

Section: Structural Tutorial Creationmentioning

confidence: 99%

HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions

Zhong

Chi

et al. 2021

The 34th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

We present HelpViz, a tool for generating contextual visual mobile tutorials from text-based instructions that are abundant on the web. HelpViz transforms text instructions to graphical tutorials in batch, by extracting a sequence of actions from each text instruction through an instruction parsing model, and executing the extracted actions on a simulation infrastructure that manages an array of Android emulators. The automatic execution of each instruction produces a set of graphical and structural assets, including images, videos, and metadata such as clicked elements for each step. HelpViz then synthesizes a tutorial by combining parsed text instructions with the generated assets, and contextualizes the tutorial to user interaction by tracking the user's progress and highlighting the next step. Our experiments with HelpViz indicate that our pipeline improved tutorial execution robustness and that participants preferred tutorials generated by HelpViz over text-based instructions. HelpViz promises a cost-effective approach for generating contextual visual tutorials for mobile interaction at scale. CCS CONCEPTS• Human-centered computing → Interactive systems and tools.

show abstract

TutAR: Semi-Automatic Generation of Augmented Reality Tutorials for Medical Education

Cited by 12 publications

References 6 publications

Mobile augmented reality system for object detection, alert, and safety

Mobile augmented reality system for object detection, alert, and safety

Towards modeling of human skilling for electrical circuitry using augmented reality applications

HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions

Contact Info

Product

Resources

About