Body LayARs: A Toolkit for Body-Based Augmented Reality

Pohl, Henning; Dalsgaard, Tor-Salve; Krasniqi, Vesa; Hornbæk, Kasper

doi:10.1145/3385956.3418946

Cited by 10 publications

(5 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition to instructional video playback, the AR content includes graphical overlays (ie, lines) that track parts of the body (ie, arms). For simplicity, we achieved this effect via postproduction video editing (although others have implemented body tracking [48][49][50]).…”

Section: Physical Rehabilitationmentioning

confidence: 99%

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Albright,

Ko,

Buvanesh

et al. 2024

JMIR Form Res

View full text Add to dashboard Cite

Background Although family caregivers play a critical role in care delivery, research has shown that they face significant physical, emotional, and informational challenges. One promising avenue to address some of caregivers’ unmet needs is via the design of digital technologies that support caregivers’ complex portfolio of responsibilities. Augmented reality (AR) applications, specifically, offer new affordances to aid caregivers as they perform care tasks in the home. Objective This study explored how AR might assist family caregivers with the delivery of home-based cancer care. The specific objectives were to shed light on challenges caregivers face where AR might help, investigate opportunities for AR to support caregivers, and understand the risks of AR exacerbating caregiver burdens. Methods We conducted a qualitative video elicitation study with clinicians and caregivers. We created 3 video elicitations that offer ways in which AR might support caregivers as they perform often high-stakes, unfamiliar, and anxiety-inducing tasks in postsurgical cancer care: wound care, drain care, and rehabilitative exercise. The elicitations show functional AR applications built using Unity Technologies software and Microsoft Hololens2. Using elicitations enabled us to avoid rediscovering known usability issues with current AR technologies, allowing us to focus on high-level, substantive feedback on potential future roles for AR in caregiving. Moreover, it enabled nonintrusive exploration of the inherently sensitive in-home cancer care context. Results We recruited 22 participants for our study: 15 clinicians (eg, oncologists and nurses) and 7 family caregivers. Our findings shed light on clinicians’ and caregivers’ perceptions of current information and communication challenges caregivers face as they perform important physical care tasks as part of cancer treatment plans. Most significant was the need to provide better and ongoing support for execution of caregiving tasks in situ, when and where the tasks need to be performed. Such support needs to be tailored to the specific needs of the patient, to the stress-impaired capacities of the caregiver, and to the time-constrained communication availability of clinicians. We uncover opportunities for AR technologies to potentially increase caregiver confidence and reduce anxiety by supporting the capture and review of images and videos and by improving communication with clinicians. However, our findings also suggest ways in which, if not deployed carefully, AR technologies might exacerbate caregivers’ already significant burdens. Conclusions These findings can inform both the design of future AR devices, software, and applications and the design of caregiver support interventions based on already available technology and processes. Our study suggests that AR technologies and the affordances they provide (eg, tailored support, enhanced monitoring and task accuracy, and improved communications) should be considered as a part of an integrated care journey involving multiple stakeholders, changing information needs, and different communication channels that blend in-person and internet-based synchronous and asynchronous care, illness, and recovery.

show abstract

Section: Physical Rehabilitationmentioning

confidence: 99%

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Albright,

Ko,

Buvanesh

et al. 2024

JMIR Form Res

View full text Add to dashboard Cite

show abstract

“…As mentioned earlier, immersive Mixed Reality is about to enter our daily lives, and it will bring the possibility of associating affective computing output with the physical body through AR visualizations. There is limited research on body and AR; one example is a body-based device-agnostic AR toolkit, BodyLayARs developed by Pohl et al [25]. One example application they present relevant to our work is attaching emotion-based visuals above people's heads [25].…”

Section: Affective Armentioning

confidence: 99%

“…There is limited research on body and AR; one example is a body-based device-agnostic AR toolkit, BodyLayARs developed by Pohl et al [25]. One example application they present relevant to our work is attaching emotion-based visuals above people's heads [25]. Similarly, demos for providing emotional information [10] and spatial manipulation based on emotions [26] have been presented.…”

Section: Affective Armentioning

confidence: 99%

EMOTE: An interactive online tool for designing real-time emotional AR visualizations

Semsioglu

Karaturhan

Yantaç

2022

13th Augmented Human International Conference

View full text Add to dashboard Cite

show abstract

“…In 60 years, the state-of-the-art has gone from programming computers using punched cards, to creating immersive virtual environments by dragging virtual elements and dropping them in their respective places 1 . Currently, you can create an online store without knowing anything about web programming 2 , or creating body-based augmented reality applications using visual programming [88].…”

Section: The Inequalities Of Interactivitymentioning

confidence: 99%

Print-and-Play Fabrication

Tejada¹

2021

Preprint

View full text Add to dashboard Cite

In recent years, it has become increasingly accessible to create interactive applications on screen-based devices. Contrary to this ease, and despite their numerous benefits, creating tangible interactive devices is a task reserved for experts, requiring extensive knowledge on electronics, and manual assemblies. While digital fabrication equipment holds promise to alleviate this situation, the majority of research exploring this avenue still present significant barriers for non-experts, and other-domain experts to construct tangible devices, often requiring assembly of electronic circuits and printed parts, prohibitive fabrication pipelines, or intricate calibration of machine learning models. This thesis introduces Print-and-Play Fabrication: a digital fabrication paradigm where tangible interactive devices are printed, rather than assembled. By embedding interior structures inside three-dimensional models that leverage distinct properties of fluid behavior, this thesis presents a variety of techniques to construct tangible devices that can sense, process, and respond to user’s interactions without requiring assembly of parts, circuits, or calibration of machine learning models. Chapter 2 provides an overview of the fabrication of tangible devices literature through the lens of Print-and-Play Fabrication. This chapter highlights the post-print activities required to enable each of the efforts in the literature, and reflects on the status of the field. Chapters 3 and 4 introduce two novel techniques for constructing tangible devices that can sense user’s interactions. AirTouch uses basic principles of fluid behavior to enable the construction of touch-sensing devices, capable of detecting interactions in up to 12 locations, with an accuracy of up to 98%. Blowhole builds on this concept by employing principles of acoustic resonance to construct tangible devices that can detect where they are gently blown on. Blowhole-enabled devices can enable up to seven interactive locations, with an accuracy of up to 98%. Conversely, in Chapter 6 I introduce a technique to encapsulate logic computation into 3D-printed objects. Inspired by concepts from the Cold War era, I embed structures capable of representing basic logic operations using interacting jets of air into three-dimensional models. AirLogic takes the form of a toolkit, enabling non-expert designers to add a variety of input, logic processing, and output mechanisms to three-dimensional models. Continuing, Chapter 5 describes a toolkit for fabricating objects capable of changing their physical shape using pneumatic actuation. MorpheesPlug introduces a design environment, a set of pneumatically actuated widgets, and a control module that, in tandem, enable non[1]experts to construct devices capable of changing their physical shape in order to provide output. Last, I conclude with reflections on the status of Print-and-Play Fabrication, and possible directions for future work.

show abstract

Body LayARs: A Toolkit for Body-Based Augmented Reality

Cited by 10 publications

References 39 publications

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

EMOTE: An interactive online tool for designing real-time emotional AR visualizations

Print-and-Play Fabrication

Contact Info

Product

Resources

About