Development of a myoelectric prosthesis simulator using augmented reality

Nishino, Wataru; Yamanoi, Yusuke; Sakuma, Yoshiaki; Kato, Ryu

doi:10.1109/smc.2017.8122749

Cited by 10 publications

(5 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, severed patients could use it to train themselves to use a virtual prosthesis before implanting a real one [50]. Research has shown that this could not only help to accelerate user adaptation but also reduce phantom limb pain and lower rejection rates through the development of long-lasting ownership illusions [51], [52]. Similarly, partial avatarization in AR could help to recover motor functions during rehabilitation after a stroke [53], as done by Heinrich et al [54].…”

Section: Partial Avatarizationmentioning

confidence: 99%

“…At first glance, it seems that partial avatarization was the most explored part of the body avatarization continuum. It was frequently used to embody virtual prosthetics [15], [52] or hands in studies of VHIs and variants, leaving out other human limbs [1], [20], [57], [127]. Body accessorization was the second most explored area of the continuum and was mainly used in application-oriented AR publications interested in fashion and innovative interaction [154].…”

Section: Exploration Of the Body Avatarization Continuummentioning

confidence: 99%

See 1 more Smart Citation

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Genay¹,

Lécuyer

Hachet³

2022

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Virtual self-avatars have been increasingly used in Augmented Reality (AR) where one can see virtual content embedded into physical space. However, little is known about the perception of self-avatars in such a context. The possibility that their embodiment could be achieved in a similar way as in Virtual Reality opens the door to numerous applications in education, communication, entertainment, or the medical field. This article aims to review the literature covering the embodiment of virtual self-avatars in AR. Our goal is (i) to guide readers through the different options and challenges linked to the implementation of AR embodiment systems, (ii) to provide a better understanding of AR embodiment perception by classifying the existing knowledge, and (iii) to offer insight on future research topics and trends for AR and avatar research. To do so, we introduce a taxonomy of virtual embodiment experiences by defining a "body avatarization" continuum. The presented knowledge suggests that the sense of embodiment evolves in the same way in AR as in other settings, but this possibility has yet to be fully investigated. We suggest that, whilst it is yet to be well understood, the embodiment of avatars has a promising future in AR and conclude by discussing possible directions for research.

show abstract

Section: Partial Avatarizationmentioning

confidence: 99%

Section: Exploration Of the Body Avatarization Continuummentioning

confidence: 99%

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Genay¹,

Lécuyer

Hachet³

2022

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…Some researchers developed a custom-made AR platform and augmented a VR headset with cameras [41], [42]. Previous research in screen-based AR has focused on myoelectric prosthesis control and the transferability of tasks from virtual environments to real-world settings, involving pick and place tasks [43] for pattern recognition control [44] or motor skill enhancement [45].…”

Section: Introductionmentioning

confidence: 99%

PhantomAR: Gamified Mixed Reality System for Alleviating Phantom Limb Pain in Upper Limb Amputees – Design, Implementation, and Clinical Usability Evaluation

Prahm,

Eckstein,

Bressler

et al. 2024

Preprint

View full text Add to dashboard Cite

Background: Phantom limb pain (PLP) is a restrictive condition in which patients perceive pain in a limb that is no longer present, greatly reducing their quality of life. Mirror Therapy, wherein patients observe a mirror reflection of their intact limb, has demonstrated efficacy in alleviating PLP. However, its unilateral and seated nature presents limitations. To address these constraints while still reducing PLP, and evaluating the impact of different virtual limb representations (anthropomorphic vs. non-anthropomorphic) on the user's sense of ownership, agency, and embodiment, PhantomAR was developed. Leveraging wearable first-person augmented reality (AR) technology, PhantomAR extends traditional Mirror Therapy by enabling users to move freely and engage in bimanual tasks. Methods: The assistive mixed reality game application PhantomAR was deployed on the Microsoft HoloLens 2 and augmented the user’s residual limb by superimposing a virtual arm or tentacle that was controlled via residual muscles on their stump using an EMG electrode array. This setup allowed patients to engage in a first-person perspective and manipulate virtual objects with both the healthy and augmented limbs, free from the confines of a seated position. The study enrolled 10 able-bodied individuals and 8 individuals with unilateral, transradial amputation. All amputees experienced PLP. The usability of the PhantomAR application was evaluated using the System Usability Scale (SUS) and a user-centric survey. Additionally, the Game Experience was assessed on a 5-point Likert questionnaire (GEQ). Participants rated their phantom sensations using the Numerical Rating Scale and McGill Pain Questionnaire before, during, and after interaction with PhantomAR. The embodiment and agency of the virtual superimposed arm were evaluated with an altered Prosthesis Embodiment Scale. The study protocol included two sessions of 30 minutes each, during which participants experienced PhantomAR. Results: Participants (n=18) rated PhantomAR highly usable (SUS m=90.8%, SD=6.88). Feedback on the Game Experience Questionnaire was overwhelmingly positive, showing high immersion (m=4.46, SD=0.08) and positive affect (m=4.97, SD=0.05). PLP (n=8) significantly decreased post-intervention (NRS and McGill Pain Questionnaire, p<.001). Skin temperature in the residual limb increased significantly post-intervention (p<.01) but did not correlate with PLP (r=-0.08, p=0.83). Tentacle overlay yielded mixed ownership but high agency ratings. Conclusion: PhantomAR leverages extended reality to significantly reduce Phantom Limb Pain, enhance user engagement, and alter perceptions of ownership and agency of their augmented limb through dynamic, full-body interactions.

show abstract

“…virtual reality), such as more accurate depth perception due to the incorporation of real world distance cues [17] and a reduced risk of adverse effects like virtual reality sickness [18]. Several rehabilitation systems have been developed wherein the user dons a virtual prosthesis and manipulates virtual objects via a myoelectric control strategy [19][20][21]. These systems have been shown to be valuable in that they: (1) allow for self-paced, at-home training [22], (2) increase user motivation for habitual practice [23], and (3) can offer real-time feedback on grasp characteristics such as optimal force or aperture [24,25].…”

Section: Introductionmentioning

confidence: 99%

Limb loading enhances skill transfer between augmented and physical reality tasks during limb loss rehabilitation

Hunt

Sun

Wang

et al. 2023

J NeuroEngineering Rehabil

View full text Add to dashboard Cite

Background Virtual and augmented reality (AR) have become popular modalities for training myoelectric prosthesis control with upper-limb amputees. While some systems have shown moderate success, it is unclear how well the complex motor skills learned in an AR simulation transfer to completing the same tasks in physical reality. Limb loading is a possible dimension of motor skill execution that is absent in current AR solutions that may help to increase skill transfer between the virtual and physical domains. Methods We implemented an immersive AR environment where individuals could operate a myoelectric virtual prosthesis to accomplish a variety of object relocation manipulations. Intact limb participants were separated into three groups, the load control (CGLD; $$N=4$$ N = 4 ), the AR control (CGAR; $$N=4$$ N = 4 ), and the experimental group (EG; $$N=4$$ N = 4 ). Both the CGAR and EG completed a 5-session prosthesis training protocol in AR while the CGLD performed simple muscle training. The EG attempted manipulations in AR while undergoing limb loading. The CGAR attempted the same manipulations without loading. All participants performed the same manipulations in physical reality while operating a real prosthesis pre- and post-training. The main outcome measure was the change in the number of manipulations completed during the physical reality assessments (i.e. completion rate). Secondary outcomes included movement kinematics and visuomotor behavior. Results The EG experienced a greater increase in completion rate post-training than both the CGAR and CGLD. This performance increase was accompanied by a shorter motor learning phase, the EG’s performance saturating in less sessions of AR training than the CGAR. Conclusion The results demonstrated that limb loading plays an important role in transferring complex motor skills learned in virtual spaces to their physical reality analogs. While participants who did not receive limb loading were able to receive some functional benefit from AR training, participants who received the loading experienced a greater positive change in motor performance with their performance saturating in fewer training sessions.

show abstract

Development of a myoelectric prosthesis simulator using augmented reality

Cited by 10 publications

References 4 publications

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

PhantomAR: Gamified Mixed Reality System for Alleviating Phantom Limb Pain in Upper Limb Amputees – Design, Implementation, and Clinical Usability Evaluation

Limb loading enhances skill transfer between augmented and physical reality tasks during limb loss rehabilitation

Contact Info

Product

Resources

About