Augmented Reality for Rehabilitation Using Multimodal Feedback

Vieira, João; Sousa, Maurício; Arsénio, Artur; Jorge, Joaquim

doi:10.1145/2838944.2838954

Cited by 24 publications

(12 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Of these, 123 were discarded since they did not fulfil the inclusion criteria: Seven papers were not written in English, three were book chapters, 112 were not related to shoulder rehabilitation. A total of 12 articles remained relevant for inclusion, corresponding to nine different AR-based systems for shoulder rehabilitation (see Figure 1): NeuroR [18], ARS [19], RehaBio [20], MirrARbilitation [21,22], ARIS [23,24], AR Games by De Leon et al [25], SleeveAR [26,27], AR Fruit Ninja [28], AR System by Colomer et al [29]. The following section presents an overview of the AR-based reviewed systems for shoulder rehabilitation, as well as an analysis and discussion of their technical and clinical aspects.…”

Section: Overview Technical and Clinical Aspects Of Ar-based Systemsmentioning

confidence: 99%

“…SleeveAR [26,27] ( Figure 1, bottom-left) is a system that integrates multimodal feedback (visual-audio-haptic) to guide the patient through therapeutic rehabilitation exercises (abduction-adduction, elevation-depression, flexion-extension) prescribed by a physical therapist. The system provides the patient a guidance for movements together with a report on the exercise progress by means of AR projections on their arm and on the floor.…”

Section: Ars [19]mentioning

confidence: 99%

“…ARIS and RehaBio also integrate biofeedback, which has a twofold purpose: it monitors and tracks the trained muscles providing performance information, and it motivates the user during the exercise execution showing visual reflections of currently activated muscles. Many studies have shown that the inclusion of biofeedback improves the quality of rehabilitation therapy, because it provides higher motivation especially for long-term training [26]. In both these AR Rehab Systems, FlexComp Infiniti™ System from Thought Technology [40], with four wearable EMG MyoScan™ Sensors for the user's upper limb muscles, is used to acquire the sEMG (surface electromyography) data in real time.…”

Section: Ars [19]mentioning

confidence: 99%

See 2 more Smart Citations

Review of the Augmented Reality Systems for Shoulder Rehabilitation

et al. 2019

View full text Add to dashboard Cite

Literature shows an increasing interest for the development of augmented reality (AR) applications in several fields, including rehabilitation. Current studies show the need for new rehabilitation tools for upper extremity, since traditional interventions are less effective than in other body regions. This review aims at: Studying to what extent AR applications are used in shoulder rehabilitation, examining wearable/non-wearable technologies employed, and investigating the evidence supporting AR effectiveness. Nine AR systems were identified and analyzed in terms of: Tracking methods, visualization technologies, integrated feedback, rehabilitation setting, and clinical evaluation. Our findings show that all these systems utilize vision-based registration, mainly with wearable marker-based tracking, and spatial displays. No system uses head-mounted displays, and only one system (11%) integrates a wearable interface (for tactile feedback). Three systems (33%) provide only visual feedback; 66% present visual-audio feedback, and only 33% of these provide visual-audio feedback, 22% visual-audio with biofeedback, and 11% visual-audio with haptic feedback. Moreover, several systems (44%) are designed primarily for home settings. Three systems (33%) have been successfully evaluated in clinical trials with more than 10 patients, showing advantages over traditional rehabilitation methods. Further clinical studies are needed to generalize the obtained findings, supporting the effectiveness of the AR applications.

show abstract

Section: Overview Technical and Clinical Aspects Of Ar-based Systemsmentioning

confidence: 99%

Section: Ars [19]mentioning

confidence: 99%

Section: Ars [19]mentioning

confidence: 99%

See 1 more Smart Citation

Review of the Augmented Reality Systems for Shoulder Rehabilitation

et al. 2019

View full text Add to dashboard Cite

show abstract

“…A number of authors [12][13][14][15][16][17][18][19][20][21] have recognized the potentialities of AR-based applications in this specific field. The virtual content is used to: guide the patient arm during the rehabilitation session, give a visual feedback to correct in real-time the movement, furnish scores as well as positive feedback to motivate the patient.…”

Section: Introductionmentioning

confidence: 99%

Wearable Augmented Reality Application for Shoulder Rehabilitation

et al. 2019

View full text Add to dashboard Cite

Augmented reality (AR) technology is gaining popularity and scholarly interest in the rehabilitation sector because of the possibility to generate controlled, user-specific environmental and perceptual stimuli which motivate the patient, while still preserving the possibility to interact with the real environment and other subjects, including the rehabilitation specialist. The paper presents the first wearable AR application for shoulder rehabilitation, based on Microsoft HoloLens, with real-time markerless tracking of the user’s hand. Potentialities and current limits of commercial head-mounted displays (HMDs) are described for the target medical field, and details of the proposed application are reported. A serious game was designed starting from the analysis of a traditional rehabilitation exercise, taking into account HoloLens specifications to maximize user comfort during the AR rehabilitation session. The AR application implemented consistently meets the recommended target frame rate for immersive applications with HoloLens device: 60 fps. Moreover, the ergonomics and the motivational value of the proposed application were positively evaluated by a group of five rehabilitation specialists and 20 healthy subjects. Even if a larger study, including real patients, is necessary for a clinical validation of the proposed application, the results obtained encourage further investigations and the integration of additional technical features for the proposed AR application.

show abstract

“…A similar implementation to the LightGuide, projects an optical signal lengthwise the users limb, and in the position where the limb should be placed, using supplementary vibration sensors to notify the user about any declination. In parallel, it uses an acoustic signal to achieve the timing of the exercise [12]. With a simplified projection of the stance of the body of the user, accompanied with ribbons at the end of the limbs that guide the movement of the trainee, and the concurrent resonance of acoustic stimulus whose purpose is to preserve the rhythm of the movements, YouMove functions as a corrective mirror.…”

Section: Introductionmentioning

confidence: 99%

Towards the design of augmented feedforward and feedback for sensorimotor learning of motor skills

Kritopoulou

Manitsaris

Moutarde

2016

Proceedings of the 3rd International Symposium on Movement and Computing

View full text Add to dashboard Cite

International audienceCreating a digital metaphor of the “in person transmission” of manual-crafting motor skills, is an extremely complicated and challenging task. We are aiming to achieve the above by creating a mixed reality environment, supported by an interactive system for sensorimotor learning that relies onpathing techniques. The gestural instruction of a person, the Learner, arises from the reference gesture of an Expert. The concept of the system is based on the simple idea of guiding with the projection of a gesture depicting path in 2D space and in real time. The path is projected either as a feedforward that describes the gesture that has to be executed next, either as a feedback that amends the gesture while taking into account the time needed to correct the mistake. This projection takes place in the exact area where the object lies and the Learner is being trained, to avoid any distraction from the crafting task

show abstract

Augmented Reality for Rehabilitation Using Multimodal Feedback

Cited by 24 publications

References 6 publications

Review of the Augmented Reality Systems for Shoulder Rehabilitation

Review of the Augmented Reality Systems for Shoulder Rehabilitation

Wearable Augmented Reality Application for Shoulder Rehabilitation

Towards the design of augmented feedforward and feedback for sensorimotor learning of motor skills

Contact Info

Product

Resources

About