Design of a home-based adaptive mixed reality rehabilitation system for stroke survivors

Abstract

This paper presents the design of a home-based adaptive mixed reality system (HAMRR) for upper extremity stroke rehabilitation. The goal of HAMRR is to help restore motor function to chronic stroke survivors by providing an engaging long-term reaching task therapy at home. The system uses an intelligent adaptation scheme to create a continuously challenging and unique multi-year therapy experience. The therapy is overseen by a physical therapist, but day-to-day use of the system can be independently set up and completed by a stroke survivor. The HAMMR system tracks movement of the wrist and torso and provides real-time, post-trial, and post-set feedback to encourage the stroke survivor to self-assess his or her movement and engage in active learning of new movement strategies. The HAMRR system consists of a custom table, chair, and media center, and is designed to easily integrate into any home.

Component-Level Tuning of Kinematic Features From Composite Therapist Impressions of Movement Quality

“…The system is shown in Fig. 2 and detailed information of the system design can be found in [9]. The main objective of this design was to be able to install the system in a participant’s home for long term therapy treatment, which prohibits the use of a heavy marker-based system.…”

“…In the inset, we see the placement of a wrist marker on a participant performing reaching tasks to a cone. The system design is discussed in detail in [9]. …”

“…An illustration of the above concept is shown in Fig. 1, where the aim is to induce active learning by providing auditory and visual feedback implying the impairments in low-level components such as trajectory inaccuracy, tremor, and segmentation [9]. In Fig.…”

“…In addition, accommodating heavy marker-based systems in a home-based setting is unrealistic, as inaccurate placement of markers can negatively affect the movement quality assessment framework and place a heavy burden on the stroke survivor and/or caregiver. In recent years, the focus of rehabilitation research has been towards devising multi-modal interventions and accompanying tools to assist home-based therapy [9], [25], [27], thereby supplementing traditional therapy received in the hospital. A solution to this was proposed in [9], where a single reflective marker was placed on the participant’s wrist to track the movement (see Fig.…”

A multimedia non-invasive e-Therapy framework for measuring live kinematic data

“…Leveraging the prior state of the art in e-Therapy study [4,5,6,7,8], we have built a multi-modal multimedia e-Therapy environment, which allows a user, either a therapist or a patient, to record a session in multi-sensory multimedia environment and tunnel the skeleton and motion data to a 3D virtual world environment. The multisensory environment consists of a 3D depth sensing camera and a 3D motion control sensor.…”