Visual feedback framework for rehabilitation of stroke patients

Semblantes, Piedad A.; Andaluz, Víctor H.; Lagla, Johana; Chicaiza, Fernando A.; Acurio, Andrés

doi:10.1016/j.imu.2018.10.002

Cited by 13 publications

(10 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Earlier studies used binary classification as well as three-point and four-point Likert scales to obtain experts’ ratings for validating their algorithms [24,25,26,27,28]. This kind of validation is rough and likely results in inflated validation accuracy because of the wide performance range between two consecutive points, especially for binary classification and a 3-point Likert scale.…”

Section: Discussionmentioning

confidence: 99%

“…Since DTW itself could not generate a meaningful scaled score for performance evaluation, a physical therapist was required to remotely monitor the patient in real time through Webcam and determine whether a patient’s performance was acceptable or not. Semblantes et al [25] and Saenz-de-Urturi and Garcia-Zapirain Soto [26] used DTW and binary classification to discriminate between correct and incorrect motions. Su et al [27] utilized DTW and Kinect sensors to evaluate patients’ supplementary exercise at home for shoulder rehabilitation, when compared with the pre-recorded standard motion in the hospital.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People

Xiong

2019

Sensors

View full text Add to dashboard Cite

Older people face difficulty engaging in conventional rehabilitation exercises for improving physical functions over a long time period due to the passive nature of the conventional exercise, inconvenience, and cost. This study aims to develop and validate a dynamic time warping (DTW) based algorithm for assessing Kinect-enabled home-based physical rehabilitation exercises, in order to support auto-coaching in a virtual gaming environment. A DTW-based algorithm was first applied to compute motion similarity between two time series from an individual user and a virtual coach. We chose eight bone vectors of the human skeleton and body orientation as the input features and proposed a simple but innovative method to further convert the DTW distance to a meaningful performance score in terms of the percentage (0–100%), without training data and experience of experts. The effectiveness of the proposed algorithm was validated through a follow-up experiment with 21 subjects when playing a Tai Chi exergame. Results showed that the algorithm scores had a strong positive linear relationship (r = 0.86) with experts’ ratings and the calibrated algorithm scores were comparable to the gold standard. These findings suggested that the DTW-based algorithm could be effectively used for automatic performance evaluation of an individual when performing home-based rehabilitation exercises.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People

Xiong

2019

Sensors

View full text Add to dashboard Cite

show abstract

“…Semblantes et al describe a framework for building exergames for stroke rehabilitation that incorporates visual feedback. Integrated with HMD, Microsoft Kinect v2 and a dynamic time warping algorithm, this framework uses the Unity engine to facilitate the creation of a VR rehabilitation application.…”

Section: Related Frameworkmentioning

confidence: 99%

VR‐Rides: An object‐oriented application framework for immersive virtual reality exergames

et al. 2020

View full text Add to dashboard Cite

Exercise can improve health and well-being. With this in mind, immersive virtual reality (VR) games are being developed to promote physical activity, and are generally evaluated through user studies. However, building such applications is time consuming and expensive. This paper introduces VR-Rides, an object-oriented application framework focused on the development of experiment-oriented VR exergames. Following the modular programming pattern, this framework facilitates the integration of different hardware (such as VR devices, sensors, and physical activity devices) within immersive VR experiences that overlay game narratives on Google Street View panoramas. Combining software engineering and interaction patterns, modules of VR-Rides can be easily added and managed in the Unity game engine. We evaluate the code efficiency and development effort across our VR exergames developed using VR-Rides. The reliability, maintainability, and usability of our framework are also demonstrated via code metrics analysis and user studies. The results show that investing in a systematic approach to reusing code and design can be a worthwhile effort for researchers beyond software engineering. K E Y W O R D Scode reuse, exergame, immersive virtual reality, object-oriented application framework, reusable component, Unity INTRODUCTIONVirtual reality (VR) software applications are useful tools for human-computer interaction (HCI) studies that require users to be immersed in a controlled environment. There are an increasing number of freely available software tools, plug-ins, programming libraries, and packages that employ recent advances in VR for use by the HCI research community. One such example is VR exercise video games (exergames), with different VR exergames used in physical education classes, 1,2 physical health in older adults, 3,4 and physical rehabilitation and therapy. 5,6 These applications are expected to be employed, integrated and improved by researchers and developers in their HCI projects, thus reducing the time, effort, and cost for creating customized applications. But the commercial VR systems, generally games, used are not systematically engineered to be adapted by researchers or to run research studies. For example, VR systems and games focus primarily on enhancing the immersion and enjoyment of user wearing the head-mounted display (HMD), which ignores the collaboration of non-HMD user. In order to study the interaction in collaborative VR, Gugenheimer et al 7 built a system with VR platform, projectors, gamepad, and Softw: Pract Exper. 2020;50:1305-1324.wileyonlinelibrary.com/journal/spe

show abstract

“…There have been various cases involving controlling visual feedback and applying it to rehabilitation. However, the effects of rehabilitation under various visual feedback situations were not analyzed; therefore, quantitative evaluation was limited [39][40][41][42]. We were able to compare the differences in the control strategy according to the accuracy of the visual information.…”

Section: Future Work: Confirmation Of Learning Effect Noise Impact Rmentioning

confidence: 99%

Analysis of motor control strategy for frontal and sagittal planes of circular tracking movements using visual feedback noise from velocity change and depth information

Lee

Choi

et al. 2020

PLoS ONE

View full text Add to dashboard Cite

We aim to investigate a control strategy for the circular tracking movement in a three-dimensional (3D) space based on the accuracy of the visual information. After setting the circular orbits for the frontal and sagittal planes in the 3D virtual space, the subjects track a target moving at a constant velocity. The analysis is applied to two parameters of the polar coordinates, namely, ΔR (the difference in the distance from the center of a circular orbit) and Δω (the difference in the angular velocity). The movement in the sagittal plane provides different depth information depending on the position of the target in orbit, unlike the task of the frontal plane. Therefore, the circular orbit is divided into four quadrants for a statistical analysis of ΔR. In the sagittal plane, the error was two to three times larger in quadrants 1 and 4 than in quadrants 2 and 3 close to the subject. Here, Δω is estimated using a frequency analysis; the lower the accuracy of the visual information, the greater the periodicity. When comparing two different planes, the periodicity in the sagittal plane was approximately 1.7 to 2 times larger than that of the frontal plane. In addition, the average angular velocity of the target and tracer was within 0.6% during a single cycle. We found that if the amount of visual information is reduced, an optimal feedback control strategy can be used to reduce the positional error within a specific area.

show abstract

Visual feedback framework for rehabilitation of stroke patients

Cited by 13 publications

References 6 publications

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People

VR‐Rides: An object‐oriented application framework for immersive virtual reality exergames

Analysis of motor control strategy for frontal and sagittal planes of circular tracking movements using visual feedback noise from velocity change and depth information

Contact Info

Product

Resources

About