A Wearable Sensing System for Tracking and Monitoring of Functional Arm Movement

Nguyen, Khoa D.; Chen, I‐Ming; Luo, Zhiqiang; Yeo, Song Huat; Duh, Henry Been-Lirn

doi:10.1109/tmech.2009.2039222

Cited by 95 publications

(57 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…There have been some studies applying Kinect to rehabilitation therapy. For example, [1][2][3][4] designed their own Kinect based rehabilitation systems with a variety of interactive virtual reality games. And [5] presented a novel system for control of elbow movements by electrical stimulation of the biceps and triceps in tetraplegia patients, using Kinect for sensory feedback.…”

Section: Introductionmentioning

confidence: 99%

Data fusion of multiple kinect sensors for a rehabilitation system

Zhao

Han

et al. 2016

2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

View full text Add to dashboard Cite

Abstract-Kinect-like depth sensors have been widely used in rehabilitation systems. However, single depth sensor processes limb-blocking, data loss or data error poorly, making it less reliable. This paper focus on using two Kinect sensors and data fusion method to solve these problems. First, two Kinect sensors capture the motion data of the healthy arm of the hemiplegic patient; Second, merge the data using the method of Set-Membership-Filter (SMF); Then, mirror this motion data by the Middle-Plane; In the end, control the wearable robotic arm driving the patient's paralytic arm so that the patient can interactively and initiatively complete a variety of recovery actions prompted by computer with 3D animation games. I. INTRODUCTIONPhysical disability is a big challenge in today's society. Because of the lack of therapist and the rising costs of health care, etc., more and more people cannot get timely rehabilitation and become permanently disabled. In addition, the traditional treatment is that the therapist assists the patient to do a variety of actions repeatedly to restore limb functionality. Patient cooperates with the therapist passively, lack of enthusiasm and initiative of participation. Studies have shown that, compared to the traditional treatment, interactive and initiative rehabilitation treatment restore limb functionality more effectively [1].We build a Mirror Movements Rehabilitation Therapy System (MMRTS) for hemiplegic patients. The system consists of a seat, a 3-DOF wearable robotic arm, two Kinect sensors and a computer. The seat and robotic arm are as shown in Fig.1. This system uses two Kinect sensors for tracking the motion data of the healthy arm of the patient himself without the marked points.As a prerequisite of the MMRTS, motion data acquisition is a key problem. We need sensors that can track human limb movement in real-time, no special requirements on the environment, no needing marked points, and no affecting patient's health side limb. The sensors should be easy to use, affordable, and do not need any calibration action. The Microsoft's Kinect is such a sensor.Microsoft's Kinect is a specially designed device for the natural human-computer interaction that can obtain RGB and depth images. There have been some studies applying Kinect to rehabilitation therapy. For example, [1-4] designed their own Kinect based rehabilitation systems with a variety of Huibin Du is with the State

show abstract

Section: Introductionmentioning

confidence: 99%

Data fusion of multiple kinect sensors for a rehabilitation system

Zhao

Han

et al. 2016

2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

View full text Add to dashboard Cite

show abstract

“…The advanced computer vision technology can realize the human motion capture [1] and the vision-based motion analysis [2]. The sensor and actuator technology can realize the human motion sensing [3] and the physical support based on biological information [4,5]. Biomechanical knowledge about human physicality can enhance the human-systeminteraction [6].…”

Section: Introductionmentioning

confidence: 99%

Total Harmonic Distortion and Content Rate of Spatial Modal Information for Haptic Parallel Motion Analysis

2013

View full text Add to dashboard Cite

Original scientific paperIn this paper, two kinds of evaluation index for the haptic motion analysis in parallel multiple degrees-offreedom (MDOF) system are proposed. At first, the spatial modal decomposition method based on discrete Fourier series expansion (DFS) is presented. Spatial modal information expresses a motion element that corresponds to a specific physical action. The spatial modal information can mathematically be defined by the Fourier coefficients. Then, this paper proposes the total harmonic distortion (THD) and the content rate of the haptic modal information as motion evaluation indexes. THD of the spatial modal information can evaluate the complexity of the human motion and/or the deformability of the contact environment. Content rate of the spatial modal information can evaluate the priority of motion element. Some experimental results on the bilateral motion control of a parallel five DOF haptic system are shown, in order to confirm the utility of the proposed indexes. Key words: Discrete fourier series expansion, Haptics, Modal decomposition, Motion controlUkupno harmoničko izobličenje i brzina prostorne modalne informacije za analizu haptičkog paralelnog gibanja. U ovom radu predložena su dva indikatora vrednovanja haptičkog gibanja u paralelnom sustavu s više stupnjeva slobode. Prikazana je metoda prostorne modalne dekompozicije zasnovana na proširenom diskretnom Fourierovom redu. Prostorna modalna informacija predstavlja element koji odgovara specifičnoj fizikalnoj radnji. Prostorna modalna informacija matematički se može opisati koristeći Fourierove koeficijente. U ovom se radu kao indikatori za evaluaciju gibanja predlažu ukupno harmoničko izobličenje i brzina haptičke modalne informacije. Ukupnim harmoničkim izobličenjem prostorne modalne informacije može se ocijeniti kompleksnost ljudskog gibanja i/ili deformabilnost kontaktne okoline. Przina prostorne modalne informacije ocjenjuje prioritet elementa u gibanju. Kako bi se potvrdila korisnost predloženih indikatora vrednovanja prikazani su eksperimentalni rezultati dobiveni dvoosnim prostornim upravljanjem paralelnim haptičkim sustavom s pet stupnjeva slobode.Ključne riječi: proširenje diskretnog Fourierovog reda, haptika, modalna dekompozicija, upravljanje gibanjem INTRODUCTIONThe analysis of the dexterity and the flexibility in human physicality is significant for the design and the development of intelligent human support systems. The advanced computer vision technology can realize the human motion capture [1] and the vision-based motion analysis [2]. The sensor and actuator technology can realize the human motion sensing [3] and the physical support based on biological information [4,5]. Biomechanical knowledge about human physicality can enhance the human-systeminteraction [6]. For the further comprehension of human physicality, it is expected that not only movement but also strength of force in human motion is analyzed by the engineering approach.Highly transparent bilateral system can realize not only the transmission of hapt...

show abstract

“…In recent years, the detection of body posture and activity received a significant interest for their application in sports, medicine and military. Recognizing people's activities is also a key issue in Assisted Living (AL) applications, where it can be useful for example to rate how a person performs routine activities [2,3].One further field of application is kinesiotherapy, where the aim is to provide monitoring of physical therapies for patients who have suffered a stroke, multiple sclerosis, joint replacements or reconstructions, amputation, brain and spinal cord injury, or some motor function disability resulting from Parkinson's disease [4][5][6]. For these cases, wireless body  Manuscript received….…”

mentioning

confidence: 99%

“…One further field of application is kinesiotherapy, where the aim is to provide monitoring of physical therapies for patients who have suffered a stroke, multiple sclerosis, joint replacements or reconstructions, amputation, brain and spinal cord injury, or some motor function disability resulting from Parkinson's disease [4][5][6]. For these cases, wireless body  Manuscript received….…”

mentioning

confidence: 99%

“…The purpose of using a WBAN is to improve health care quality and efficacy, and also to reduce health assistance costs. Studies relative to WBANs usually include the use of various transducers like accelerometers and gyroscopes [6,8]. Alternative approaches include motion capture systems [9], which are based on video cameras that can follow the movements of a number of markers placed on the human body in order to reconstruct its activity.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Limb Movements Classification Using Wearable Wireless Transceivers

Guraliuc

Barsocchi

Potortì

et al. 2011

IEEE Trans. Inform. Technol. Biomed.

View full text Add to dashboard Cite

Abstract-A feasibility study where small wireless transceivers are used to classify some typical limb movements used in physical therapy processes is presented. Wearable wireless low-cost commercial transceivers operating at 2.4 GHz are supposed to be widely deployed in indoor settings and on people's bodies in tomorrow's pervasive computing environments. The key idea of this work is to exploit their presence by collecting the received signal strength measured between those worn by a person. The measurements are used to classify a set of kinesiotherapy activities. The collected data are classified using both Support Vector Machine and K-Nearest Neighbour methods, in order to recognise the different activities. Index Terms- I. INTRODUCTIONHE increasing improvements of wireless technology and miniaturized sensors made possible the proliferation of wireless sensor networks. These communications networks are one of the first real world examples of pervasive computing: they are composed of small, smart and cheap sensing devices that promise to eventually permeate the environment. We may face a not so distant future where small sensors, all capable of wireless communication, are ubiquitously deployed in the environment and on people's body. TExtensive attention has been focused in the literature on wireless sensor networks, especially in the framework of wireless body sensor networks [1]. In particular, wearable wireless systems were developed to detect, track and understand people's behaviour. In recent years, the detection of body posture and activity received a significant interest for their application in sports, medicine and military. Recognizing people's activities is also a key issue in Assisted Living (AL) applications, where it can be useful for example to rate how a person performs routine activities [2,3].One further field of application is kinesiotherapy, where the aim is to provide monitoring of physical therapies for patients who have suffered a stroke, multiple sclerosis, joint replacements or reconstructions, amputation, brain and spinal cord injury, or some motor function disability resulting from Parkinson's disease [4][5][6]. For these cases, wireless body  Manuscript received….Anda R. Guraliuc and Paolo Nepa are with the Department of Information Engineering, University of Pisa, Italy (via Caruso 16, I-56122, Pisa, Italy, phone: +39 050 2217511; fax: +39 050 2217522; e-mail: {anda.guraliuc, paolo.nepa}@iet.unipi.it).Paolo Barsocchi and Francesco Potortì are with the ISTI Institute of CNR (via Moruzzi 1, I-56124, Pisa, Italy, e-mail: {paolo.barsocchi, potorti}@isti.cnr.it): their work is supported in part by the European Commission in the framework of the FP7 project UNIVERSAAL (contract N. 247950).sensor networks could replace the existing wired telemetry systems [7], allowing remotely supervised kinesiotherapy. In a typical wearable Wireless Body Area Network (WBAN) scenario, a patient wears some sensors that form an on-body sensor network, while an off-body base station registers data collected...

show abstract

A Wearable Sensing System for Tracking and Monitoring of Functional Arm Movement

Cited by 95 publications

References 8 publications

Data fusion of multiple kinect sensors for a rehabilitation system

Data fusion of multiple kinect sensors for a rehabilitation system

Total Harmonic Distortion and Content Rate of Spatial Modal Information for Haptic Parallel Motion Analysis

Limb Movements Classification Using Wearable Wireless Transceivers

Contact Info

Product

Resources

About