Abstract-Kinect-like depth sensors have been widely used in rehabilitation systems. However, single depth sensor processes limb-blocking, data loss or data error poorly, making it less reliable. This paper focus on using two Kinect sensors and data fusion method to solve these problems. First, two Kinect sensors capture the motion data of the healthy arm of the hemiplegic patient; Second, merge the data using the method of Set-Membership-Filter (SMF); Then, mirror this motion data by the Middle-Plane; In the end, control the wearable robotic arm driving the patient's paralytic arm so that the patient can interactively and initiatively complete a variety of recovery actions prompted by computer with 3D animation games.
I. INTRODUCTIONPhysical disability is a big challenge in today's society. Because of the lack of therapist and the rising costs of health care, etc., more and more people cannot get timely rehabilitation and become permanently disabled. In addition, the traditional treatment is that the therapist assists the patient to do a variety of actions repeatedly to restore limb functionality. Patient cooperates with the therapist passively, lack of enthusiasm and initiative of participation. Studies have shown that, compared to the traditional treatment, interactive and initiative rehabilitation treatment restore limb functionality more effectively [1].We build a Mirror Movements Rehabilitation Therapy System (MMRTS) for hemiplegic patients. The system consists of a seat, a 3-DOF wearable robotic arm, two Kinect sensors and a computer. The seat and robotic arm are as shown in Fig.1. This system uses two Kinect sensors for tracking the motion data of the healthy arm of the patient himself without the marked points.As a prerequisite of the MMRTS, motion data acquisition is a key problem. We need sensors that can track human limb movement in real-time, no special requirements on the environment, no needing marked points, and no affecting patient's health side limb. The sensors should be easy to use, affordable, and do not need any calibration action. The Microsoft's Kinect is such a sensor.Microsoft's Kinect is a specially designed device for the natural human-computer interaction that can obtain RGB and depth images. There have been some studies applying Kinect to rehabilitation therapy. For example, [1-4] designed their own Kinect based rehabilitation systems with a variety of Huibin Du is with the State