This study added a hand gesture quick interactive operation to the human–machine interface of a leg sport system. Hands are of varying skin color, thus, the background noise and light rays during detection can lead to misjudgments. This study adopted the YCbCr color system to detect skin color and minimize the impact of light rays to mark the characteristic point after the skin color had been separated. The system defines three simplified gestures: clenching the fist with the forefinger and reaching out represents the mouse pointer, clenching the fist with the forefinger and thumb and reaching out represents the left button of the mouse, and clenching the fist with the forefinger and little finger and reaching out represents the right button of the mouse, namely clicking the mouse is replaced by hand gestures. The change in the characteristic point is used for operating the hand mouse and interactive connection with games to achieve a preferred presence and feeling of reality.

In this paper we constructed an interactive wheelchair rehabilitation training platform. The roller wheel on the platform is driven mainly by turning the wheelchair, and then the relative position of wheelchair on the screen can be adjusted based on the rotation speed of left and right wheels on the platform. Comparing the digital logic function when two wheels rotate at the same time and judging the variance in digital logic, the steering direction of wheels can be known and be controlled forward or backward. Additionally, the standard digital logic function could be individually judged when left wheel rotates and vice versa, so as to control the steering. Through judging three digital logic functions, the initial time of left wheel, next signal selecting time of left wheel, initial time of right wheel, and next signal selecting time of right wheel could be obtained, then the system can achieve the required direction control function through the judgment formula. The direction control function is indicated by standard digital logic function, so that the user can operate smoothly in the interactive situation software and make an interaction with the computer 3D simulation scene, the patient would have rehabilitation training through various 3D simulation real exteriors. This study not only provides basic trainings but also records the service behavior of wheelchair users, so that the rehabilitation consultant would have reference for the future diagnosis.