Hand Gesture Recognition in a Leg Sport System

Abstract

This study added a hand gesture quick interactive operation to the human–machine interface of a leg sport system. Hands are of varying skin color, thus, the background noise and light rays during detection can lead to misjudgments. This study adopted the YCbCr color system to detect skin color and minimize the impact of light rays to mark the characteristic point after the skin color had been separated. The system defines three simplified gestures: clenching the fist with the forefinger and reaching out represents the mouse pointer, clenching the fist with the forefinger and thumb and reaching out represents the left button of the mouse, and clenching the fist with the forefinger and little finger and reaching out represents the right button of the mouse, namely clicking the mouse is replaced by hand gestures. The change in the characteristic point is used for operating the hand mouse and interactive connection with games to achieve a preferred presence and feeling of reality.

Design of Digital-Twin Human-Machine Interface Sensor with Intelligent Finger Gesture Recognition

“…To achieve the capability of discriminating dynamic gestures or action images [ 26 ] for interactive virtual interaction [ 27 ], the contrast blocks created are pre-contrasted for each captured dynamic image and thus unrelated to the previous implementation. represents the image in the comparison window that will be captured in the picture.…”

“…The search block portion is calculated based on the size of the comparison block. When fingers are bent, and their heights are unsuitable or coordinated with adjacent or stretched fingers, accuracy will be affected [ 27 , 28 ]. Therefore, a window is used to frame the continuous and relatively large skin color to represent the fingertip for simulating mouse pointing functionality [ 29 ].…”

A positioning model of a two CCD camera coordinate system with an alternate-four-matrix look-up table algorithm

“…In recent years, interfaces based on video tracking technology have been developed for non-contact interaction [1][2][3]. Video cameras are used for target tracking and video communication.…”

“…Video cameras are used for target tracking and video communication. Detecting the user's hand position and orientation is also fundamental in the development of vision-driven user interfaces [1]. Basic camera model obtains coordinates of an image point as a non-linear function of the point in the global coordinate system and the extrinsic and intrinsic parameters [4].…”