Method of Finger Motion Recognition Based on Polyvinylidene Fluoride Sensor Array

Abstract

Finger motion recognition is one of the key technologies of human-computer interaction based on gestures. In this paper, we propose a method of recognizing finger motions by using a wearable wrist device (WWD). This method not only avoids the problem that the user's hands are limited by wearing motion detection sensors, but also avoids the problem that vision-sensorbased gesture recognition technology is difficult to use in a mobile environment. Moreover, this method, which uses polyvinylidene fluoride (PVDF) sensors as the detection units of WWD, has the advantages of being noninvasive, comfortable, and convenient. In this work, we first studied the distribution and optimization of the PVDF sensor array, and used this array to complete the acquisition of wrist motion signals. Then, we used short-term energy to solve the problems of the real-time detection of motion signals' endpoints and the extraction of motion signal fragments. Then, we encoded these fragments into 64-digit eigenvectors for finger motion recognition. In the experiment, we transmitted the eigenvectors as input values into a four-layer back propagation (BP) network to recognize three essential finger motions for mouse control. The experimental results show that the recognition effect of this method is satisfactory and the recognition accuracy is up to 96.7%.

Wrist Dorsal Sensor Array for Finger Movement Recognition

“…For the same hardness, we obtained a greater output voltage of the sensor unit with a thicker substrate. By considering the characteristics of dorsal wrist movement, (15) we attempted to obtain a more sensitive sensor. We selected the substrate with a Shore-A hardness of 23 and a thickness of 2 mm and we fabricated the sensor matrix using the substrate, as shown in Fig.…”