Hand Gesture Recognition Using EGaIn-Silicone Soft Sensors

Abstract

Exploiting hand gestures for non-verbal communication has extraordinary potential in HCI. A data glove is an apparatus widely used to recognize hand gestures. To improve the functionality of the data glove, a highly stretchable and reliable signal-to-noise ratio sensor is indispensable. To do this, the study focused on the development of soft silicone microchannel sensors using a Eutectic Gallium-Indium (EGaIn) liquid metal alloy and a hand gesture recognition system via the proposed data glove using the soft sensor. The EGaIn-silicone sensor was uniquely designed to include two sensing channels to monitor the finger joint movements and to facilitate the EGaIn alloy injection into the meander-type microchannels. We recruited 15 participants to collect hand gesture dataset investigating 12 static hand gestures. The dataset was exploited to estimate the performance of the proposed data glove in hand gesture recognition. Additionally, six traditional classification algorithms were studied. From the results, a random forest shows the highest classification accuracy of 97.3% and a linear discriminant analysis shows the lowest accuracy of 87.4%. The non-linearity of the proposed sensor deteriorated the accuracy of LDA, however, the other classifiers adequately overcame it and performed high accuracies (>90%).

Octopus‐Inspired Suction Cups with Embedded Strain Sensors for Object Recognition

“…The most common applications of machine learning are for solving classification problems requiring complex input signals, identifying features automatically from the data, and handling complex preprocessing workflows using well‐known algorithms, such as k ‐nearest neighbor (KNN), feed‐forward neural networks, or classical naive Bayesian methods. For more complex problems, such as object identification and recognition, [ 53 ] support vector machine (SVM) is one of the most effective supervised learning models, [ 54 ] while the multilayer perceptron is most effective when little is known about the structure of the problem. [ 55 ] In this application, we used multilayer perceptron as a standard algorithm to classify the materials both in air and in water.…”

Human body IoT systems based on the triboelectrification effect: energy harvesting, sensing, interfacing and communication

“…Moreover, these TENG applications have even provided a means of non-verbal communication between individuals. 154,155 Thus, future research can focus on providing warnings or feedback signals to inform the wearer of the biomechanical status of their body.…”

Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas

“…On the other hand, stretchable garments with strain-based or pressure sensing methods have been studied by many researchers (Boyali et al, 2012;Jung et al, 2015;Zhou et al, 2017;Skach et al, 2018;Mokhlespour Esfahani and Nussbaum, 2019;Lin et al, 2020;Ramalingame et al, 2021;Shin et al, 2021), which demonstrate their value in textile based BPG recognition. Fiber optic embedded in a jacket and pants was proposed in a limited study (one person) (Koyama et al, 2018); the transmitted light changes with the wearer's movements, creating a time series pattern due to the bending of the fiber optics.…”