Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

Abstract

Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.

Recent progress of triboelectric nanogenerators: From fundamental theory to practical applications

“…Considering that mechanical motions are ubiquitous in sports activities, TENGs have shown great potential in developing self-powered athletic sensing systems, including smart sports facility and wearable equipment. 118,[120][121][122] As shown in Figure 9B, a flexible and durable wood-based TENG for fabricating a smart pingpong table was developed by Luo et al, which could directly convert the impactions between the ping-pong ball and the table surface into electrical signals. 20 By setting a TENG array on the table, a self-powered falling point distribution statistical system that could perform motion path tracking, velocity sensing, and distribution statistics was successfully realized (Figure 9C,D).…”

Progress inTENGtechnology—A journey from energy harvesting to nanoenergy and nanosystem

“…By applying machine learning and haptic feedback, the integrated glove demonstrated the advanced interaction in baseball and surgical training, with intuitive control and accurate object recognition. 24 Generally, TENG based wearable sensors expose the great potential of being the next generation of self-powered HMIs for the detection of multidimensional physical activities. 229 Meanwhile, there are also several obstacles that need to be considered, such as sensitivity, environmental influences, and so on.…”

Advances in Healthcare Electronics Enabled by Triboelectric Nanogenerators

“…[99][100][101][102] Both textile and nontextile materials can be fabricated into wearable, stretchable and high-sensitive TENGs. [30,[103][104][105][106][107][108][109] In this section, TENGs work as auditory and pressure sensors will be reviewed. Apart from attaching on the surface of the human Reproduced with permission.…”