Electronic skin as wireless human-machine interfaces for robotic VR

Liu, Yiming; Yiu, Chun Ki; Song, Zhen; Huang, Ya; Yao, Kuanming; Wong, Tsz Hung; Zhou, Jingkun; Zhao, Ling; Huang, Xingcan; Nejad, Sina Khazaee; Wu, Mengge; Li, Dengfeng; He, Jiahui; Guo, Xu; Yu, Junsheng; Feng, Xue; Xie, Zhaoqian; Yu, Xinge

doi:10.1126/sciadv.abl6700

Cited by 128 publications

(135 citation statements)

References 40 publications

Supporting

Mentioning

124

Contrasting

Order By: Relevance

“…With the continuous popularization of the era of big data, − human–ambience/machine interaction, as one of the branches, has received cumulative attention. − The complexity of the interface parameters puts forward higher requirements for the functionality of the sensing materials − and the richness of the sensing mechanisms. − In this process, the mutual interferences among functions make it hard for the system to respond accurately when various parameters vary simultaneously. A preferred strategy for realizing multimodal sensation on one sensing system is to use the same sensory unit for detecting different physical quantities without signal interference through the design of materials, such as using the ion relaxation dynamics of an ion conductor to decouple the strain and temperature measurement or capitalizing on zwitterionic thermo-glucose-sensitive hydrogels to distinguish discrete stimuli .…”

mentioning

confidence: 99%

Double-Sided Wearable Multifunctional Sensing System with Anti-interference Design for Human–Ambience Interface

et al. 2022

View full text Add to dashboard Cite

Multifunctional sensing systems play important roles in a variety of applications, incluing health surveillance, intelligent prothetics, human–machine/ambinece interfaces, and many others. The richness of the signal and the decoupling among multiple parameters are essential for simultaneous, multimodal measurements. However, current multifunctional sensing fails to decouple interferences from various signals. Here, we propose a double-sided wearable system that both enables multifunctional sensing and avoids the interferences among multiple parameters. Specifically, the sensitivities of system modules to strain are controlled through customizing the pattern and morphology of sensing electrodes as well as the modification of active materials. Compensation of temperature drift and selection of sensing mechanisms ensure the thermal stability of the system. The encapsulation of modules resists the interferences of proximity, normal pressure, and gas molecules at the same time. A double-sided partition layout with serpentine interconnections reduces the effect of motion artifacts and ensures simultaneous operation of electrochemical-sensing modules. Cooperation among decoupled modules acts as the bridge between the perception of ambience changes and the timely feedback of the human body. In addition, to sense the signal at the interface, modules for energy harvesting and storage are also integrated into the system to broaden its application scenarios.

show abstract

mentioning

confidence: 99%

Double-Sided Wearable Multifunctional Sensing System with Anti-interference Design for Human–Ambience Interface

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Some recent works have focused on its application in the field of human-machine interaction, especially in virtual reality (VR) and augmented reality (AR). [223][224][225][226] Sensors can serve as the interface to gather the signals transmitted by human stimuli such as touch, sound, myoelectric activity, and nerve impulses for the front end of humanmachine interaction system, and then transform them into the data input required by the back end. [227][228][229][230][231] The adoption of bioinspired sensor technology enables the further development of human-machine interaction.…”

Section: Human-machine Interactionmentioning

confidence: 99%

“…As a part of the bionic tactile sensing closed‐loop system, artificial haptic interfaces play an important role in human‐machine interaction. Some recent works have focused on its application in the field of human‐machine interaction, especially in virtual reality (VR) and augmented reality (AR) 223–226 . Sensors can serve as the interface to gather the signals transmitted by human stimuli such as touch, sound, myoelectric activity, and nerve impulses for the front end of human‐machine interaction system, and then transform them into the data input required by the back end 227–231 .…”

Section: Applications Of Bioinspired Sensor Systemmentioning

confidence: 99%

Bioinspired sensor system for health care and human‐machine interaction

Xue

Zou

Deng

et al. 2022

EcoMat

View full text Add to dashboard Cite

Bioinspired sensor system leads the development of new generation sensor technology with remarkable features like ultra‐sensitivity, low‐power consumption and self‐adaptability. With the help of bioinspired sensor systems, human perception can be quantified and machines can be endowed with specific perception. As an emerging technology, bioinspired sensor system has been widely used in various fields such as industrial, medical, food safety, military and robotic. This review summarizes the recent process of bioinspired sensor system. First, three bionic strategies are defined as bionic materials, bionic structures, and functional bionic according to the sources of bionic inspiration. Second, bioinspired sensor systems with different working mechanisms are summarized and classified into piezoresistive, capacitive, triboelectric, piezoelectric, and other types. Afterward, for applications, the representative works of bioinspired sensor system for health care and human‐machine interaction are focused and introduced, respectively. Finally, the current challenges and prospects of bioinspired sensor system are also discussed.

show abstract

“…There are actuators based on tendon driver 51 , pneumatic 52 , and electrostatic 53 mechanisms that can generate large-scale forces to provide kinesthetic feedback. Secondly, the electrotactile simulators 54 and the vibrotactile devices enabled by electromagnetics 55 , 56 , electroactive polymer 57 , 58 and piezoelectrics 59 can simulate afferent nerves or mechanoreceptors in the skin for cutaneous stimuli. Compared with bulky kinesthetic actuation systems and other cutaneous stimulators requiring an external/high supply power, electromagnetic vibrators possess the merits of small size and low-driven voltage 60 .…”

Section: Introductionmentioning

confidence: 99%

Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

et al. 2022

View full text Add to dashboard Cite

Advancements of virtual reality technology pave the way for developing wearable devices to enable somatosensory sensation, which can bring more comprehensive perception and feedback in the metaverse-based virtual society. Here, we propose augmented tactile-perception and haptic-feedback rings with multimodal sensing and feedback capabilities. This highly integrated ring consists of triboelectric and pyroelectric sensors for tactile and temperature perception, and vibrators and nichrome heaters for vibro- and thermo-haptic feedback. All these components integrated on the ring can be directly driven by a custom wireless platform of low power consumption for wearable/portable scenarios. With voltage integration processing, high-resolution continuous finger motion tracking is achieved via the triboelectric tactile sensor, which also contributes to superior performance in gesture/object recognition with artificial intelligence analysis. By fusing the multimodal sensing and feedback functions, an interactive metaverse platform with cross-space perception capability is successfully achieved, giving people a face-to-face like immersive virtual social experience.

show abstract

Electronic skin as wireless human-machine interfaces for robotic VR

Abstract: The closed-loop HMI system could compliantly interface with human body for teleoperating various robotics with haptic feedback.

Cited by 128 publications

References 40 publications

Double-Sided Wearable Multifunctional Sensing System with Anti-interference Design for Human–Ambience Interface

Double-Sided Wearable Multifunctional Sensing System with Anti-interference Design for Human–Ambience Interface

Bioinspired sensor system for health care and human‐machine interaction

Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions

Contact Info

Product

Resources

About