Skin Electronics: Next‐Generation Device Platform for Virtual and Augmented Reality

Abstract

Virtual reality (VR) and augmented reality (AR) are overcoming the physical limits of real‐life using advances in devices and software. In particular, the recent restrictions in transportation from the coronavirus disease 2019 (COVID‐19) pandemic are making people more interested in these virtual experiences. However, to minimize the differences between artificial and natural perception, more human‐interactive and human‐like devices are necessary. The skin is the largest organ of the human body and interacts with the environment as the site of interfacing and sensing. Recent progress in skin electronics has enabled the use of the skin as the mounting object of functional devices and the signal pathway bridging humans and computers, with opening its potential in future VR and AR applications. In this review, the current skin electronics are summarized as one of the most promising device solutions for future VR/AR devices, especially focusing on the recent materials and structures. After defining and explaining VR/AR systems and the components, the advantages of skin electronics for VR/AR applications are emphasized. Next, the detailed functionalities of skin electronic devices, including the input, output, energy devices, and integrated systems, are reviewed for future VR/AR applications.

Three-Axis Pneumatic Haptic Display for the Mechanical and Thermal Stimulation of a Human Finger Pad

“…The force feedback on the finger consists of normal haptic feedback to represent the force applied perpendicular to the finger surface and shear haptic feedback to represent slip and pull on the surface of the object. Recently, studies of the three-axis haptic feedback have been reported for more intuitive haptic feedback during teleoperation [11,21,22]. Leroy et al published a device that can generate haptics in both vertical and lateral directions using electrostatic forces [21].…”

“…Recently, studies of the three-axis haptic feedback have been reported for more intuitive haptic feedback during teleoperation [11,21,22]. Leroy et al published a device that can generate haptics in both vertical and lateral directions using electrostatic forces [21]. Although hydrolytic forces were combined, it was a limitation of the device that the maximum lateral force was only 5 mN and the displacement was less than 1 mm.…”

AR in the Architecture Domain: State of the Art

“…Pham and Stuerzlinger propose comparing the different controllers, focusing on the flexibility in using the 3D pen for VR and AR applications [105]. Electronic skins have recently been investigated as one of the most promising device solutions for future VR/AR devices [106], while the ARtention project [107] illustrates how input information can come directly from retinal motion. Finally, the MARVIS project proposes integrating HMDs and mobile devices for optimized data management in augmented reality [108].…”

Conformal electrodes for on‐skin digitalization

“…On‐skin digitalization is to transform multidimensional epidermal physiological signals into computer‐sensible digital language, streamlining the concept of the “human to device to cyberspace” platform. It aimed at making computers to interact with human in physical reality, at the same time adapting to the shape and mechanical characteristics of human skins 1 . The whole platform for on‐skin digitalization is divided into two parts, input sensing parts and integrated data processing systems.…”