Stretchable spring‐sheathed yarn sensor for 3D dynamic body reconstruction assisted by transfer learning

Abstract

A wearable sensing system that can reconstruct dynamic 3D human body models for virtual cloth fitting is highly important in the era of information and metaverse. However, few research has been conducted regarding conformal sensors for accurately measuring the human body circumferences for dynamic 3D human body reshaping. Here, we develop a stretchable spring‐sheathed yarn sensor (SSYS) as a smart ruler, for precisely measuring the circumference of human bodies and long‐term tracking the movement for the dynamic 3D body reconstruction. The SSYS has a robust property, high resilience, high stability (>18 000), and ultrafast response (12 ms) to external deformation. It is also washable, wearable, tailorable, and durable for long‐time wearing. Moreover, geometric, and mechanical behaviors of the SSYS are systematically investigated both theoretically and experimentally. In addition, a transfer learning algorithm that bridges the discrepancy of real and virtual sensing performance is developed, enabling a small body circumference measurement error of 1.79%, noticeably lower than that of traditional learning algorithm. Furtherly, 3D human bodies that are numerically consistent with the actual bodies are reconstructed. The 3D dynamic human body reconstruction based on the wearing sensing system and transfer learning algorithm enables excellent virtual fitting and shirt customization in a smart and highly efficient manner. This wearable sensing technology shows great potential in human‐computer interaction, intelligent fitting, specialized protection, sports activities, and human physiological health tracking.image

Flexible Meso Electronics and Photonics Based on Cocoon Silk and Applications

“…Wu et al have developed a wearable sensing system that utilizes a highly stretchable spring-sheathed yarn sensor (SSYS) in combination with a transfer learning algorithm for automatic modeling of anthropometric parameters and dynamic reconstruction of the human body (Figure 9A). 15 The SSYS is sewn onto different regions of the garment, such as the wrist, arm, shoulder, chest, and waist, enabling the measurement of human body dimensions in 3D (Figure 9B). Finite element analysis simulations validate the design of the SSYS, indicating that the sensor responds to stretching by elongating the core PU yarn and straightening the sheath yarns (Figure 9C).…”

“…The measurement with the transfer learning algorithm decreased the measurement errors. Reproduced with permission from ref . Copyright 2023 Wiley-VCH.…”

“…(F) Measurement errors for motion tracking with and without the TL model of different motion types and six different users. Reproduced with permission from ref . Copyright 2023 Wiley-VCH.…”

“…(A) Revolutionary remote personalized clothes customization enabled by yarn sensing arrays. Reproduced with permission from ref . Copyright 2023 Wiley-VCH.…”

“…Copyright 2021 Wiley-VCH. “Smart Clothes with yarn sensing array for human body dimension and action measurement”, Reproduced with permission from ref . Copyright 2023 Wiley-VCH.…”