Natural Tactile Interaction with Virtual Clay

Barreiro, Héctor; Torres, Joan; Otaduy, Miguel Á.

doi:10.1109/whc49131.2021.9517171

Cited by 4 publications

(10 citation statements)

References 31 publications

(40 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Right: the extracted pressure field on the virtual hand (bottom), and the rendered pressure field to the user in the left image (top) [9]. (e) Arts & crafts in the virtual classroom with a tangible interactive experience of highly realistic deformations, merging, and splitting [104]. (f) A user discerns the softness of the virtual object via an ultrasound transducer array [105].…”

Section: B Tactile Renderingmentioning

confidence: 99%

“…Barreiro et al formulated the computation of the rendered pressure as an optimization problem, and optimized the location and intensity of focal points based on AM for the interaction with fluid [9] (Fig. 8 (d)) and clay material [104] (Fig. 8 (e)).…”

Section: B Tactile Renderingmentioning

confidence: 99%

“…Existing studies support hand-based interaction with rigid objects well, and usually involving a single object. For the interaction with complex-material objects, such as clay-like objects [104], and fluids [9], the update rate of full simulation and haptic rendering is tens of Hertz. Such a low update rate results from the high complexity of modeling complex-material objects such as nonlinear deformations and fluids, which also brings challenges to interactive realism.…”

Section: A Realistic Visual Display Of Hand-object Interactionmentioning

confidence: 99%

“…9 (b)−three fingers rotate a pencil), and contacts between the virtual hand and virtual objects with special shapes (thin-wall objects and thin lines [28], [133], etc.) or complex physical properties (deformable objects [104], [134], [135], etc.). The former challenge results primarily from the current limited computational and handling ability for various distributed contacts due to the complexity of contact modeling, and thus hand-object penetration and interaction instability might occur.…”

Section: A Realistic Visual Display Of Hand-object Interactionmentioning

confidence: 99%

“…Currently, there is still a lack of accessible software platforms to support handbased haptic interaction. A few pioneering works for handbased interaction such as CLAP 5 [56], [104] aims to provide a realistic hand simulator for real-time applications, and it features real-time hand simulation with soft skin, supporting hand touching and grasping of virtual objects. Haptic devices and haptic rendering algorithms are two key components for the development and application of a haptic interactive software platform.…”

Section: Software Platform For Hand-based Haptic Interactionmentioning

confidence: 99%

See 4 more Smart Citations

Survey on Hand-Based Haptic Interaction for Virtual Reality

Tong

Wei

Zhang

et al. 2023

IEEE Trans. Haptics

View full text Add to dashboard Cite

Interacting with virtual objects with haptic feedback directly using the user's hand (hand-based haptic interaction) has attracted increasing attention. Due to the high degrees of freedom of the hand, compared with tool-based interactive simulation using a pen-like haptic proxy, hand-based haptic simulation faces greater challenges, mainly including higher motion mapping and modeling difficulty of deformable hand avatars, higher computational complexity of contact dynamics, and nontrivial multi-modal fusion feedback. In this paper, we aim to review key computing components for hand-based haptic simulation, and draw out major findings in this direction while analyzing the gaps toward immersive and natural hand-based haptic interaction. To this end, we investigate existing relevant studies on hand-based interaction with kinesthetic and/or cutaneous display in terms of virtual hand modeling, hand-based haptic rendering, and visuohaptic fusion feedback. By identifying current challenges, we finally highlight future perspectives in this field.

show abstract

Section: B Tactile Renderingmentioning

confidence: 99%

Section: B Tactile Renderingmentioning

confidence: 99%

Section: A Realistic Visual Display Of Hand-object Interactionmentioning

confidence: 99%

Section: A Realistic Visual Display Of Hand-object Interactionmentioning

confidence: 99%

Section: Software Platform For Hand-based Haptic Interactionmentioning

confidence: 99%

See 3 more Smart Citations

Survey on Hand-Based Haptic Interaction for Virtual Reality

Tong

Wei

Zhang

et al. 2023

IEEE Trans. Haptics

View full text Add to dashboard Cite

show abstract

When Tangibles Become Deformable: Studying Pseudo-Stiffness Perceptual Thresholds in a VR Grasping Task

Bouzbib

Pacchierotti

Lécuyer

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Compliant Stiff Compliant StiffBefore Deformation After DeformationVirtual Environment Sponge Tomato Matchbox Plastic Bottle LockFig. 1: When Tangibles Become Deformable: In the virtual environment, objects are displayed before and after being compressed, following a compliance-stiffness continuum (sponge, tomato, matchbox, water bottle, lock). In the real environment, a user is compressing a tangible object. Using pseudo-stiffness, she perceives this same range of stiffness, while only grasping a noncompressible object. We investigate the range of compliance and stiffness that can be elicited on a non-compressible tangible object.

show abstract

Material Attribute Estimation as Part of Telecommunication Augmented Reality, Virtual Reality, and Mixed Reality System: Systematic Review

Christoff,

Tonchev

2024

Electronics

View full text Add to dashboard Cite

The integration of material attribute estimation (MAE) within augmented reality, virtual reality, and mixed reality telecommunication systems stands as a pivotal domain, evolving rapidly with the advent of the Tactile Internet. This unifying implementation process has the potential for improvements in the realism and interactivity of immersive environments. The interaction between MAE and the haptic Internet could lead to significant advances in haptic feedback systems, enabling more accurate and responsive user experiences. This systematic review is focused on the intersection of MAE and the Tactile Internet, aiming to find an implementation path between these technologies. Motivated by the potential of the haptic Internet to advance telecommunications, we explore its potential to advance the analysis of material attributes within AR, VR, and MR applications. Through an extensive analysis of current research approaches, including machine learning methods, we explore the possibilities of integrating the TI into MAE. By exploiting haptic and visual properties stored in the materials of 3D objects and using them directly during rendering in remote access scenarios, we propose a conceptual framework that combines data capture, visual representation, processing, and communication in virtual environments.

show abstract

Natural Tactile Interaction with Virtual Clay

Cited by 4 publications

References 31 publications

Survey on Hand-Based Haptic Interaction for Virtual Reality

Survey on Hand-Based Haptic Interaction for Virtual Reality

When Tangibles Become Deformable: Studying Pseudo-Stiffness Perceptual Thresholds in a VR Grasping Task

Material Attribute Estimation as Part of Telecommunication Augmented Reality, Virtual Reality, and Mixed Reality System: Systematic Review

Contact Info

Product

Resources

About