Facial performance sensing head-mounted display

Li, Hao; Trutoiu, Laura; Olszewski, Kyle; Wei, Lingyu; Trutna, Tristan; Hsieh, Pei-Lun; Nicholls, Aaron; Ma, Chongyang

doi:10.1145/2766939

Cited by 168 publications

(124 citation statements)

References 38 publications

Supporting

Mentioning

119

Contrasting

Order By: Relevance

“…From an objective perspective this makes sense particularly for social VR: having a body is an important aspect of social interaction, since it allows us to keep peripersonal spaces (proxemics) or show expressions when interacting with others (Llobera et al, 2010;Trutoiu et al, 2011;Kastanis and Slater, 2012;Li et al, 2015).…”

Section: Embodiment Presence and Immersionmentioning

confidence: 99%

Avatar Embodiment. Towards a Standardized Questionnaire

2018

View full text Add to dashboard Cite

Inside virtual reality, users can embody avatars that are collocated from a first-person perspective. When doing so, participants have the feeling that the own body has been substituted by the self-avatar, and that the new body is the source of the sensations. Embodiment is complex as it includes not only body ownership over the avatar, but also agency, co-location, and external appearance. Despite the multiple variables that influence it, the illusion is quite robust, and it can be produced even if the self-avatar is of a different age, size, gender, or race from the participant's own body. Embodiment illusions are therefore the basis for many social VR experiences and a current active research area among the community. Researchers are interested both in the body manipulations that can be accepted, as well as studying how different self-avatars produce different attitudinal, social, perceptual, and behavioral effects. However, findings suggest that despite embodiment being strongly associated with the performance and reactions inside virtual reality, the extent to which the illusion is experienced varies between participants. In this paper, we review the questionnaires used in past experiments and propose a standardized embodiment questionnaire based on 25 questions that are prevalent in the literature. We encourage future virtual reality experiments that include first-person virtual avatars to administer this questionnaire in order to evaluate the degree of embodiment.

show abstract

Section: Embodiment Presence and Immersionmentioning

confidence: 99%

Avatar Embodiment. Towards a Standardized Questionnaire

2018

View full text Add to dashboard Cite

show abstract

“…Many scholars have studied how to use these devices in different scenarios. Li et al [11] studied the use of a helmet display for facial expression perception. In their follow-up [12] , they also explored the use of helmet displays for face animation and speech synthesis.…”

Section: Helmet Displaymentioning

confidence: 99%

Virtual Fashion Show with HTC VIVE

Xing¹,

Chen²,

Sufang³

et al. 2018

dtcse

View full text Add to dashboard Cite

Abstract. Virtual cloth demonstration has great potential in digital cloth design, and thus has been discussed a lot in academic community. However, limited by the display hardware, existing systems are lack of immersion which affects users' experience a lot. Recently, the emergence of head mounted display system such as Oculus Rift and HTC Vive provides a possible manner to solve the problem. This paper proposes to build a virtual fashion show system to simulate a real show based on HTC Vive. The system use software of unity3D and 3DMax to model the stage scene, lighting, music and character models, clothing to reproduce the real stage maximally, which can give users a high degree of immersion. Simultaneously the system allows users to use the HTC Vive handle to interact with the system, including changing the angle of view and selecting the shape of the stage, lighting, clothing and adjusting the style of model shape. A variety of built-in data (including motion capture data, clothes and human model templates) can intelligently recommend module to meet user needs, which could create a customized fashion show.

show abstract

“…User immersion was maximized by considering not only simple props such as a wall and door, but also diverse physical objects and effects including ledges, steps, switches, portals, and wind. In addition, Li et al [22] reflected change of expression by detecting user's face movement with a sensor attached to HMD and reflecting it on the virtual reality. In their study, change of expression was detected through a head-mounted RGB-D camera and movement of mouth was particularly computed in detail to be applied to the virtual character.…”

Section: Virtual Realitymentioning

confidence: 99%

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Kim

2016

Symmetry

View full text Add to dashboard Cite

This study proposes a modeling method that can effectively generate multiple diverse digital trees for creating immersive virtual landscape based on virtual reality and an optimization method for real-time rendering. The proposed method simplifies a process of procedures from growth of tree models to the generation of the three-dimensional branch geometric model. Here, the procedural branch graph (PBG) algorithm is proposed, which simultaneously and effectively generates diverse trees that have a similar branch pattern. Moreover, the optimization method is designed in a polygon-based branch model which controls the resolution of tree models according to the distance from the camera to generate a tree model structure that is appropriate for an immersive system based on virtual reality. Finally, a virtual reality system is established based on the Oculus SDK (Software Development Kit) and Unity3D engine. In this process, the image processing-based pixel to tree (PTT) method is proposed as a technique for easily and efficiently generating a virtual landscape by allocating multiple trees on terrain. An immersive virtual landscape that has a stereoscopic perception and spatial impression is created through the proposed method and whether it can deliver experience of nature in virtual reality to the users was checked through an experiment.

show abstract

Facial performance sensing head-mounted display

Cited by 168 publications

References 38 publications

Avatar Embodiment. Towards a Standardized Questionnaire

Avatar Embodiment. Towards a Standardized Questionnaire

Virtual Fashion Show with HTC VIVE

Modeling and Optimization of a Tree Based on Virtual Reality for Immersive Virtual Landscape Generation

Contact Info

Product

Resources

About