Effects of Hand Representations for Typing in Virtual Reality

Grubert, Jens; Witzani, Lukas; Ofek, Eyal; Pahud, Michel; Kranz, Matthias; Kristensson, Per Ola

doi:10.1109/vr.2018.8446250

Cited by 78 publications

(51 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The virtual environment was showing the virtual keyboard and a monitor resting on a desk. In line with previous work [30,31] the passwords and the entered text were visualized both on the monitor and directly above the keyboard. The system was implemented in Unity 2018.2 and deployed on a PC (Intel Xeon E5-1650 processor, 64 GB RAM, Nvidia GTX 1070 graphics card) running Windows 10.…”

Section: Apparatus and Materialsmentioning

confidence: 85%

“…Grubert et al [30,31] investigated the performance of physical and touch keyboards and physical/virtual co-location for VR text entry. They proposed to use minimalistic fingertip rendering as hand representation and indicated that this representation is as efficient as a video-see through of the user's physical hands [30]. Subsequently, similar studies have investigated further hand representations, such as semi-transparent hand models [40].…”

Section: Physical Keyboards For Vrmentioning

confidence: 99%

“…The setup is shown in Figure 6. We utilized a minimalistic finger tip representation as suggested by prior [30] work to indicate the hand position relative to the keyboard, see Figure 5.…”

Section: Apparatus and Materialsmentioning

confidence: 99%

See 2 more Smart Citations

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Figure 1: Example for reconfiguring the input and output space of individual keys of a physical keyboard in virtual reality. Top row from left to right: emoji entry, special characters, secure password entry using randomized keys. Bottom row from left to right: foreign languages, browser shortcuts, text processing macros. ABSTRACTPhysical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive headmounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment. In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard. We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR-relevant applications: emojis, languages and special characters, application shortcuts, vir-* tual text processing macros, a window manager, a photo browser, a whack-a-mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.

show abstract

Section: Apparatus and Materialsmentioning

confidence: 85%

Section: Physical Keyboards For Vrmentioning

confidence: 99%

See 1 more Smart Citation

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

show abstract

“…Another freedom VR provides is changing the representation and display of the user's hands in the virtual environment 10 . For example, the user's hands can become translucent in the virtual environment, which might provide an unobstructed view of the keyboard.…”

Section: Figurementioning

confidence: 99%

The Office of the Future: Virtual, Portable, and Global

Grubert

Ofek

Pahud

et al. 2018

IEEE Comput. Grap. Appl.

Self Cite

View full text Add to dashboard Cite

Virtual Reality has the potential to change the way we work. We envision the future office worker to be able to work productively everywhere solely using portable standard input devices and immersive head-mounted displays. Virtual Reality has the potential to enable this, by allowing users to create working environments of their choice and by relieving them from physical world limitations such as constrained space or noisy environments. In this article, we investigate opportunities and challenges for realizing this vision and discuss implications from recent findings of text entry in virtual reality as a core office task.Much of the hype around Virtual Reality (VR) has focused on immersive gaming and entertainment, and considerable progress has been made in those directions in recent years. The underpinning thesis in this article, however, is that recent VR research progress allows us to also reimagine the office work of the future 1 . Raskar et al. imagined novel use cases for office work based on projection-based Augmented Reality, allowing local office workers with remote groups. Immersive head-mounted displays build upon this idea without the need for instrumentation of the environment with projectorcamera systems and, hence, enable novel office experiences on the go. VR office based on immersive head-mounted displays (HMDs) open up a novel design space with exciting new opportunities for immersive, flexible and fluid office work.Despite the rapid rise of mobile devices such as smartphones and tablets, the traditional workstation and laptop setups still dominate today's office work. Users type text on full-sized physical QWERTY keyboards and use a mouse or trackpad to select and manipulate on-screen objects. Common activities such as typing, editing text, changing

show abstract

“…People are quite skilled at using keyboards in traditional desktop computing, but when wearing a head-mounted display (HMD) the lack of visual feedback makes typing more difficult [41,56]. Recent work has focused on exploring alternative virtual representations of the keyboard and hands [25,34] and using mixed-reality systems to overlay camera data of the user's hands with virtual content [31]. Yet these approaches require the user to be seated and do not work for room-scale VR or AR, the scenarios with the highest potential immersion and use of physical navigation to enhance presence.…”

Section: Introductionmentioning

confidence: 99%

Arc-Type and Tilt-Type: Pen-based Immersive Text Input for Room-Scale VR

Jackson

Caraco

Spilka

2020

Symposium on Spatial User Interaction

View full text Add to dashboard Cite

Figure 1: Left: A user manipulates a pen-shaped stylus to enter text in a virtual reality CAVE, where traditional keyboard interaction limits mobility. Center: The Tilt-Type interface uses small finger motions to tilt the stylus along two axes, changing the selected character in a binned layout. Right: The Arc-Type interface uses a rotational gesture and interactions with a touch slider to select characters from a radial layout.

show abstract

Effects of Hand Representations for Typing in Virtual Reality

Cited by 78 publications

References 41 publications

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

The Office of the Future: Virtual, Portable, and Global

Arc-Type and Tilt-Type: Pen-based Immersive Text Input for Room-Scale VR

Contact Info

Product

Resources

About