Evaluating Text Entry in Virtual Reality using a Touch-sensitive Physical Keyboard

Otte, Alexander; Schneider, Daniel; Menzner, Tim; Gesslein, Travis; Gagel, Philipp; Grubert, Jens

doi:10.1109/ismar-adjunct.2019.000-4

Cited by 16 publications

(12 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Laptop keyboards have different form factor and key design which is likely to open up possibilities for additional design exploration, for instance by allowing gestures by swiping across the physical keys [83]. To this end, alternative sensing capabilities (such as touch-enabled physical keyboards [61]) could be employed with our use cases. Further, this work focused on the use of individual fingers when operating the keyboard.…”

Section: Limitations and Future Workmentioning

confidence: 99%

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Figure 1: Example for reconfiguring the input and output space of individual keys of a physical keyboard in virtual reality. Top row from left to right: emoji entry, special characters, secure password entry using randomized keys. Bottom row from left to right: foreign languages, browser shortcuts, text processing macros. ABSTRACTPhysical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive headmounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment. In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard. We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR-relevant applications: emojis, languages and special characters, application shortcuts, vir-* tual text processing macros, a window manager, a photo browser, a whack-a-mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.

show abstract

Section: Limitations and Future Workmentioning

confidence: 99%

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

show abstract

“…They combined this approach with an auto-correction algorithm, and showed that users could reach a speed of 40 words per minute. A similar approach by Otte et al [72] used touch-sensitive keyboards enabling highlighting touched keys in virtual displays prior to pressing them. They compared fingertip visualization with a touch-sensitive keyboard and found that they are similarly efficient.…”

Section: Representing Keyboards and Handsmentioning

confidence: 99%

Extended Reality for Knowledge Work in Everyday Environments

Biener¹,

Ofek²,

Pahud³

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

Virtual and Augmented Reality (VR and AR) have the potential to change information work. The ability to modify the workers senses can transform everyday environments into a productive office, using portable head-mounted displays (HMDs) combined with conventional interaction devices, such as keyboards and tablets. While a stream of better, cheaper and lighter HMDs have been introduced for consumers in recent years, there are still many challenges to be addressed to allow this vision to become reality. This chapter summarizes the state of the art in the field of extended reality for knowledge work in everyday environments and proposes steps to address the open challenges.

show abstract

“…In VR, around device interaction has been studied in conjunction with physical keyboards for text entry (e.g., [68,74,75,91]).…”

Section: Around Device Interactionmentioning

confidence: 99%

Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality

Menzner¹,

Gesslein²,

Otte³

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Figure 1: Relative, rate-controlled mapping for multiscale navigation between a touchscreen and VR headset: a) A user points her finger in the zoom out space (between the maximum finger height and halfway down the minimum height). b) While she holds her finger in this zoom out space the virtual information space scales down until it eventually reaches the size of the touch screen (with a rate corresponding to the height of the finger). c) The user points her finger in the zoom in space (between the minimum height and halfway up to the maximum height). c) While she holds her finger in this zoom in space the virtual information space scales up until it eventually reaches 1:1 scale (with a rate corresponding to the height of the finger). Target selection happens through touch on the touch screen.

show abstract

Evaluating Text Entry in Virtual Reality using a Touch-sensitive Physical Keyboard

Cited by 16 publications

References 33 publications

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Extended Reality for Knowledge Work in Everyday Environments

Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality

Contact Info

Product

Resources

About