Text Entry in Virtual Environments using Speech and a Midair Keyboard

Adhikary, Jiban; Vertanen, Keith

doi:10.1109/tvcg.2021.3067776

Cited by 28 publications

(14 citation statements)

References 52 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, it may not be suitable if a complete sentence or paragraph has already been entered. Previous work has shown that text revision techniques can significantly improve text entry and error rates [1]. Likewise, research also showed that users spend a significant amount of time revising text [16].…”

Section: Text Revisionmentioning

confidence: 95%

“…Virtual keyboards often adopt the physical keyboard layouts [17] to take advantage of prior knowledge and minimize the effort of learning. The most prominent keyboard layouts used in evaluations of virtual keyboards are QWERTY [1,2,8,76] and QWERTZ [74,84]. While most researchers predefined the target layout, others let the participant decide [84].…”

Section: Keyboard Layoutsmentioning

confidence: 99%

“…Virtual keyboards include at least letters from A-Z. Capitalization and punctuation are often not considered [1,21,76,84], because researchers compared pure text input, rather than focusing on real-world usability. Dube and Arif [18] investigated different key dimensions and shapes on a virtual keyboard.…”

Section: Keyboard Layoutsmentioning

confidence: 99%

See 2 more Smart Citations

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Kern¹,

Niebling

Latoschik³

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Fig. 1: The virtual keyboard layout is based on the traditional layout of physical keyboards. (A) Shows the tap keyboard in video see-through augmented reality (VST AR) and (B) the swipe keyboard in virtual reality (VR) with a black tail following the user's controller. For the VR condition, we created an accurate digital twin of the real physical room. In the VST AR condition, the real world was captured by the video see-through capabilities of the XR device. To enable precise interaction, the user holds the controller upside down in a pen-like posture and presses/swipes the virtual keyboard keys with the bottom tip of the controller. Three word suggestions are displayed in the upper left. The arrow keys to move the cursor and the backspace key are located in the upper right. The cursor can also be positioned directly in the input field. The shift keys and the space bar are hidden on the swipe keyboard because they are not required for text entry. Rectangular 3D keys provide visual feedback, and when pressed, the controllers vibrate.

show abstract

Section: Text Revisionmentioning

confidence: 95%

Section: Keyboard Layoutsmentioning

confidence: 99%

See 1 more Smart Citation

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Kern¹,

Niebling

Latoschik³

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…For instance, employing a virtual keyboard is not optimal, and alternatives should be sought to improve the overall satisfaction of course authors in these tasks. For typing that must occur within the virtual environment, optimizations might include voice recognition, automatic text completion suggestions, as well as exploring several novel methods being introduced by other researchers [56]. We envision furthering that by increasing interoperability of immersive authoring with traditional web-based learning management systems.…”

Section: Discussionmentioning

confidence: 99%

Design and Evaluation of a Choreography-Based Virtual Reality Authoring Tool for Experiential Learning in Industrial Training

Cassola

Mendes

Pinto

et al. 2022

IEEE Trans. Learning Technol.

View full text Add to dashboard Cite

The use of virtual reality (VR) for industrial training helps minimize risks and costs by allowing more frequent and varied use of experiential learning activities, leading to active and improved learning. However, creating VR training experiences is costly and time-consuming, requiring software development experts. Additionally, current authoring tools lack integration with existing data and are desktop-oriented, which detach the pedagogic process of creating the immersive experience from experiencing it in a situated context. In this article, we present a novel interactive approach for immersive authoring of VR-based experiential training by the trainers themselves, from inside the virtual environment and without the support of development experts. The design includes identifying interactable elements, such as 3-D models, equipment, tools, settings, and environment. The trainer also specifies by demonstration the actions to be performed by trainees, as a virtual choreography. During course execution, trainees' activities are also registered as virtual choreographies and matched to those specified by the trainer. Thus, trainer and trainee are culturally situated within their area semantics and social discourse, rather than adopting concepts of the VR system for the learning content. We conducted a usability case study with professionals from an international wind energy company, using detailed models of wind turbines and real-world procedures. Trainers set up a training course using the immersive authoring tool, and trainees executed the course. The learning experience and usability were analyzed, and the training was certified by comparing real-world task completion between a user who had undergone virtual training and a user who did not.

show abstract

“…Ainda, tais técnicas podem não ser precisas em reconhecer siglas e palavras novas ou em outros idiomas. Por fim, uma grande limitação de técnicas de entrada de texto baseadas em reconhecimento de voz é a dificuldade para corrigir ou editar textos (GRUBERT et al, 2018;ADHIKARY;VERTANEN, 2021). Dada a contextualização, entende-se como uma oportunidade de investigação identificar técnicas alternativas para entrada de texto, em sistemas de RV, focadas em possibilitar um bom desempenho (velocidade de digitação) e experiência do usuário positiva às Pessoas com Deficiências (PcDs) em membros superiores.…”

Section: Introductionunclassified

Técnicas de entrada de texto em sistemas de realidade virtual que visam a inclusão de pessoas com deficiência em membros superiores: uma revisão sistemática

PALMEIRA¹,

NETO²,

CINELLI³

2022

Blucher Design Proceedings

View full text Add to dashboard Cite

Text Entry in Virtual Environments using Speech and a Midair Keyboard

Cited by 28 publications

References 52 publications

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Design and Evaluation of a Choreography-Based Virtual Reality Authoring Tool for Experiential Learning in Industrial Training

Técnicas de entrada de texto em sistemas de realidade virtual que visam a inclusão de pessoas com deficiência em membros superiores: uma revisão sistemática

Contact Info

Product

Resources

About