PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches

Fashimpaur, Jacqui; Kin, Kenrick; Longest, Matt

doi:10.1145/3334480.3382888

Cited by 47 publications

(11 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As advocated by Wigdor and Wixon [213], touch-based and gestural interactions are proliferating, and eventually serve as the primary interaction approaches between humans and computers more than the desktop metaphor, namely the post-Windows, Icons, Menus, Pointers (WIMP) paradigm [106]. We observe a smaller and smaller degree of user movements for gestural inputs [52], in descending order, from the whole body [188], upper body gestures [216], arm gestures [74,133], palm gestures [51], finger gestures [84], to a minimal of fingertip movements [129]. For example, the daily text entry scenarios for mobile augmented reality (MAR) utilize a smaller interaction space in mid-air, reducing from a square of standard QWERTY keyboard to a horizontal space of 1-line non-standard keyboard [133].…”

Section: The Frontier Of Interaction Design With Extended Realities (Ar/mr/vr)mentioning

confidence: 85%

Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey

Shatilov

Chatzopoulos

Lee

et al. 2021

ACM Trans. Interact. Intell. Syst.

View full text Add to dashboard Cite

Incremental and quantitative improvements of two-way interactions with e x tended realities (XR) are contributing toward a qualitative leap into a state of XR ecosystems being efficient, user-friendly, and widely adopted. However, there are multiple barriers on the way toward the omnipresence of XR; among them are the following: computational and power limitations of portable hardware, social acceptance of novel interaction protocols, and usability and efficiency of interfaces. In this article, we overview and analyse novel natural user interfaces based on sensing electrical bio-signals that can be leveraged to tackle the challenges of XR input interactions. Electroencephalography-based brain-machine interfaces that enable thought-only hands-free interaction, myoelectric input methods that track body gestures employing electromyography, and gaze-tracking electrooculography input interfaces are the examples of electrical bio-signal sensing technologies united under a collective concept of ExG. ExG signal acquisition modalities provide a way to interact with computing systems using natural intuitive actions enriching interactions with XR. This survey will provide a bottom-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) ExG hardware solutions, (iii) ExG-enabled applications, (iv) discussion on social acceptance of such applications and technologies, as well as (v) research challenges, application directions, and open problems; evidencing the benefits that ExG-based Natural User Interfaces inputs can introduce to the area of XR.

show abstract

Section: The Frontier Of Interaction Design With Extended Realities (Ar/mr/vr)mentioning

confidence: 85%

Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey

Shatilov

Chatzopoulos

Lee

et al. 2021

ACM Trans. Interact. Intell. Syst.

View full text Add to dashboard Cite

show abstract

“…Namely: Controller Drumming, Freehand Typing, and Pinch Typing. Previous research compared these inputs with other existing methods and showed comparable performances and usability which makes them the best candidates for low-burdening text input for free-text responses in VR user studies [6,8,28]. To provide a sound comparability, all input methods were operating on the same virtual keyboard.…”

Section: Evaluating Suitable Vr Text Input Methodsmentioning

confidence: 99%

Towards Low-burden Responses to Open Questions in VR

Alexandrovsky¹,

Putze²,

Schülke³

et al. 2021

Preprint

View full text Add to dashboard Cite

Subjective self-reports in VR user studies is a burdening and often tedious task for the participants. To minimize the disruption with the ongoing experience VR research has started to administer the surveying directly inside the virtual environments. However, due to the tedious nature of text-entry in VR, most VR surveying tools focus on closed questions with predetermined responses, while open questions with free-text responses remain unexplored. This neglects a crucial part of UX research. To provide guidance on suitable self-reporting methods for open questions in VR user studies, this position paper presents a comparative study with three text-entry methods in VR and outlines future directions towards low-burden qualitative responding. CCS CONCEPTS• Human-centered computing → HCI theory, concepts and models; Empirical studies in HCI.

show abstract

“…BlueTap [13]) or between the thumb and fingertips (e.g. Pinch Keyboard [9] and PinchType [18]) to select characters. Pinch Keyboard is particularly worth noting for this project because it uses a rotation gesture of the user's wrist to select a set of characters followed by pinching a digit to their thumb to select one of four characters in the set.…”

Section: Gesture and Controller Vr/ar Text Inputmentioning

confidence: 99%

Arc-Type and Tilt-Type: Pen-based Immersive Text Input for Room-Scale VR

Jackson

Caraco

Spilka

2020

Symposium on Spatial User Interaction

View full text Add to dashboard Cite

Figure 1: Left: A user manipulates a pen-shaped stylus to enter text in a virtual reality CAVE, where traditional keyboard interaction limits mobility. Center: The Tilt-Type interface uses small finger motions to tilt the stylus along two axes, changing the selected character in a binned layout. Right: The Arc-Type interface uses a rotational gesture and interactions with a touch slider to select characters from a radial layout.

show abstract

PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches

Cited by 47 publications

References 15 publications

Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey

Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey

Towards Low-burden Responses to Open Questions in VR

Arc-Type and Tilt-Type: Pen-based Immersive Text Input for Room-Scale VR

Contact Info

Product

Resources

About