A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment

Wu, Caicong; Hsu, Chih-Wen; Lee, Tzu-Kuei; Smith, Shana

doi:10.1007/s10055-016-0296-6

Cited by 69 publications

(23 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Wearable virtual keyboards [14]- [18] are installed with various sensors on the hands or fingers to detect their gestures and motion, which can be matched with the motions of typing different keys. The ''data glove'' [18]- [22], integrating sensors, is a common example. Through detecting finger gestures, it can be applied as a keyboard, a mouse, or other interactive devices.…”

Section: B Wearable Virtual Keyboardsmentioning

confidence: 99%

Wireless IoT Motion-Recognition Rings and a Paper Keyboard

et al. 2019

View full text Add to dashboard Cite

In this paper, we present a new scheme for implementing virtual keyboards, which uses only two to four motion-recognition rings per hand and a two-dimensional keyboard template (e.g., an A4 size paper with printed key positions). It has the benefit of portability, customizability, and low-cost when compared with existing approaches. Essentially, we have shown that wearing two wireless IoT rings on the middle phalanges of two fingers of each hand, users can input the alphabetic characters into a computing device by typing on a flat paper on a desk, and potentially in mid-air. We have demonstrated that two rings are sufficient in capturing the gestures and motions of all fingers in a typing hand for keystrokes recognition. A single wireless IoT ring, which weighs 7.8 grams, consists of a Bluetooth low energy (BLE) unit, a micro inertial measurement unit (mIMU), and a cell battery. The 3-axes attitude angles and the Z-axis acceleration of each ring are adopted as the features for keystroke recognition. The overall keystroke recognition accuracy rate can reach as high as 94.8% when two IoT rings are worn by a user on each hand; this accuracy rate increases to 98.6%, when four rings are worn on each typing hand. INDEX TERMS Wearable sensors, wireless IoT ring, keystroke recognition, virtual keyboard, micro IMU.

show abstract

Section: B Wearable Virtual Keyboardsmentioning

confidence: 99%

Wireless IoT Motion-Recognition Rings and a Paper Keyboard

et al. 2019

View full text Add to dashboard Cite

show abstract

“…The next research [18] that provides valuable cues while designing an AR system for traders presents the use of novel 3D virtual reality keyboard system with realistic haptic feedback. The presented method uses two five-fingered hand data to track finger positions and postures.…”

Section: Related Workmentioning

confidence: 99%

Visualizing Financial Stock Data withinan Augmented Reality Trading Environment

Rumiński¹,

Maik²,

Walczak³

2019

ACTA POLYTECH HUNG

View full text Add to dashboard Cite

In this paper, we present a novel augmented reality (AR) system for visualization of financial stock data. The system enhances the equity traders' working environment with virtual charts and live business TV streams, overlaid onto the real trading workspace. The presented research investigates how human cognitive capabilities can be extended by the use of artificial computer-generated 3D representation of financial data and interaction with such data representation using hand gestures. We combined the nVisor ST50 headset with InteriaCube4 and Leap Motion devices to enable tracking of head orientation and controlling the AR environment with hands. With the use of hand gestures, a user is able to create virtual charts displaying real-time stock data and financial TV streams within his/her surroundings. To evaluate the system, we conducted experimental tests with 22 users. Our objective was to evaluate tasks completion times and users' experience while creating and parametrizing virtual stock charts through the AR interface. The obtained results are promising and demonstrate that most users were able to finish tasks in acceptable time without significant difficulties.

show abstract

“…In the spatial drawing process, a user draws a line and a surface using a handtracking device. The hand-tracking module acquires the position and orientation data from HMD controllers and the hand joints or fingertips of the hand-tracking device, e.g., Leap Motion [5]. The head-tracking module tracks the movement of the HMD and the 3D visualization module updates the virtual environment in real time based on the head-tracking module [6].…”

Section: Spatial Drawing Framework Designmentioning

confidence: 99%

A Study on a Drawing Tool of a Spatial Drawing Application in Virtual Reality

Ko¹,

Suh

2018

IJMUE

View full text Add to dashboard Cite

A system for spatial drawing must have a display device that shows stereoscopic images to the user, a controller serving as a brush for drawing, and a function that creates a line and a curved surface and visualizes the virtual space. Herein, a software framework was designed for spatial drawing by analyzing the functions for spatial drawing applications in a virtual environment based on existing studies and produced a virtual reality spatial drawing application with virtual drawing tools. The application employed a traditional painting metaphor. Furthermore, a brush module and a palette module were designed for the spatial drawing interface and linked to the line and surface generator modules to change drawing attributes, e.g., color and texture.

show abstract

A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment

Cited by 69 publications

References 15 publications

Wireless IoT Motion-Recognition Rings and a Paper Keyboard

Wireless IoT Motion-Recognition Rings and a Paper Keyboard

Visualizing Financial Stock Data withinan Augmented Reality Trading Environment

A Study on a Drawing Tool of a Spatial Drawing Application in Virtual Reality

Contact Info

Product

Resources

About