A reliable non-verbal vocal input metaphor for clicking

Zielasko, Daniel; Neha, Neha; Weyers, Benjamin; Kuhlen, Torsten

doi:10.1109/3dui.2017.7893316

Cited by 19 publications

(15 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Alternatively, the voice can also be used for text input, as in [84,98], allowing the users to input text by speaking the words. Lastly, there are a few studies that make use of non-verbal actions to issue commands to the VR systems, detecting when the user "blows" to confirm a selection (e.g., [120]).…”

Section: Interaction Interfacesmentioning

confidence: 99%

“…The nature of these two interfaces makes them good candidates for this task as it is natural and easy to point at things with the eyes/head. For the confirmation task alone, only the use of the voice was found in the literature with a non-verbal "blow" action [119,120] used for confirming the selection of an object being targeted with a Manipulation 5 [11,25,45,63,90] Modification 5 [11,15,30,45,56] Creation 3 [45,90,117] N/A 4 [1,36,94,100] controller.…”

Section: Interaction Tasksmentioning

confidence: 99%

See 1 more Smart Citation

Hands-free interaction in immersive virtual reality: A systematic review

Monteiro

Gonçalves

Coelho

et al. 2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 80 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.

show abstract

Section: Interaction Interfacesmentioning

confidence: 99%

Section: Interaction Tasksmentioning

confidence: 99%

Hands-free interaction in immersive virtual reality: A systematic review

Monteiro

Gonçalves

Coelho

et al. 2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…The disadvantage of this approach is that it requires a fixed placement of the microphone and it has considerable limitations in terms of usage scenarios and usage methods. Zielasko et al presented an alternative trigger approach for hands-free interaction scenarios to precisely trigger events by blowing into a microphone [45]. When the blowing value exceeds a given threshold, the event is triggered; otherwise, the event is not triggered.…”

Section: A Breathing or Blowing Interactionmentioning

confidence: 99%

“…In addition to simply detecting sound intensity to correspond to simple interactions [16], [45], there are other works that identified different breathing actions through more accurate and complex recognition algorithms.…”

Section: B Recognition Algorithmmentioning

confidence: 99%

“…To date, some works have studied breathing or blowing air as a direct input modality in proper detail. Depending on whether special detection equipment is needed to obtain the breathing signal, the methods for detecting breathing can be divided into two categories: methods based on special detection equipment and methods based on common microphones [30], [45]. For the first category, one method based on special detection equipment is to obtain breath signals by detecting chest or abdominal movements [8], [38], and the other is to obtain breathing signals by placing special devices in the mouth that directly detect the airflow of breathing [11], [31].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Adaptive Blowing Interaction Method Based on a Siamese Network

et al. 2020

View full text Add to dashboard Cite

Breathing is a natural and directly controllable human activity. Currently, some works have considered breath as a direct input controlling mechanism. The equipment relied upon in these works is generally complicated, expensive, inconvenient to wear, and sometimes insufficiently controllable. The use of breathing interaction is also limited to a certain scene and is not universal. This paper proposes an adaptive interaction method, which is a natural and directly controllable interaction based on blowing air that only uses headset microphones to obtain the sound waveform of the blowing action without requiring expensive equipment, and that can be used conveniently anytime and anywhere. This blowing interaction uses a Siamese network to achieve "self-adaptation"-the first step adapts to noise interference, including environmental noise and the user's own speaking interference, and the second step adapts to different users and equipment, that is, the blowing interaction is used by different people or on different equipment, and the interaction mode can accurately identify the type of blowing. This paper also develops several applications of the blowing interaction method to test the algorithm. During tests, it's proved that this interface not only increases the type of blowing used for interaction but also eliminates interference from speaking in a normal volume effectively and addresses the problem of individual differences.

show abstract