Exploring attention mechanism for acoustic-based classification of speech utterances into system-directed and non-system-directed

Norouzian, Atta; Mazoure, Bogdan; Connolly, Dermot; Willett, Daniel

doi:10.48550/arxiv.1902.00570

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ravuri and Stolcke (2015) have explored addressee detection but strictly with lexical and/or speech based modality. More recently, Norouzian et al (2019) have explored sophisticated models for addressee detection based purely on acoustical cues. Frampton et al (2009) have combined gaze and linguistic features to identify the addressee in conversations among groups of humans that involve ambiguous references like "you".…”

Section: Addressee Detectionmentioning

confidence: 99%

You Talkin’ to Me? A Practical Attention-Aware Embodied Agent

Divekar

Kephart

Mou

et al. 2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

Most present-day voice-based assistants require that users utter a wake-up word to signify that they are addressing the assistant. While this may be acceptable for one-shot requests such as "Turn on the lights", it becomes tiresome when one is engaged in an extended interaction with such an assistant. To support the goal of developing low-complexity, low-cost alternatives to a wake-up word, we present the results of two studies in which users engage with an assistant that infers whether it is being addressed from the user's head orientation. In the first experiment, we collected informal user feedback regarding a relatively simple application of head orientation as a substitute for a wake-up word. We discuss that feedback and how it influenced the design of a second prototype assistant designed to correct many of the issues identified in the first experiment. The most promising insight was that users were willing to adapt to the interface, leading us to hypothesize that it would be beneficial to provide visual feedback about the assistant's belief about the user's attentional state. In a second experiment conducted using the improved assistant, we collected more formal user feedback on likability and usability and used it to establish that, with high confidence, head orientation combined with visual feedback is preferable to the traditional wake-up word approach. We describe the visual feedback mechanisms and quantify their usefulness in the second experiment.

show abstract

Section: Addressee Detectionmentioning

confidence: 99%