Evaluation and usability of multimodal spoken language dialogue systems

Dybkjær, Laila; Bernsen, Niels Ole; Minker, Wolfgang

doi:10.1016/j.specom.2004.02.001

Cited by 92 publications

(72 citation statements)

References 40 publications

(23 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Much effort is also spent on minimising the cost of evaluation, for example by designing evaluation methods that will generalise over systems and that may be re-used (e.g. Dybkjaer et al, 2004;Walker et al, 2000; see also Möller et al, 2007 for an overview); by automating the evaluations (e.g. Bechet et al, 2004;; or by utilising simulations instead of users in order make low cost repeat studies (e.g.…”

Section: Introductionmentioning

confidence: 99%

Towards human-like spoken dialogue systems

Edlund¹,

Gustafson²,

Heldner³

et al. 2008

Speech Communication

105

View full text Add to dashboard Cite

show abstract

Section: Introductionmentioning

confidence: 99%

Towards human-like spoken dialogue systems

Edlund¹,

Gustafson²,

Heldner³

et al. 2008

Speech Communication

105

View full text Add to dashboard Cite

show abstract

“…This field can be considered to be in an initial phase of development. PARADISE (PARAdigm for DIalogue Evaluation System) is the most widely proposed methodology to perform a global evaluation of a dialog system (Walker et al, 1998) (Dybkjaer et al, 2004). This methodology combines different measures regarding task success, dialog efficiency and dialog quality in a single function that measures the yield of the system in direct correlation with user satisfaction.…”

Section: Related Work Evaluation Of Dialog Systemsmentioning

confidence: 99%

A statistical approach to spoken dialog systems design and evaluation

Griol

Hurtado

Segarra

et al. 2008

Speech Communication

100

View full text Add to dashboard Cite

“…These aspects can be used as the basis for usability evaluation strategies. Many frameworks and methodologies have been developed and used for evaluation of spoken dialogue systems in recent works [8,9,13,15,17,18,21,24,30].…”

Section: 12mentioning

confidence: 99%

Spoken Dialogue Interfaces: Integrating Usability

Spiliotopoulos

Stavropoulou

2009

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. Usability is a fundamental requirement for natural language interfaces. Usability evaluation reflects the impact of the interface and the acceptance from the users. This work examines the potential of usability evaluation in terms of issues and methodologies for spoken dialogue interfaces along with the appropriate designer-needs analysis. It unfolds the perspective to the usability integration in the spoken language interface design lifecycle and provides a framework description for creating and testing usable content and applications for conversational interfaces. Main concerns include the problem identification of design issues for usability design and evaluation, the use of customer experience for the design of voice interfaces and dialogue, and the problems that arise from real-life deployment. Moreover it presents a real-life paradigm of a hands-on approach for applying usability methodologies in a spoken dialogue application environment to compare against a DTMF approach. Finally, the scope and interpretation of results from both the designer and the user standpoint of usability evaluation are discussed.

show abstract

Evaluation and usability of multimodal spoken language dialogue systems

Cited by 92 publications

References 40 publications

Towards human-like spoken dialogue systems

Towards human-like spoken dialogue systems

A statistical approach to spoken dialog systems design and evaluation

Spoken Dialogue Interfaces: Integrating Usability

Contact Info

Product

Resources

About