Building Multimodal Dialogue Applications: System Integration in SmartKom

Herzog, Gerd; Ndiaye, Alassane

doi:10.1007/3-540-36678-4_28

Cited by 3 publications

(3 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Compared to the Verbmobil version, several major changes have been made concerning both implementation and classification models. Since the SMARTKOM system provides a different approach for module communication (Herzog and Ndiaye, 2006), the module interface has been fully reimplemented. The classification core remains essentially the same, except for some minor changes, which increase the stability and performance of the module.…”

Section: Module Descriptionmentioning

confidence: 99%

See 1 more Smart Citation

The Prosody Module

Zeißler

Adelhardt

Batliner

et al. 2006

SmartKom: Foundations of Multimodal Dialogue Systems

View full text Add to dashboard Cite

In multimodal dialogue systems, several input and output modalities are used for user interaction. The most important modality for human computer interaction is speech. Similar to human human interaction, it is necessary in the human computer interaction that the machine recognizes the spoken word chain in the user's utterance. For better communication with the user it is advantageous to recognize his internal emotional state because it is then possible to adapt the dialogue strategy to the situation in order to reduce, for example, anger or uncertainty of the user.In the following sections we describe first the state of the art in emotion and user state recognition with the help of prosody. The next section describes the prosody module. After that we present the experiments and results for recognition of user states. We summarize our results in the last section.

show abstract

Section: Module Descriptionmentioning

confidence: 99%

“…The SMARTKOM communication system is based on the so-called Pool Communication Architecture (PCA) described in Herzog and Ndiaye (2006). There are several I/O FIFOs called communication pools which run in an asynchronous manner.…”

Section: Executionmentioning

confidence: 99%

The Prosody Module

Zeißler

Adelhardt

Batliner

et al. 2006

SmartKom: Foundations of Multimodal Dialogue Systems

View full text Add to dashboard Cite

show abstract

“…An example page of the English dialogue description included in the log file and can be extracted together with the textual output of the system. The information in the trace file is encoded in M3L [8,6], the XML-based language which is used for data exchange between SmartKom software components. XSLT style sheets (see e.g.…”

Section: From Dialogue Drafts To Dialogue Protocolsmentioning

confidence: 99%

An Exemplary Interaction with SmartKom

Reithinger

Herzog

SmartKom: Foundations of Multimodal Dialogue Systems

Self Cite

View full text Add to dashboard Cite

Summary. The different instantiations of the SmartKom demonstration system offer a broad range of application functions and sophisticated dialogue capabilities. We provide a first look at the final SmartKom prototype from the point of view of the end user. In particular, a typical interaction sequence will be presented in order to illustrate the functionality of the integrated multimodal dialogue system.

show abstract