Dialog Modeling for Multiple Devices and Multiple Interaction Modalities

Schaefer, Robbie; Bleul, Steffen; Mueller, Wolfgang

doi:10.1007/978-3-540-70816-2_4

Cited by 7 publications

(3 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We have shown that our approach implementing the dialogue Model as presented in [5] into the rendering Architecture [42] effectively allows different devices to control one application simultaneously, while there are still open issues with respect to the synchronization of multiple modalities.…”

Section: Device Multiplicitymentioning

confidence: 99%

See 1 more Smart Citation

Assessment of a multimodal interaction and rendering system against established design principles

Schaefer

Mueller

2008

J Multimodal User Interfaces

Self Cite

View full text Add to dashboard Cite

To provide user interfaces for a rich set of devices and interaction modalities, we follow a model-based development methodology. We devised an architecture which deploys user interfaces specified as dialogue models with abstract interaction objects and allows context-based adaptations by means of an external transcoding process. For the validation of the applicability of this methodology for developing usable multimodal multi-device systems, we present two case studies based on proof-of-concept implementations and assessed them with a large set of established design principles and different types of modality cooperation.

show abstract

Section: Device Multiplicitymentioning

confidence: 99%

“…The latest incarnation of this architecture has been presented in [5]. As a first step we have implemented a client-server-based architecture with transformation tools and an abstract user interface renderer for a Java2 Micro Edition enabled mobile phone (see [6]).…”

Section: Architectural Overviewmentioning

confidence: 99%

Assessment of a multimodal interaction and rendering system against established design principles

Schaefer

Mueller

2008

J Multimodal User Interfaces

Self Cite

View full text Add to dashboard Cite

show abstract

“…A transformational approach in multiple steps is also used in Teresa XML by Paterno et al [8]. DISL [9] was created as a language for specifying a dialogue model which separates multimodal interaction and presentation components from the control model. Finally, NiMMiT [10] is a high-level graphical modelling notation associated with a language used to express and evaluate multimodal user interaction as state transitions.…”

Section: Multimodal Dialogue Description Languagesmentioning

confidence: 99%

A graphical editor for the SMUIML multimodal user interaction description language

Dumas

Signer

Lalanne

2014

Science of Computer Programming

View full text Add to dashboard Cite

We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centered nature of SMUIML, the multimodal dialogue modelling is represented by a state machine in the graphical SMUIML dialogue editor. Our editor further offers a real-time graphical debugging tool. Compared to existing multimodal dialogue editing solutions, the SMUIML graphical editor offers synchronised dual editing in graphical and textual form as well as a number of operators for the temporal combination of modalities. The presented graphical editor represents the third component of a triad of tools for the development of multimodal user interfaces, consisting of an XML-based modelling language, a framework for the authoring of multimodal interfaces and a graphical editor.

show abstract

Design of Robot Teaching Assistants Through Multi-modal Human-Robot Interactions

Ferrarelli

Lázaro

Iocchi

2017

Robotics in Education

View full text Add to dashboard Cite

Dialog Modeling for Multiple Devices and Multiple Interaction Modalities

Cited by 7 publications

References 11 publications

Assessment of a multimodal interaction and rendering system against established design principles

Assessment of a multimodal interaction and rendering system against established design principles

A graphical editor for the SMUIML multimodal user interaction description language

Design of Robot Teaching Assistants Through Multi-modal Human-Robot Interactions

Contact Info

Product

Resources

About