Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation

Abstract

These reviews of books and other forms of information express the opinions of the individual reviewers and are not necessarily endorsed by the Editorial Board of this Journal.

The Communicative Effectiveness of Education Videos: Towards an Empirically-Motivated Multimodal Account

“…In terms of traditional functional discourse annotations, scaffolding contributions are then PMEs that are "forward-looking", whereas PMEs performing development work are "backward-looking" (cf. [42], 57-59). Since, in the former, scaffolding, case, direct externalized diagrammatic support for discourse interpretation is offered, below, we empirically investigate the hypothesis that this is one condition that may impact on a video's effectiveness.…”

Chatbots for troubleshooting: A survey

“…Moreover, updates will keep triggering successive rules and updates (involving potentially several rules at a time) as long as their preconditions are satisfied. This will give rise to a sequence of actions and updated DS states known as a plan (Boye, ; Gibbon, Mertins, & Moore, ).…”

Designing Mobile Multimodal Artefacts

“…Multimodal interaction provides users with interaction modes, beyond the usual keyboard/mouse for input and visual display for output. Usually, multimodal systems combine different modalities according to the user's characteristics or/and surrounding environments, enabling them to interact with the system adequately according to their situation at a given time (Gibbon, 2000). These systems have only started to be used and seriously researched in the past 15 to 20 years (Oviatt, 2003), as they became more feasible from a technological point of view.…”

“…Multimodalities are particularly well suited for mobile systems given the varying constraints placed on both the user and the surrounding environment (Hurtig, 2006). Adaptability is a key issue on these systems, as users can, in some circumstances, take advantage of a single modality (or a group of modalities) according to their needs (Gibbon, 2000). The use of non-conventional interaction modalities becomes crucial when concerning human-machine interaction for users with special needs (e.g., visually impaired users).…”