Toward a Needs-Based Architecture for ‘Intelligent’ Communicative Agents: Speaking with Intention

Abstract

The past few years have seen considerable progress in the deployment of voice-enabled personal assistants, first on smartphones (such as Apple's Siri) and most recently as standalone devices in people's homes (such as Amazon's Alexa). Such 'intelligent' communicative agents are distinguished from the previous generation of speech-based systems in that they claim to offer access to services and information via conversational interaction (rather than simple voice commands). In reality, conversations with such agents have limited depth and, after initial enthusiasm, users typically revert to more traditional ways of getting things done. It is argued here that one source of the problem is that the standard architecture for a contemporary spoken language interface fails to capture the fundamental teleological properties of human spoken language. As a consequence, users have difficulty engaging with such systems, primarily due to a gross mismatch in intentional priors. This paper presents an alternative needs-driven cognitive architecture which models speech-based interaction as an emergent property of coupled hierarchical feedback-control processes in which a speaker has in mind the needs of a listener and a listener has in mind the intentions of a speaker. The implications of this architecture for future spoken language systems are illustrated using results from a new type of 'intentional speech synthesiser' that is capable of optimising its pronunciation in unpredictable acoustic environments as a function of its perceived communicative success. It is concluded that such purposeful behavior is essential to the facilitation of meaningful and productive spoken language interaction between human beings and autonomous social agents (such as robots). However, it is also noted that persistent mismatched priors may ultimately impose a fundamental limit on the effectiveness of speech-based human-robot interaction.

Voicing Suggestions and Enabling Reflection: Results of an Expert Discussion on Proactive Assistants for Time Management

“…He maintained that only then the dialogue can be coherent to the user and illustrated the argument by proclaiming that a speech-enabled robot that is still too limited to provide a human-level dialogue flexibility should have a robot voice. Similarly, Moore and Nicolao [18] proposed a needs-based architecture that would help mitigate the limited depth of communications capabilities IPAs currently possess, while Viswanathan et al [24] presented a WoZ IPA prototype that mimics interaction principles of graphical interfaces.…”

Whither the Priors for (Vocal) Interactivity?

“…interaction is viewed as being based on the co-evolution of two key traits -ostensive-inferential communication and recursive mind-reading [14], then contemporary voice-based systems are essentially only dealing with one aspect -inferenceand while some of the high-level issues relating to recursive mind-reading are being addressed [15], we lack a theoretical framework relating to user engagement and interaction that would inform the implementation of practical mechanisms to handle not just what to say, but crucially when to say it and, in a group context, to whom.…”

Zur Adressierung des Unbelebten - Grenzen von pragmatischer Konzeption

“…Schon der Analogieschluss vom quantitativen Anstieg der Rechenleistung in einem binären System auf Künstliche Intelligenz, deren qualitative Parameter noch völlig unklar sind, ist angreifbar (vgl. Lotze 2018, Moore & Nikolao 2017.…”