Designing and implementing service framework for virtual agents in home network system

Abstract

In order to achieve intuitive and easy operations for home network system (HNS), we have previously proposed user interface with virtual agent (called HNS virtual agent user interface, HNS-VAUI). The HNS-VAUI was implemented with MMDAgent toolkit. A user can operate appliances and services interactively through dialog with a virtual agent in a screen. However, the previous prototype heavily depends on MMDAgent, which causes a tight coupling between HNS operations and agent behaviors, and poor capability of using external information.To cope with the problem, this paper proposes a serviceoriented framework that allows the HNS-VAUI to provide richer interaction. Specifically, we decompose the tightly-coupled system into two separate services: MMC Service and MSM service. The MMC service concentrates on controlling detailed behaviors of a virtual agent, whereas the MSM service defines logic of HNS operations and dialog with the agent with richer state machines. The two services are loosely coupled to enable more flexible and sophisticated dialog in the HNS-VAUI. The proposed framework is implemented in a real HNS environment. We also conduct a case study with practical service scenarios, to demonstrate effectiveness of the proposed framework.

Designing an Elderly Virtual Caregiver Using Dialogue Agents and WebRTC

“…In our previous research, to assist the elderly in daily dialogue and aid memory, we have been studying the concept of a dialogue agent as a virtual caregiver for the elderly in smart homes [9] [10], and have been designing architecture [11] [12], agent appearance [13] [14], dialogue scenarios [15] [16], and extended microservices [17]. A dialogue agent is a system that interacts with humans in the form of a dialogue using a machine as an intermediary.…”

VirtualCareGiver

“…Yasuda, Fuketa, and Aoe (2014) developed a system where a VA serves as a conversation partner of people with dementia. Our research group has also developed a system which exploits a VA as a user interface of the home network system (called HNS) (Horiuchi, Saiki, Matsumoto et al, 2014). When a user says "Turn on a TV", the system interprets the voice as a command TV.on().…”

Set Theory-based FSM for Managing Home Emergencies Concept, Properties and Process Algebra

“…Other works based on FSM and directly related to enhance home healthcare services have also been proposed in the literature. In [13], a user interface based on virtual agent is proposed to permit inhabitants to operate home appliances and services. In [14] [15], a system is developed to classify the activities of the daily life.…”