Integración de Fuentes con Información de Contexto y Sistemas Interactivos

Abstract

In this Thesis, we have addressed the difficulties related to the development of context-aware human-machine interaction systems. This issue is part of two research fields: interactive systems and contextual information sources. Traditionally both fields have been integrated through domain-specific vertical solutions that allow interactive systems to access contextual information without having to deal with low-level procedures, but restricting their interoperability with other applications and heterogeneous data sources. Thus, it is essential to boost the research on interoperable solutions that provide access to real world information through homogeneous procedures.This issue perfectly matches with the scenarios of "Ubiquitous Computing" and "Internet of Things", which point toward a future in which many objects around us will be able to acquire meaningful information about the environment and communicate it to other objects and to people. Since interactive systems are able to get information from their environment through interaction with the user, they can play an important role in this scenario as they can both consume real-world data and produce enriched information. This Thesis deals with the integration of both fields considering this technological scenario. In order to do this, we first carried out an analysis of the most important initiatives for the definition and design of interactive systems, and the main infrastructures for providing information. Through this study the use of the W3C SCXML language is proposed for both the design of interactive systems and the processing of data provided by different context sources. Thus, this work has shown how the SCXML capabilities for combining information from different modalities can also be used to process and integrate contextual information from different heterogeneous sensor sources, and therefore to develope context-aware interaction systems. Similarly, we present the Sensor Web initiative, and its semantic extension Semantic Sensor Web, as an appropriate initiative to allow uniform access and delivery of information to the context-aware interactive systems.Subsequently we have analyzed the challenges of integrating both types of initiatives: SCXML and (Semantic) Sensor Web. As a result, we state a number of functionalities that are necessary to implement in order to perform this integration. By using technologies that provide flexibility to the implementation process and are based on current recommendations and standards, we implemented a series of experimental developments that integrate the identified functionalities.xiii Finally, in order to validate our approach, we conducted different experiments with a testing environment simulating a driving scenario. In this framework an interactive system can access a semantic extension of a Telco plataform, based on the standards of the Sensor Web, to acquire contextual information and publish observations that the user performed to the system.The results showed the feasibility of using the SCXML language for ...

User experience in human-technology interaction. Communication, context and evaluation methodology.

“…No such details are discussed here. The idea of developing HMI systems that function as prosumers of information, consuming (accessing, combining and reasoning with) local and remote sensor data, and in turn producing information generally of a higher conceptual (semantic) order for which it can be regarded as a sensor, for third parties to use, has been explored elsewhere (Sigüenza et al, 2012;Sigüenza Izquierdo, 2013), and it will receive no more than a passing mention in the present Thesis. The focus of this Thesis, as sketched in the introduction, is both on technological aspects of information handling -potentially from various different sources-within interaction manag rs, an on th valuation of th int raction an th us rs' xp ri nc with th syst m.…”

“…In this section we give a brief overview of the main properties of statecharts. A more detailed treatment of SCXML statecharts can be found in Barnett et al (2012) andSigüenza Izquierdo (2013), and of statecharts in general in the abovementioned original proposal by Harel.…”