In this paper, we present an architecture that demonstrates multimodal fusion and fission using semantic agents and web services that interacts with worldwide-web computers, services and users. This solution extracts the meaning of a situation using the semantic memory of agents to manage the interaction process involved. The fusion of values from different sensors produces an event that needs implementation. The fission process suggests a detailed set of actions that are for implementation. Before such actions are implemented by actuators, these actions are first evaluated in a virtual environment which mimics the real-world environment. If no danger arises from such virtual evaluation, then implementation is feasible. Otherwise, there might be a need to add one or more smaller actions to render the action safe and free from danger. Our work presents the following contributions: (i) a design of agent memory and a model of the world environment using a knowledge representation language that is compatible with the current standards, (ii) creation of a pervasive architecture with several scenarios of composition and adaptation, (iii) presentation of how agents and services interact to provide support in a real-world, and (iv) simulation of an event in a virtual environment to assess the feasibility of the event's implementation.
Since 1960, AI researchers have worked on intelligent and reactive architectures capable of managing multiple events and acts in the environment. This issue is part of the Robotics domain. An extraction of meaning at different levels of abstraction and the decision process must be implemented in the robot brain to accomplish the multimodal interaction with humans in a human environment. This paper presents a semantic agents architecture giving the robot the ability to understand what is happening and thus provide more robust responses. Intelligence and knowledge about objects like behaviours in the environment are stored in two ontologies linked to an inference engine. To store and exchange information, an event knowledge representation language is used by semantic agents. This architecture brings other advantages: pervasive, cooperating, redundant, automatically adaptable, and interoperable. It is independent of platforms.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.