Sensor Information Fusion by Integrated AI to Control Public Emotion in a Cyber-Physical Environment

Abstract

The cyber-physical system (CPS) is a next-generation smart system that combines computing with physical space. It has been applied in various fields because the uncertainty of the physical world can be ideally controlled using cyber technology. In terms of environmental control, studies have been conducted to enhance the effectiveness of the service by inducing ideal emotions in the service space. This paper proposes a CPS control system for inducing emotion based on multiple sensors. The CPS can expand the constrained environmental sensors of the physical space variously by combining the virtual space with the physical space. The cyber space is constructed in a Unity 3D space that can be experienced through virtual reality devices. We collect the temperature, humidity, dust concentration, and current emotion in the physical space as an environmental control elements, and the control illumination, color temperature, video, sound and volume in the cyber space. The proposed system consists of an emotion prediction module using modular Bayesian networks and an optimal stimulus decision module for deriving the predicted emotion to the target emotion based on utility theory and reinforcement learning. To verify the system, the performance is evaluated using the data collected from real situations.

Augmented Reality-Assisted Deep Reinforcement Learning-Based Model towards Industrial Training and Maintenance for NanoDrop Spectrophotometer

“…Many studies have been conducted on enhancing the service experience by providing ideal feedback. The cyber-physical system (CPS) proposed by Choi et al [25] can be used with various sensors to create an interactive environment.…”

Virtual Simulation of the Effect of FMCW Laser Fuse Detector’s Component Performance Variability on Target Echo Characteristics under Smoke Interference

“…The root cause for the above problem is that the traditional simulation method can only perform low-dimensional and superficial characterization of photon transport simulation in smoke, and it is not efficient to achieve simultaneous cosimulation of multiple systems among the smoke system, laser transmitting system, and laser receiving system. In order to solve this problem, it is possible to integrate the advantages of virtual reality technology and traditional simulation methods with each other based on the validity and reliability of deep simulation with particle systems in a virtual reality approach [20,21]. As a result, based on laser detection and Monte-Carlo principles, the three-dimensional dynamic and virtual simulation model that meets the requirements of simultaneous multisystem cosimulation can be built using a professional and virtual particle system, such as in Unity3D [22].…”

AI-Based Sensor Information Fusion for Supporting Deep Supervised Learning

“…As another example, sensors on the global navigation satellite system (GNSS) [32]—such as the Global Positioning System (GPS) [33], GLONASS, Gaillieo and Beidou (which are originated in the USA, Russia, the EU and China, respectively), as well as other regional systems—have also created large volumes of geolocation and time information. With big sensory data from these sources and other sensors, sensor information fusion [34,35,36,37]—which integrates sensor data and information from a collection of these heterogeneous or homogeneous sensors to produce accurate, consistent and useful knowledge—is in demand.…”