Integrating IoT Modern Communication Architectures into the New Generation of VR/MR Environments

Abstract

This paper presents how modern IoT communication architectures can be successfully used in building both virtual and mixed reality scenarios. The IoT architecture enables the use of LPWAN technologies with a limited Maximum Transmission Unit for an efficient IoT data provision. Based on the IoT communication architecture, this paper will present two study cases, where IoT data can be used in developing complex Mixed Reality (MR) / Virtual Reality (VR) environments. First study case will present how Mixed Reality can be applied for the development of an application based on Microsoft HoloLens© headset. The MR application will allow mixing virtual and real elements for creating an improved context related to possible indoor emergencies getting information at real-time from distributed IoT devices. The MR application that will be presented will cover four topics: virtual evacuation drills, media content display, real-time sensors information access and domotic actions. Second study case will present a solution for building VR environments used for overhead crane training operations based on shipping ports sensors information This paper will emphasize on the fact that based on IoT sensor information it is possible to move from the development of static MR/VR environments, where real, external conditions don't influence at all the virtual context, to the creation of dynamically generated environments, based on IoT data. This work is developed in the ongoing "Smart City 3D simulation and monitoring platform" (CITISIM) Itea3 project where MR/VR services are being developed in the smart city domain.