Pc-Mcu

Abstract

This paper introduces the Point Cloud Multipoint Control Unit (PC-MCU): a key component for multiuser holoconferencing systems, where remote participants are represented as Point Clouds. The presented solution redefines the idea of MCU, broadly used to optimize connections and communications between users in traditional videoconferencing, and introduces a set of key features for the optimization of holoconferencing services where multiple users can be remotely connected. The PC-MCU is a virtualized cloud-based component, that aims at reducing the end-user client computational resources and bandwidth usage, providing the following key features: fusion of volumetric videos, Level of Detail (LoD) adjustment and non visible data removal. The results obtained for a scenario with two remote users, show how the introduction of the PC-MCU provides significant benefits in terms of computational resources and bandwidth savings, thus alleviating the requirements at the client side in holoconferencing services when compared to a baseline condition without using it. These improvements open the door to further research on this area to enable scalable and adaptive holoconferencing services using lightweight devices. CCS CONCEPTS • Computer systems organization → Real-time operating systems; Real-time systems; Real-time operating systems; • Networks → Cloud computing; Network services; Cloud computing.

VRComm

“…video-based (V-PCC) [46] and geometry-based (G-PCC) [33]) point cloud coding) require significant processing resources for capturing, coding, transmitting and rendering [33,46]. While V-PCC is currently not suitable for real-time communication (due to its encoding latency), recent work has started to optimise G-VCC for telepresence scenarios [7,25] by data reduction and fusion. Still, many open challenges exist regarding volumetric media delivery [52].…”

“…However, our system is fully adaptable to any resolution. Audio is also captured, transmitted, and made spatially audible with the help of the Google Resonance API 7 .…”