Towards coordinated bandwidth adaptations for hundred-scale 3D tele-immersive systems

Jiang

Berlin

et al. 2017

IEEE Trans. Multimedia

Self Cite

Abstract-The ultimate objective of medical cyber-physical systems is to enhance the safety and effectiveness of patient care. To ensure safe and effective care during emergency patient transfer from rural areas to center tertiary hospitals, reliable and real-time communication is essential. Unfortunately, real-time monitoring of patients involves transmission of various clinical multimedia data including videos, medical images, and vital signs, which requires use of mobile network with high-fidelity communication bandwidth. However, the wireless networks along the roads in rural areas range from 4G to 2G to low speed satellite links, which poses a significant challenge to transmit critical patient information.In this paper, we present a bandwidth-compliant criticalityaware system for transmission of massive clinical multimedia data adaptive to varying bandwidths during patient transport. Model-based clinical automata are used to determine the criticality of clinical multimedia data. We borrow concepts from DASH, and propose physiology-aware adaptation techniques to transmit more critical clinical data with higher fidelity in response to changes in disease, clinical states, and bandwidth condition. In collaboration with Carle's ambulance service center, we develop a bandwidth profiler, and use it as proof of concept to support our experiments. Our preliminary evaluation results show that our solutions ensure that most critical patient's clinical data are communicated with higher fidelity. ACKNOWLEDGMENTThis paper reviews a technology package that is the result of a team effort. Lui Sha led the development of model-driven multimedia clinical systems and all system integration. Yu Jiang and Houbing Song helped with the development of physiological and cyber-physical models. Richard Berlin guided the study of patient emergency care, physiological multimedia data, and medical correctness. Mohammad Hosseini led the design and development of the multimedia communication system, adaptation system, heuristic algorithms, as well as development of the profiler app and conducting experiments and evaluations.

Section: B Prioritized and Criticality-aware Adaptationsmentioning

confidence: 99%

Toward Physiology-Aware DASH: Bandwidth-Compliant Prioritized Clinical Multimedia Communication in Ambulances

Jiang

Berlin

et al. 2017

IEEE Trans. Multimedia

Self Cite

“…Hosseini et al [6], [7] adopted prioritization techniques towards efficiently transmitting, rendering, and displaying bulky 3D contents to resource-limited devices given the importance of various 3D objects in the context. Similarly, in the context of 3D tele-immersive systems, the authors in [8] studied stream prioritization in regards to bandwidth savings. Their approach assigns higher quality to parts within users' viewport given the features of the human visual system.…”

Section: B Prioritized Multimedia Streamingmentioning

confidence: 99%

Adaptive 360 VR Video Streaming: Divide and Conquer

2016 IEEE International Symposium on Multimedia (ISM)

Swaminathan

2016

Self Cite

253

133

While traditional multimedia applications such as games and videos are still popular, there has been a significant interest in the recent years towards new 3D media such as 3D immersion and Virtual Reality (VR) applications, especially 360 VR videos. 360 VR video is an immersive spherical video where the user can look around during playback. Unfortunately, 360 VR videos are extremely bandwidth intensive, and therefore are difficult to stream at acceptable quality levels.In this paper, we propose an adaptive bandwidth-efficient 360 VR video streaming system using a divide and conquer approach. We propose a dynamic view-aware adaptation technique to tackle the huge bandwidth demands of 360 VR video streaming. We spatially divide the videos into multiple tiles while encoding and packaging, use MPEG-DASH SRD to describe the spatial relationship of tiles in the 360-degree space, and prioritize the tiles in the Field of View (FoV). In order to describe such tiled representations, we extend MPEG-DASH SRD to the 3D space of 360 VR videos. We spatially partition the underlying 3D mesh, and construct an efficient 3D geometry mesh called hexaface sphere to optimally represent a tiled 360 VR video in the 3D space. Our initial evaluation results report up to 72% bandwidth savings on 360 VR video streaming with minor negative quality impacts compared to the baseline scenario when no adaptations is applied.

“…In the context of 360 VR videos for example, various studies have been conducted to leverage view-aware adaptations to efficiently transmit, render, and display 360 videos to resource-limited VR headsets [2,6,8,9]. Similarly, the authors in [11] and [10] studied view-aware streaming in the context of 3D tele-immersive systems. Their approach assigns higher quality to parts within users' viewport given the features of the human visual system.…”

Section: View-aware Media Streamingmentioning

confidence: 99%

Dynamic Adaptive Point Cloud Streaming

Proceedings of the 23rd Packet Video Workshop

Timmerer

2018

Self Cite

High-quality point clouds have recently gained interest as an emerging form of representing immersive 3D graphics. Unfortunately, these 3D media are bulky and severely bandwidth intensive, which makes it difficult for streaming to resourcelimited and mobile devices. This has called researchers to propose efficient and adaptive approaches for streaming of high-quality point clouds.In this paper, we run a pilot study towards dynamic adaptive point cloud streaming, and extend the concept of dynamic adaptive streaming over HTTP (DASH) towards DASH-PC, a dynamic adaptive bandwidth-efficient and view-aware point cloud streaming system. DASH-PC can tackle the huge bandwidth demands of dense point cloud streaming while at the same time can semantically link to human visual acuity to maintain high visual quality when needed. In order to describe the various quality representations, we propose multiple thinning approaches to spatially sub-sample point clouds in the 3D space, and design a DASH Media Presentation Description manifest specific for point cloud streaming. Our initial evaluations show that we can achieve significant bandwidth and performance improvement on dense point cloud streaming with minor negative quality impacts compared to the baseline scenario when no adaptations is applied. CCS CONCEPTS•Information systems →Multimedia streaming; ACM Reference format: