Computing Offloading Over mmWave for Mobile VR: Make 360 Video Streaming Alive

Le, Tuan Thanh; Nguyen, Dien Van; Ryu, Eun‐Seok

doi:10.1109/access.2018.2878519

Cited by 19 publications

(10 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Regarding VR synchronization, authors in [25] implemented a computing offloading scheme via an mmWave 802.11ad 60GHz wireless link in order to share 360 • VR content with a PC. Synchronization algorithms were employed at packet level, handling real-time video transmission without packet loss.…”

Section: B Vr Backgroundmentioning

confidence: 99%

Real-Virtual World Device Synchronization in a Cloud-Enabled Social Virtual Reality IoT Network

Simiscuka¹,

Markande²,

Muntean³

2019

IEEE Access

View full text Add to dashboard Cite

Virtual reality (VR) is currently being used in many different areas such as car prototyping, gaming, medical training, teaching, and so on. The Internet of Things (IoT) devices such as systems-on-achip (e.g. Raspberry Pi), smart appliances, and sensors support a wide range of services, including machine automation, and remote monitoring and control. This paper introduces a novel social VR-IoT environment, which allows users to share and control local or remote IoT devices in a virtual platform. Two approaches using the VR-IoT solution are presented: one local network-based and one cloud-based. The proposed VR-IoT environment contains VRITESS, the novel VR-IoT Environment Synchronization Scheme, which facilitates a consistent and integrated experience for users by enabling control of real IoT objects with VR headsets. The control of some IoT objects in extreme environments or devices which are complex to operate can be simplified in a virtual environment. The VRITESS synchronization scheme maintains the real objects updated following instructions given in the virtual world and vice-versa. Testing involved local network-based and cloud-based testbeds created with a VR headset and IoT devices with the Performance Engineering Laboratory, Dublin City University's, Ireland. Test results demonstrated that lower latency is experienced in the local-network testbed in comparison with the cloud testbed. Furthermore, tests regarding the communications protocols implemented in the cloud testbed indicated that MQTT generates less delay and data traffic than REST. INDEX TERMS Multimedia IoT, three-dimensional visualization, virtual reality (VR), VR-IoT. ANDERSON AUGUSTO SIMISCUKA (S'17) received the B.Sc. degree in information systems from Mackenzie Presbyterian University, São Paulo, Brazil. He is currently pursuing the Ph.D. degree with the Performance Engineering Laboratory, School of Electronic Engineering, Dublin City University (DCU). He was involved in several telecom and software development projects with companies such as Wittel,

show abstract

Section: B Vr Backgroundmentioning

confidence: 99%

Real-Virtual World Device Synchronization in a Cloud-Enabled Social Virtual Reality IoT Network

Simiscuka¹,

Markande²,

Muntean³

2019

IEEE Access

View full text Add to dashboard Cite

show abstract

“…The first step to calculate the viewport area is to consider a spherical VR space that satisfies equation (1). In addition, we suppose that texture B is the actual output texture by using the resolution information displayed to the HMD and multiply the inverse matrix of equation (2), which expands the plane adjacent to the surface of the sphere to plane B…”

Section: Multi-layered Rendering 360 Vr Playermentioning

confidence: 99%

“…Furthermore, existing hardware video decoders have limits on their specifications, which implies that they cannot handle high-resolution video. 1,2 Several studies on video processing for resolutions higher than 4K and high-quality network-adaptive video have been performed. For example, the highefficiency video coding (HEVC) standard was made scalable through scalable high-efficiency video coding (SHVC); SHVC was approved recently as a standard by the Joint Collaborative Team on Video Coding.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Region of interest–based segmented tiled adaptive streaming using head-mounted display tracking sensing data

Kim

Yang

2019

International Journal of Distributed Sensor Networks

View full text Add to dashboard Cite

To support 360 virtual reality video streaming services, high resolutions of over 8K and network streaming technology that guarantees consistent quality of service are required. To this end, we propose 360 virtual reality video player technology and a streaming protocol based on MPEG Dynamic Adaptive Streaming over HTTP Spatial Representation Description to support the player. The player renders the downsized video as the base layer, which has a quarter of the resolution of the original video, and high-quality video tiles consisting of tiles obtained from the tiled-encoded high-quality video (over 16K resolution) as the enhanced layer. Furthermore, we implemented the system and conducted experiments to measure the network bandwidth for 16K video streaming and switching latency arising from changes in the viewport. From the results, we confirmed that the player has a switching latency of less than 1000 ms and a maximum network download bandwidth requirement of 100 Mbps.

show abstract

“…This means that the amount of data handled by the HMD increases rapidly, which is very challenging. For this reason, asymmetric core processing [1], [2], data offloading over mmWave [3], [4] for a mobile devices, and view location based asymmetric down-sampling method [5] have proposed. Consequently, the motion-constrained tile set (MCTS) [6] has been reported to process the viewport of the user.…”

Section: Introductionmentioning

confidence: 99%

Towards 3DoF+ 360 Video Streaming System for Immersive Media

et al. 2019

Self Cite

View full text Add to dashboard Cite

Immersive video streaming has become very popular. To increase the quality of experience (QoE) with immersive media, user movement adaptive video streaming, three degrees of freedom plus (3DoF+), has emerged and is expected to meet this growing demand. Satisfying the limit of the bandwidth, providing high-quality immersive experience is challenging because 3DoF+ system requires high resolution, multi-view video transmission. This paper proposes a stride based 3DoF+ 360 video streaming system and introduces two main ideas: (i) a multi-view video redundancy removal method using view synthesis, (ii) a multi-view video residual packing method. The proposed multi-view video compression method removes redundancy between videos and packs them into one video, and it exhibits a BD-rate saving of 36.0% in maximum compared to the results of the high-efficiency video coding reference model. In addition, the proposed system requires fewer number of decoders for the clients, and it decreases the burden for immersive video streaming.

show abstract

Computing Offloading Over mmWave for Mobile VR: Make 360 Video Streaming Alive

Cited by 19 publications

References 17 publications

Real-Virtual World Device Synchronization in a Cloud-Enabled Social Virtual Reality IoT Network

Real-Virtual World Device Synchronization in a Cloud-Enabled Social Virtual Reality IoT Network

Region of interest–based segmented tiled adaptive streaming using head-mounted display tracking sensing data

Towards 3DoF+ 360 Video Streaming System for Immersive Media

Contact Info

Product

Resources

About