Adaptive 360 VR Video Streaming: Divide and Conquer

Hosseini, Mohammad; Swaminathan, Viswanathan

doi:10.1109/ism.2016.0028

Cited by 240 publications

(134 citation statements)

References 6 publications

(5 reference statements)

Supporting

Mentioning

133

Contrasting

Unclassified

Order By: Relevance

“…During the experiment subjects were wearing an HMD composed of a VR headmount with buttons 7 and a mobile device installed inside as a screen. iPhone 6 was used to display the images.…”

Section: B Methodologymentioning

confidence: 99%

See 1 more Smart Citation

On the performance of objective metrics for omnidirectional visual content

Upenik

Řeřábek

Ebrahimi

2017

2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX)

View full text Add to dashboard Cite

Abstract-Omnidirectional image and video have gained popularity thanks to availability of capture and display devices for this type of content. Recent studies have assessed performance of objective metrics in predicting visual quality of omnidirectional content. These metrics, however, have not been rigorously validated by comparing their prediction results with groundtruth subjective scores. In this paper, we present a set of 360-degree images along with their subjective quality ratings. The set is composed of four contents represented in two geometric projections and compressed with three different codecs at four different bitrates. A range of objective quality metrics for each stimulus is then computed and compared to subjective scores. Statistical analysis is performed in order to assess performance of each objective quality metric in predicting subjective visual quality as perceived by human observers. Results show the estimated performance of the state-of-the-art objective metrics for omnidirectional visual content. Objective metrics specifically designed for 360-degree content do not outperform conventional methods designed for 2D images.

show abstract

“…During the experiment subjects were wearing an HMD composed of a VR headmount with buttons 7 and a mobile device installed inside as a screen. iPhone 6 was used to display the images.…”

Section: B Methodologymentioning

confidence: 99%

“…Nevertheless, a suitable compression algorithm must take into account the intrinsic spherical nature of omnidirectional content. Recent studies on compression attempt to improve its efficiency by addressing geometrical representations [4][5], adaptive delivery [6] [7], and spherical nature of the visual content [8] [9].…”

Section: Introductionmentioning

confidence: 99%

On the performance of objective metrics for omnidirectional visual content

Upenik

Řeřábek

Ebrahimi

2017

2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX)

View full text Add to dashboard Cite

show abstract

“…Prior work has proposed a new tiling structure for 360°video, potentially saving up to 30% of the bandwidth compared to a non-tiled video [6]. Our approach can be considered complimentary to these works.…”

Section: Related Work 21 360°video Streamingmentioning

confidence: 98%

“…HM supports motion-constrained encoding and allows to decode the tiled video with a single decoder at client-side. The video is divided into six tiles: two polar tiles and four equatorial tiles [6], as in Figure 1. This tiling structure is not natively supported by H.265, which only allows to tile the video into a regular grid, where all rows have the same amount of columns and vice-versa.…”

Section: Proof-of-concept Setupmentioning

confidence: 99%

Improving Virtual Reality Streaming using HTTP/2

Petrangeli

Swaminathan

Hosseini

et al. 2017

Proceedings of the 8th ACM on Multimedia Systems Conference

Self Cite

View full text Add to dashboard Cite

The demand for 360°Virtual Reality (VR) videos is expected to grow in the near future, thanks to the diffusion of VR headsets. VR Streaming is however challenged by the high bandwidth requirements of 360°videos. To save bandwidth, we spatially tile the video using the H.265 standard and stream only tiles in view at the highest quality. The video is also temporally segmented, so that each temporal segment is composed of several spatial tiles. In order to minimize quality transitions when the user moves, an algorithm is developed to predict where the user is likely going to watch in the near future. Consequently, predicted tiles are also streamed at the highest quality. Finally, the server push in HTTP/2 is used to deliver the tiled video. Only one request is sent from the client; all the tiles of a segment are automatically pushed from the server. This approach results in a better bandwidth utilization and video quality compared to traditional streaming over HTTP/1.1, where each tile has to be requested independently by the client. We showcase the benefits of our framework using a prototype developed on a Samsung Galaxy S7 and a Gear VR, which supports both tiled and non-tiled videos and streaming over HTTP/1.1 and HTTP/2. Under limited bandwidth conditions, we demonstrate how our framework can improve the quality watched by the user compared to a non-tiled solution where all of the video is streamed at the same quality. This result represents a major improvement for the efficient streaming of VR videos.

show abstract

“…Zare et al propose a modi ed H.265 encoder to more e ciently tile a 360°v ideo [20]. Hosseini et al propose a new tiling structure of the 360°v ideo, which allows to save up to 30% of the bandwidth compared to a non-tiled video [7]. The same tiling structure has also been adopted in this paper, because of its e ciency.…”

Section: Related Work 21 360°video Streamingmentioning

confidence: 99%

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

Petrangeli

Swaminathan

Hosseini

et al. 2017

Proceedings of the 25th ACM International Conference on Multimedia

Self Cite

136

View full text Add to dashboard Cite

Virtual Reality (VR) devices are becoming accessible to a large public, which is going to increase the demand for 360°VR videos. VR videos are often characterized by a poor quality of experience, due to the high bandwidth required to stream the 360°video. To overcome this issue, we spatially divide the VR video into tiles, so that each temporal segment is composed of several spatial tiles. Only the tiles belonging to the viewport, the region of the video watched by the user, are streamed at the highest quality. The other tiles are instead streamed at a lower quality. We also propose an algorithm to predict the future viewport position and minimize quality transitions during viewport changes. The video is delivered using the server push feature of the HTTP/2 protocol. Instead of retrieving each tile individually, the client issues a single push request to the server, so that all the required tiles are automatically pushed back to back. This approach allows to increase the achieved throughput, especially in mobile, high RTT networks. In this paper, we detail the proposed framework and present a prototype developed to test its performance using real-world 4G bandwidth traces. Particularly, our approach can save bandwidth up to 35% without severely impacting the quality viewed by the user, when compared to a traditional non-tiled VR streaming solution. Moreover, in high RTT conditions, our HTTP/2 approach can reach 3 times the throughput of tiled streaming over HTTP/1.1, and consistently reduce freeze time. These results represent a major improvement for the e cient delivery of 360°VR videos over the Internet.

show abstract

Adaptive 360 VR Video Streaming: Divide and Conquer

Cited by 240 publications

References 6 publications

On the performance of objective metrics for omnidirectional visual content

On the performance of objective metrics for omnidirectional visual content

Improving Virtual Reality Streaming using HTTP/2

An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos

Contact Info

Product

Resources

About