Real-time panoramic video streaming system with overlaid interface concept for social media

Seo, Dongmahn; Kim, Suhyun; Park, Hogun; Ko, Heedong

doi:10.1007/s00530-013-0333-1

Cited by 12 publications

(10 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The proposed protocol not only alleviates the navigation limitation of previous works [Yang and Crawfis 2002;Jiang et al 2006;Seo et al 2013], but also minimizes the delay between viewpoint updates at the client end, allowing for a much richer and smoother interactive experience. Another motivation for this work is the use of remote rendering and IBR to assist emergency responders in their duties.…”

Section: Introductionmentioning

confidence: 84%

“…This characteristic of IBR is ideal for rendering photo-realistic environments on graphics-constrained devices. Coupled with a remote repository of images, IBR could also lead to the implementation of the Free Viewpoint Television (FTV) [Kilner et al 2007;Tanimoto 2009;Seo et al 2013] that allows the user to control the virtual camera and move within a scene. Instead of using a remote image repository, remote 3D rendering could be employed to enable the rendering of complex 3D virtual environments.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Propane

Pazzi

Boukerche

2014

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

Image-Based Rendering (IBR) has become widely known by its relatively low requirements for generating new scenes based on a sequence of reference images. This characteristic of IBR shows a remarkable potential impact in rendering complex 3D virtual environments on graphics-constrained devices, such as head-mounted displays, set-top boxes, media streaming devices, and so on. If well exploited, IBR coupled with remote rendering would enable the exploration of complex virtual environments on these devices. However, remote rendering requires the transmission of a large volume of images. In addition, existing solutions consider limited and/or deterministic navigation schemes as a means of decreasing the volume of streamed data. This article proposes the PROgressive PANorama StrEaming protocol (PROPANE) to offer users a smoother virtual navigation experience by prestreaming the imagery data required to generate new views as the user wanders within a 3D environment. PROPANE is based on a very simple yet effective trigonometry model and uses a strafe (lateral movement) technique to minimize the delay between image updates at the client end. This article introduces the concept of key partial panoramas, namely panorama segments that cover movements in any direction by simply strafing from an appropriate key partial panorama and streaming the amount of lost pixels. Therefore, PROPANE can provide a constrained device with sufficient imagery data to cover a future user's viewpoints, thereby minimizing the impact of transmission delay and jitter. PROPANE has been implemented and compared to two baseline remote rendering schemes. The evaluation results show that the proposed technique outperforms the selected and closely related existing schemes by minimizing the response time while not limiting the user to predefined paths as opposed to previous protocols.

show abstract

Section: Introductionmentioning

confidence: 84%

Section: Introductionmentioning

confidence: 99%

Propane

Pazzi

Boukerche

2014

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

show abstract

“…Interesting future work includes how to dynamically assign personalized weights for the most likely streams to switch to next (e.g., by the design of data-driven methods for determining stream switching probabilities), and the design of (online) algorithms for determining appropriate values of the penalty parameter A. Other interesting future work could be to integrate social media and other aspects that may impact the switching probabilities [54].…”

Section: Discussionmentioning

confidence: 99%

Optimized Adaptive Streaming of Multi-video Stream Bundles

Carlsson

Eager

Krishnamoorthi

et al. 2017

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Abstract-In contrast to traditional video, multi-view video streaming allows viewers to interactively switch among multiple perspectives provided by different cameras. One approach to achieving such a service is to encode the video from all of the cameras into a single stream, but this has the disadvantage that only a portion of the received video data will be used, namely that required for the selected view at each point in time. In this paper we introduce the concept of a "multi-video stream bundle" that consists of multiple parallel video streams that are synchronized in time, each providing the video from a different camera capturing the same event or movie. For delivery we leverage the adaptive features and time-based chunking of HTTPbased Adaptive Streaming (HAS), but now employing adaptation in both content and rate. Users are able to change their viewpoint on-demand and the client player adapts the rate at which data is retrieved from each stream based on the user's current view, the probabilities of switching to other views, and the user's current bandwidth conditions. A crucial component of such a system is the prefetching policy. For this we present an optimization model as well as a simpler heuristic that can balance the playback quality and the probability of playback interruptions. After analytically and numerically characterizing the optimal solution, we present a prototype implementation and sample results. Our prefetching and buffer management solution is shown to provide close to seamless playback switching when there is sufficient bandwidth to prefetch the parallel streams.

show abstract

“…In [21] a system using multi-resolution panorama streaming is described. The main idea is to encode the panorama video into tiles and at different resolutions.…”

Section: Related Workmentioning

confidence: 99%

Video processing for panoramic streaming using HEVC and its scalable extensions

Fuente

Skupin

Schierl

2016

Multimed Tools Appl

View full text Add to dashboard Cite

Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) is transmitted from a high-spatial resolution video, i.e. a video covering a very Bwide-angle^(much larger than the human field-of-view -e.g. 360°). Some transport schemes for panoramic video delivery have been proposed and demonstrated within the past decade, which allow users to navigate interactively within the high-resolution videos. With the recent advances of head mounted displays, consumers may soon have immersive and sufficiently convenient end devices at reach, which could lead to an increasing demand for panoramic video experiences. The solution proposed within this paper is built upon tile-based panoramic streaming, where users receive a set of tiles that match their RoI, and consists in a low-complexity compressed domain video processing technique for using H.265/HEVC and its scalable extensions (H.265/SHVC and H.265/MV-HEVC). The proposed technique generates a single video bitstream out of the selected tiles so that a single hardware decoder can be used. It overcomes the scalability issue of previous solutions not using tiles and the battery consumption issue inherent of tile-based panorama streaming, where multiple parallel software decoders are used. In addition, the described technique is capable of reducing peak streaming bitrate during changes of the RoI, which is crucial for allowing a truly immersive and low latency video experience. Besides, it makes it possible to use Open GOP structures without incurring any playback interruption at switching events, which provides a better compression efficiency compared to closed GOP structures.

show abstract

Real-time panoramic video streaming system with overlaid interface concept for social media

Cited by 12 publications

References 13 publications

Propane

Propane

Optimized Adaptive Streaming of Multi-video Stream Bundles

Video processing for panoramic streaming using HEVC and its scalable extensions

Contact Info

Product

Resources

About