Interactive Zoom and Panning from Live Panoramic Video

Abstract

Panorama video is becoming increasingly popular, and we present an end-to-end real-time system to interactively zoom and pan into high-resolution panoramic videos. Compared to existing systems using perspective panoramas with cropping, our approach creates a cylindrical panorama. Here, the perspective is corrected in real-time, and the result is a better and more natural zoom. Our experimental results also indicate that such zoomed virtual views can be generated far below the frame-rate threshold. Taking into account recent trends in device development, our approach should be able to scale to a large number of concurrent users in the near future.

An Experimental Evaluation of Debayering Algorithms on GPUs for Recording Panoramic Video in Real-Time

“…Cameras can perform a hardware conversion in the device, limited to a simple non-adaptive algorithm. In our realtime panorama video system [Gaddam et al, 2014], we use multiple industrial cameras with a gigabit Ethernet interface. With 2K resolution, a full rate data stream in the RGB color model is limited by bandwidth to about 18 fps.…”

Using a Commodity Hardware Video Encoder for Interactive Applications

“…As a case study in this paper, we have targeted an interactive and immersive streaming scenario, enabled by the growing availability of high-speed Internet access. In this respect, we already see systems where users can interact with live high-resolution content, e.g., some systems allow end-users to pan, tilt and zoom a virtual camera in panorama videos [Gaddam et al, 2014]. New cloud gaming services run the games entirely on the server.…”

“…Due to the increased availability of high-speed Internet access, multimedia services are becoming more interactive. Examples of such applications are both cloud gaming (OnLive, 2014) and systems where users can interact with high-resolution content (Gaddam et al, 2014). During the last few years, programmable hardware video encoders have been built into commodity hardware such as CPUs and GPUs.…”