360-Degree Virtual-Reality Cameras for the Masses

Tan, Jack Z. G.; Cheung, Gene; Ma, Rui

doi:10.1109/mmul.2018.011921238

Cited by 18 publications

(12 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the approach does require complex multi-camera setups and produces significant volumes of data requiring 28 CPU hours processing time per frame. There are commercial solutions that capture 360-Degree RGBD videos (Kandao Obsidian R ≈ $4200 USD (Tan et al, 2018), as well as 360-Degree RGBD can be synthesized from 360 ODS video using stereo matching. These 360-Degree RGBD videos can be rendered efficiently in real-time on mobile hardware.…”

Section: Degrees-of-freedom Videomentioning

confidence: 99%

6DIVE: 6 Degrees-of-Freedom Immersive Video Editor

Griffin

Langlotz

Zollmann

2021

Front. Virtual Real.

View full text Add to dashboard Cite

Editing 6DoF videos using standard video editing tools is challenging, especially for non-expert users. There is a large gap between the 2D interface used for traditional video editing and the immersive VR environment used for replay. In this paper, we present 6DIVE, a 6 degrees-of-freedom (DoF) immersive video editor. 6DIVE allows users to edit these 6DoF videos directly in an immersive VR environment. In this work, we explored options for a timeline representation as well as UI placement suitable for immersive video editing. We used our prototypical implementation of an immersive video editor to conduct a user study to analyze the feasibility and usability of immersive 6DoF editing. We compared 6DIVE to a desktop-based implementation of a VR video editor. Our initial results suggest that 6DIVE allows even non-expert users to perform basic editing operations on videos in VR. While we did not find any statistically significant differences for the workload between the VR and the desktop interface, we found a statistically significant difference in user preference, with a preference for the VR interface. We also found higher ratings for the user experience metrics in VR captured by the user experience questionnaire.

show abstract

Section: Degrees-of-freedom Videomentioning

confidence: 99%

6DIVE: 6 Degrees-of-Freedom Immersive Video Editor

Griffin

Langlotz

Zollmann

2021

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…With the development of information and communications technology (ICT) such as 5G and artificial intelligence and changes to the content creation environment, there is a growing demand for immersive media [1][2][3][4], which refers to a medium that conveys information of all types of senses in the scene to maximize immersion and presence for user satisfaction. Immersive media may include multisensory information such as high-quality visual information, multichannel audio information, and tactile information.…”

Section: Introductionmentioning

confidence: 99%

Region-Based Static Video Stitching for Reduction of Parallax Distortion

Park

Shim

Lee

2021

Sensors

View full text Add to dashboard Cite

In this paper, we propose a semantic segmentation-based static video stitching method to reduce parallax and misalignment distortion for sports stadium scenes with dynamic foreground objects. First, video frame pairs for stitching are divided into segments of different classes through semantic segmentation. Region-based stitching is performed on matched segment pairs, assuming that segments of the same semantic class are on the same plane. Second, to prevent degradation of the stitching quality of plain or noisy videos, the homography for each matched segment pair is estimated using the temporally consistent feature points. Finally, the stitched video frame is synthesized by stacking the stitched matched segment pairs and the foreground segments to the reference frame plane by descending order of the area. The performance of the proposed method is evaluated by comparing the subjective quality, geometric distortion, and pixel distortion of video sequences stitched using the proposed and conventional methods. The proposed method is shown to reduce parallax and misalignment distortion in segments with plain texture or large parallax, and significantly improve geometric distortion and pixel distortion compared to conventional methods.

show abstract

“…V IDEO stitching is a crucial technique to generate immersive videos since omnidirectional scenes are usually captured by using multiple cameras [1], [2]. It creates a combined, usually wider field of view, video from a collection of videos with overlapping fields of view.…”

Section: Introductionmentioning

confidence: 99%

Segmentation-Based Seam Cutting for High-Resolution 360-Degree Video Stitching

et al. 2021

View full text Add to dashboard Cite

We present a novel segmentation-based seam cutting algorithm to generate visually plausible high-resolution 360-degree video efficiently. While the demand for an efficient video stitching algorithm for generating immersive videos has increased, it has received limited attention in the literature. Furthermore, stitched videos often suffer from distorted objects, temporal inconsistency, and time constraints. Thus, in this paper, we propose an efficient seam finding algorithm that preserves objects from distortion, minimizes temporal inconsistency and reduces processing time. One of the fundamental steps in image and video stitching is the estimation of seam boundary. To do this, the proposed algorithm leverages a convolutional neural networks-based instance segmentation algorithm that provides more accurate object regions. It computes energy surfaces considering the regions and then estimates seam boundary by discovering a minimal energy path with minimal computations. We validate the proposed algorithm using challenging high-resolution 360-degree virtual reality sequences. The experimental results verify that the proposed algorithm can produce seam boundaries that avoid objects with better temporary consistency. The proposed algorithm reduces the number of pixels passed through objects by approximately 30% on average compared to the existing algorithms. The qualitative comparisons furthermore demonstrate that the proposed algorithm consistently produces more perceptually pleasing results.

show abstract

360-Degree Virtual-Reality Cameras for the Masses

Cited by 18 publications

References 8 publications

6DIVE: 6 Degrees-of-Freedom Immersive Video Editor

6DIVE: 6 Degrees-of-Freedom Immersive Video Editor

Region-Based Static Video Stitching for Reduction of Parallax Distortion

Segmentation-Based Seam Cutting for High-Resolution 360-Degree Video Stitching

Contact Info

Product

Resources

About