Standards-compliant HTTP adaptive streaming of static light fields

Wijnants, Maarten; Lievens, Hendrik; Michiels, Nick; Put, Jeroen; Quax, Peter; Lamotte, Wim

doi:10.1145/3281505.3281539

Cited by 10 publications

(3 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Beyond power requirements and other implementation-related challenges, light field visualization comes with immense data that is to be stored, processed, and depending on the use case, transmitted. To combat this, there are significant research efforts related to compression [ 96 ], alternate formats [ 97 ], and adaptive approaches [ 98 ].…”

Section: Projection-based Light Field Visualization Technologymentioning

confidence: 99%

How I Met Your V2X Sensor Data: Analysis of Projection-Based Light Field Visualization for Vehicle-to-Everything Communication Protocols and Use Cases

Kara

Wippelhauser

Balogh

et al. 2023

Sensors

View full text Add to dashboard Cite

The practical usage of V2X communication protocols started emerging in recent years. Data built on sensor information are displayed via onboard units and smart devices. However, perceptually obtaining such data may be counterproductive in terms of visual attention, particularly in the case of safety-related applications. Using the windshield as a display may solve this issue, but switching between 2D information and the 3D reality of traffic may introduce issues of its own. To overcome such difficulties, automotive light field visualization is introduced. In this paper, we investigate the visualization of V2X communication protocols and use cases via projection-based light field technology. Our work is motivated by the abundance of V2X sensor data, the low latency of V2X data transfer, the availability of automotive light field prototypes, the prevalent dominance of non-autonomous and non-remote driving, and the lack of V2X-based light field solutions. As our primary contributions, we provide a comprehensive technological review of light field and V2X communication, a set of recommendations for design and implementation, an extensive discussion and implication analysis, the exploration of utilization based on standardized protocols, and use-case-specific considerations.

show abstract

Section: Projection-based Light Field Visualization Technologymentioning

confidence: 99%

How I Met Your V2X Sensor Data: Analysis of Projection-Based Light Field Visualization for Vehicle-to-Everything Communication Protocols and Use Cases

Kara

Wippelhauser

Balogh

et al. 2023

Sensors

View full text Add to dashboard Cite

show abstract

“…With the advent of mobile AR/VR and low-cost volumetric capture devices, video-based point cloud compression and light field streaming techniques have recently received more attention [39,47].…”

Section: General Texture Compressionmentioning

confidence: 99%

A Distributed, Decoupled System for Losslessly Streaming Dynamic Light Probes to Thin Clients

Stengel¹,

Majercik²,

Boudaoud³

et al. 2021

Preprint

View full text Add to dashboard Cite

GlobalIllumination (GI) Server 2x HEVC Lossless YUV444 + Meta data 5G / WiFi Data Center Thin Clients User Input (50 KBps) Game Server Process Irradiance Volume Data Scene Transforms Game State (10 KBps) Render Loop Global Illumination < 50 Mbps Handheld Console AR/VR Headset + Figure 1. Light probe streaming architecture. Our system streams irradiance volume data from a cloud server to thin clients for mobile gaming and AR/VR. The streamed data enables dynamic high quality ray traced indirect lighting on the clients at low computational cost. We use efficient encoding and decoding hardware features to achieve high compression ratios with low latency. Thus a single server can update thousands of light probes per seconds across multiple connected thin clients, amortizing rendering costs.

show abstract

“…The recent work of Wijnants et al proposed HTTP adaptive streaming to transmit the data of static light fields. The core idea of the concept is approaching the source views of the model or the scene as the segments of a video sequence.…”

Section: The Perceived Quality Of Light‐field Visualizationmentioning

confidence: 99%

Angularly continuous light‐field format: Concept, implementation, and evaluation

et al. 2019

View full text Add to dashboard Cite

In this paper, we present the concept, the implementation, and the evaluation of our novel angularly continuous light-field format. We compared the subjective visual performance of our format with the perspective camera format through a series of subjective and objective tests. In our extensive subjective study, we used multiple absolute and comparative rating scales and various visual stimuli with different contents and angular resolutions. The perceived quality was assessed by a total of 36 test participants, who were separated based on their scientific expertise. The objective quality was evaluated through the degradations caused by three well-known compression methods. The obtained results indicate that our light-field format may outperform the conventional format, and it generally can provide at least equivalent visual quality. Furthermore, these findings open the way for data size optimization, without compromising the achieved level of perceived quality.

show abstract

Standards-compliant HTTP adaptive streaming of static light fields

Cited by 10 publications

References 35 publications

How I Met Your V2X Sensor Data: Analysis of Projection-Based Light Field Visualization for Vehicle-to-Everything Communication Protocols and Use Cases

How I Met Your V2X Sensor Data: Analysis of Projection-Based Light Field Visualization for Vehicle-to-Everything Communication Protocols and Use Cases

A Distributed, Decoupled System for Losslessly Streaming Dynamic Light Probes to Thin Clients

Angularly continuous light‐field format: Concept, implementation, and evaluation

Contact Info

Product

Resources

About