Measuring Latency in Virtual Environments

Friston, Sebastian; Steed, Anthony

doi:10.1109/tvcg.2014.30

Cited by 70 publications

(44 citation statements)

References 24 publications

(29 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We measured the end-to-end latency of our apparatus at ∼6 ms, using the cross-correlation variant of Steed's Method [18]. This was predominantly the scan out time of the display.…”

Section: Resultsmentioning

confidence: 99%

Ultra low latency dataflow renderer

Friston

Steed

Tilbury

et al. 2015

2015 25th International Conference on Field Programmable Logic and Applications (FPL)

Self Cite

View full text Add to dashboard Cite

Abstract-In highly interactive applications, low latency (the time between a user's action, and the response to this action) is critical for a good user experience. Traditional GPU architectures can make very low latencies difficult to achieve. This is because they are designed first and foremost to implement the painter's algorithm -a rendering algorithm that trades-off visual realism for moderate computational speed and high scene dynamism. The dataflow programming paradigm, along with dedicated toolchains such as Maxeler's MaxCompiler, enable the design of application-specific graphics accelerators. Such accelerators, however, have the advantage that their architecture can be completely customised. In this paper we present a custom renderer that composites 2D sprites and maps to emulate a graphical user interface. It was designed to facilitate user interaction tests described in our previous work. Our design is ultra low latency, updating what is being driven to the display within 1 ms of receiving user input. This is far lower than traditional GPUs. We describe the operation of our renderer, and our novel DVI display driver output stage. We measure a latency of under 1 ms for our renderer, with an end-to-end delay of 6 ms for our whole apparatus. We compare this with the end-to-end latency of the same apparatus built with a modern GPU, which we measure at 20 ms.

show abstract

“…We measured the end-to-end latency of our apparatus at ∼6 ms, using the cross-correlation variant of Steed's Method [18]. This was predominantly the scan out time of the display.…”

Section: Resultsmentioning

confidence: 99%

Ultra low latency dataflow renderer

Friston

Steed

Tilbury

et al. 2015

2015 25th International Conference on Field Programmable Logic and Applications (FPL)

Self Cite

View full text Add to dashboard Cite

show abstract

“…The regular end-to-end latency of our system depends on the frame rate and ranges from about 70ms at 60Hz to about 105ms at 20Hz and was measured based on Friston et al [7]. Furthermore, we limited user interaction to tracked head-movements to avoid confounding influences of navigation parameters, viewing angles and potentially varying frame rates.…”

Section: Methodsmentioning

confidence: 99%

Efficient Hybrid Image Warping for High Frame-Rate Stereoscopic Rendering

Schollmeyer

Schneegans

Beck

et al. 2017

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Abstract-Modern virtual reality simulations require a constant high-frame rate from the rendering engine. They may also require very low latency and stereo images. Previous rendering engines for virtual reality applications have exploited spatial and temporal coherence by using image-warping to re-use previous frames or to render a stereo pair at lower cost than running the full render pipeline twice. However these previous approaches have shown artifacts or have not scaled well with image size. We present a new image-warping algorithm that has several novel contributions: an adaptive grid generation algorithm for proxy geometry for image warping; a low-pass hole-filling algorithm to address un-occlusion; and support for transparent surfaces by efficiently ray casting transparent fragments stored in per-pixel linked lists of an A-Buffer. We evaluate our algorithm with a variety of challenging test cases. The results show that it achieves better quality image-warping than state-of-the-art techniques and that it can support transparent surfaces effectively. Finally, we show that our algorithm can achieve image warping at rates suitable for practical use in a variety of applications on modern virtual reality equipment.

show abstract

“…Friston and Steed (2014) have characterized these techniques and developed a controllable mechanical simulator to simulate virtual environments (VEs) with various amounts of delay. They developed an Automated Frame Counting method to assess the amount of latency.…”

Section: How Latency Influences Effectiveness Of Training Systemsmentioning

confidence: 99%

Relative Effects of Real-world and Virtual-World Latency on an Augmented Reality Training Task: An AR Simulation Experiment

et al. 2017

View full text Add to dashboard Cite

In augmented reality (AR), virtual objects and information are overlaid onto the user's view of the physical world and can appear to become part of the real-world. Accurate registration of virtual objects is a key requirement for an effective and natural AR system, but misregistration can break the illusion of virtual objects being part of the real-world and disrupt immersion. End-to-end system latency severely impacts the quality of AR registration. In this research, we present a controlled study that aims at a deeper understanding of the effects of latency on virtual and real-world imagery and its influences on task performance in an AR training task. We utilize an AR simulation approach, in which an outdoor AR training task is simulated in a high-fidelity virtual reality (VR) system. The real and augmented portions of the AR training scenarios are simulated in VR, affording us detailed control over a variety of immersion parameters and the ability to explore the effects of different types of simulated latency. We utilized a representative task inspired by outdoor AR military training systems to compare various AR system configurations, including optical see-through and video see-through setups with both matched and unmatched levels of real and virtual objects latency. Our findings indicate that users are able to perform significantly better when virtual and real-world latencies are matched (as in the case of simulated video see-through AR with perfect augmentation-to-real-world registration). Unequal levels of latency led to reduction in performance, even when overall latency levels were lower compared to the matched case. The relative results hold up with increased overall latency.

show abstract

Measuring Latency in Virtual Environments

Cited by 70 publications

References 24 publications

Ultra low latency dataflow renderer

Ultra low latency dataflow renderer

Efficient Hybrid Image Warping for High Frame-Rate Stereoscopic Rendering

Relative Effects of Real-world and Virtual-World Latency on an Augmented Reality Training Task: An AR Simulation Experiment

Contact Info

Product

Resources

About