Investigation of the beat rate effect on frame rate for animated content

Hulusić, Vedad; Czanner, Gabriela; Debattista, Kurt; Šikudová, Elena; Dubla, Piotr; Chalmers, Alan

doi:10.1145/1980462.1980493

Cited by 14 publications

(19 citation statements)

References 25 publications

(17 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Refreshing the plot for every data point requires updating the plot every 0.001 milliseconds. However, since humans can only perceive changes on the order of 60 events per second [33], this update rate is unnecessary. With pixel-aware preaggregation, we would refresh for each aggregated data point instead, the rate of which may still be higher than necessary.…”

Section: Streaming Asapmentioning

confidence: 99%

Asap

Rong¹,

Bailis²

2017

Proc. VLDB Endow.

View full text Add to dashboard Cite

Time series visualization of streaming telemetry (i.e., charting of key metrics such as server load over time) is increasingly prevalent in modern data platforms and applications. However, many existing systems simply plot the raw data streams as they arrive, often obscuring large-scale trends due to small-scale noise. We propose an alternative: to better prioritize end users' attention, smooth time series visualizations as much as possible to remove noise, while retaining large-scale structure to highlight significant deviations. We develop a new analytics operator called ASAP that automatically smooths streaming time series by adaptively optimizing the trade-off between noise reduction (i.e., variance) and trend retention (i.e., kurtosis). We introduce metrics to quantitatively assess the quality of smoothed plots and provide an efficient search strategy for optimizing these metrics that combines techniques from stream processing, user interface design, and signal processing via autocorrelation-based pruning, pixel-aware preaggregation, and ondemand refresh. We demonstrate that ASAP can improve users' accuracy in identifying long-term deviations in time series by up to 38.4% while reducing response times by up to 44.3%. Moreover, ASAP delivers these results several orders of magnitude faster than alternative search strategies.

show abstract

Section: Streaming Asapmentioning

confidence: 99%

Asap

Rong¹,

Bailis²

2017

Proc. VLDB Endow.

View full text Add to dashboard Cite

show abstract

“…This work showed that when accompanied by these scene-unrelated sound effects it is possible to decrease the frame rate of a video animation without perceivable difference in visual quality. Most recently, Hulusic et al [18] focused particularly on the effect of beat rate, scene and familiarity on the perception of frame rate. They showed that in case of static scenes lower beat rates have a significant effect on perception of low frame rates.…”

Section: Auditory-visual Cross-modal Interaction Research In Computermentioning

confidence: 99%

“…Subsequent work demonstrated how sound effects could be used as a distracter to reduce the computed frame rate of an animation without the participants perceiving any difference in the visual quality of the animation [34]. Hulusic et al achieved similar results using rhythmically significant audio, played at different beat rates [18].…”

Section: Introductionmentioning

confidence: 99%

“…One such limitation is the influence of one sensory input on another, commonly termed crossmodal interaction. One particular cross-modal effect, which has been successfully exploited in the field of computer graphics is that of vision and audition [31,[17][18][19]. Mastoropoulou et al demonstrated how crossmodal effects can be combined with selective rendering techniques to speed up the rendering process [33].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction

et al. 2010

Self Cite

View full text Add to dashboard Cite

The entertainment industry, primarily the video games industry, continues to dictate the development and performance requirements of graphics hardware and computer graphics algorithms. However, despite the enormous progress in the last few years it is still not possible to achieve some of industry's demands, in particular high-fidelity rendering of complex scenes in real-time, on a single desktop machine. A realisation that sound/music and other senses are important to entertainment, led to an investigation of alternative methods, such as cross-modal interaction in order to try and achieve the goal of "realism in real-time". In this paper we investigate the cross-modal interaction between vision and audition for reducing the amount of computation required to compute visuals by introducing movement related sound effects. Additionally, we look at the effect of camera movement speed on temporal visual perception. Our results indicate that slow animations are perceived as smoother than fast animations. Furthermore, introducing the sound effect of footsteps to walking animations further increased the animation smoothness perception. This has the consequence that for certain conditions the number of frames that need to be rendered each second can be reduced, saving valuable computation time, without the viewer being aware of this reduction. The results presented are another step towards the full understanding of the auditory-visual cross-modal interaction and its importance for helping achieve "realism int real-time".

show abstract

“…Moreover, it has been shown that it is possible to increase the perceptual quality of a stimulus in one modality by stimulating another modality at the same time (Mastoropoulou et al, 2005a;Harvey et al, 2010). This can be used for improving the perception of a material quality (Bonneel et al, 2010), Level-of-Detail (LOD) selection (Grelaud et al, 2009) or for increasing the spatial (Mastoropoulou et al, 2005a;Hulusic et al, 2008) and temporal (Mastoropoulou et al, 2005b;Hulusic et al, 2009Hulusic et al, , 2010a quality of visuals by coupling them with corresponding auditory stimuli.…”

Section: Introductionmentioning

confidence: 99%

Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and Interaction

Hulusić

Harvey

Debattista

et al. 2012

Computer Graphics Forum

Self Cite

View full text Add to dashboard Cite

In recent years research in the three-dimensional sound generation field has been primarily focussed upon new applications of spatialised sound. In the computer graphics community the use of such techniques is most commonly found being applied to virtual, immersive environments. However, the field is more varied and diverse than this and other research tackles the problem in a more complete, and computationally expensive manner. Furthermore, the simulation of light and sound wave propagation is still unachievable at a physically accurate spatio-temporal quality in real-time. Although the Human Visual System (HVS) and the Human Auditory System (HAS) are exceptionally sophisticated, they also contain certain perceptional and attentional limitations. Researchers, in fields such as psychology, have been investigating these limitations for several years and have come up with findings which may be exploited in other fields. This paper provides a comprehensive overview of the major techniques for generating spatialised sound and, in addition, discusses perceptual and cross-modal influences to consider. We also describe current limitations and provide an in-depth look at the emerging topics in the field.

show abstract

Investigation of the beat rate effect on frame rate for animated content

Cited by 14 publications

References 25 publications

Asap

Asap

Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction

Acoustic Rendering and Auditory–Visual Cross‐Modal Perception and Interaction

Contact Info

Product

Resources

About