A Decision Theoretic Approach to Motion Saliency in Computer Animations

Arpa, Sami; Bulbul, Abdullah; Çapın, Tolga

doi:10.1007/978-3-642-25090-3_15

Cited by 3 publications

(5 citation statements)

References 16 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several authors proposed dynamic saliency models, designed to handle this temporal information (see the benchmark of Wang et al [39] for more details), but still present a high computational cost that is not yet compatible with our real-time context. However, given the versatility of our framework, we believe that this aspect could be explored using a custom velocity map, or by adapting existing methods for moving objects [40] or animated meshes [41], which should compensate for the missing temporal aspect.…”

Section: Summary Of Contributionsmentioning

confidence: 99%

Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

Goudé

Bruckert

Olivier

et al. 2024

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Gaze behavior of virtual characters in video games and virtual reality experiences is a key factor of realism and immersion. Indeed, gaze plays many roles when interacting with the environment; not only does it indicate what characters are looking at, but it also plays an important role in verbal and non-verbal behaviors and in making virtual characters alive. Automated computing of gaze behaviors is however a challenging problem, and to date none of the existing methods are capable of producing close-to-real results in an interactive context. We therefore propose a novel method that leverages recent advances in several distinct areas related to visual saliency, attention mechanisms, saccadic behavior modelling, and head-gaze animation techniques. Our approach articulates these advances to converge on a multi-map saliency-driven model which offers real-time realistic gaze behaviors for non-conversational characters, together with additional user-control over customizable features to compose a wide variety of results. We first evaluate the benefits of our approach through an objective evaluation that confronts our gaze simulation with ground truth data using an eye-tracking dataset specifically acquired for this purpose. We then rely on subjective evaluation to measure the level of realism of gaze animations generated by our method, in comparison with gaze animations captured from real actors. Our results show that our method generates gaze behaviors that cannot be distinguished from captured gaze animations. Overall, we believe that these results will open the way for more natural and intuitive design of realistic and coherent gaze animations for real-time applications.

show abstract

Section: Summary Of Contributionsmentioning

confidence: 99%

Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

Goudé

Bruckert

Olivier

et al. 2024

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…By considering the psychological literature given in Section 2, and through analyzing psychophysical experiments [24], we describe a model to compare the attention values of objects in terms of motion. While we know that motion by itself does not attract attention, its attributes, such as initiation, may do so.…”

Section: Motion Saliency Modelmentioning

confidence: 99%

“…Calculating saliency: We use the motion-saliency model from [24] to assign a saliency value for each cluster, as described in Section 3.1. Once the motion state of a cluster is detected, its saliency value is calculated as a time-dependent variable.…”

Section: Saliency Calculation For Clustersmentioning

confidence: 99%

“…Motion-saliency model.Individual attention values for changing motion states. (From[24], ©2011 Springer, reprinted with permission. For each motion state an initial saliency value is assigned considering its dominancy among the others.…”

mentioning

confidence: 99%

“…k is determined as a motion-saliency unit, discretized for computer space. Refer to Arpa et al[24] for more details. ).…”

mentioning

confidence: 99%

See 2 more Smart Citations

A clustering-based method to estimate saliency in 3D animated meshes

Bulbul

Arpa

Çapın

2014

Computers & Graphics

Self Cite

View full text Add to dashboard Cite

We present a model to determine the perceptually significant elements in animated 3D scenes using a motion-saliency method. Our model clusters vertices with similar motion-related behaviors. To find these similarities, for each frame of an animated mesh sequence, vertices' motion properties are analyzed and clustered using a Gestalt approach. Each cluster is analyzed as a single unit and representative vertices of each cluster are used to extract the motion-saliency values of each group. We evaluate our method by performing an eye-tracker-based user study in which we analyze observers' reactions to vertices with high and low saliencies. The experiment results verify that our proposed model correctly detects the regions of interest in each frame of an animated mesh. © 2014 Elsevier Ltd

show abstract

Reactive Gaze during Locomotion in Natural Environments

Melgare,

Rohmer,

Musse

et al. 2024

Computer Graphics Forum

View full text Add to dashboard Cite

Animating gaze behavior is crucial for creating believable virtual characters, providing insights into their perception and interaction with the environment. In this paper, we present an efficient yet natural‐looking gaze animation model applicable to real‐time walking characters exploring natural environments. We address the challenge of dynamic gaze adaptation by combining findings from neuroscience with a data‐driven saliency model. Specifically, our model determines gaze focus by considering the character's locomotion, environment stimuli, and terrain conditions. Our model is compatible with both automatic navigation through pre‐defined character trajectories and user‐guided interactive locomotion, and can be configured according to the desired degree of visual exploration of the environment. Our perceptual evaluation shows that our solution significantly improves the state‐of‐the‐art saliency‐based gaze animation with respect to the character's apparent awareness of the environment, the naturalness of the motion, and the elements to which it pays attention.

show abstract

A Decision Theoretic Approach to Motion Saliency in Computer Animations

Cited by 3 publications

References 16 publications

Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

A clustering-based method to estimate saliency in 3D animated meshes

Reactive Gaze during Locomotion in Natural Environments

Contact Info

Product

Resources

About