Text or Pictures? An Eyetracking Study of How People View Digital Video Surrogates

Hughés, A.E.; Wilkens, Todd; Wildemuth, Barbara M.; Marchionini, Gary

doi:10.1007/3-540-45113-7_27

Cited by 52 publications

(58 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In our 'binned' analysis of Study 1, we found that for surrogates where the text alone did not have perfect judgment accuracy (the 'low-bin'), adding good images increased accuracy by 24%. This result is consistent with results from Loumakis et al [16] that 'high-scent' images can help improve surrogates with 'low-scent' text, and observations from Hughes et al [11] that images are sometimes used to help confirm or refute the textual parts of a surrogate. In a study of social annotations embedded into SERP results, Muralidharan et al [19] noted that when summary snippets were shorter, the social annotations were noticed more.…”

Section: Rq1 -Do Image-augmented Surrogates Help Relevance Decisions?supporting

confidence: 91%

“…Al Maqbali et al [18] found that users looked at textual components of an image-augmented surrogate more than the image components, but that salient images did draw users' attention. Hughes et al [11] also found that searchers had more eyegaze fixations on the textual elements of an image-augmented surrogate than on the image, and reported gaze patterns that suggest that participants looked at the text first, and used the image to help confirm or refute the text. Muralidharan et al [19] looked at social annotations integrated into web search results and reported that often participants did not notice small sized images and annotations, but instead focused on URLs and titles in the results.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Augmenting web search surrogates with images

Capra

Arguello

Scholer

2013

Proceedings of the 22nd ACM International Conference on Conference on Information &Amp; Knowledge Management - CIKM '13

View full text Add to dashboard Cite

While images are commonly used in search result presentation for vertical domains such as shopping and news, web search results surrogates remain primarily text-based. In this paper, we present results of two large-scale user studies to examine the effects of augmenting text-based surrogates with images extracted from the underlying webpage. We evaluate effectiveness and efficiency at both the individual surrogate level and at the results page level. Additionally, we investigate the influence of two factors: the goodness of the image in terms of representing the underlying page content, and the diversity of the results on a results page. Our results show that at the individual surrogate level, good images provide only a small benefit in judgment accuracy versus text-only surrogates, with a slight increase in judgment time. At the results page level, surrogates with good images had similar effectiveness and efficiency compared to the text-only condition. However, in situations where the results page items had diverse senses, surrogates with images had higher click precision versus text-only ones. Results of these studies show tradeoffs in the use of images in web search surrogates, and highlight particular situations where they can provide benefits.

show abstract

Section: Rq1 -Do Image-augmented Surrogates Help Relevance Decisions?supporting

confidence: 91%

Section: Related Workmentioning

confidence: 99%

Augmenting web search surrogates with images

Capra

Arguello

Scholer

2013

Proceedings of the 22nd ACM International Conference on Conference on Information &Amp; Knowledge Management - CIKM '13

View full text Add to dashboard Cite

show abstract

“…A prior eye-tracking empirical study looked at digital video surrogates comprised of text and three thumbnail images to represent each document, and found that participants looked at and fixated on text far more than pictures [10]. They used the text as an anchor from which to make judgments about the list of results.…”

Section: Discussionmentioning

confidence: 99%

Evaluating the contributions of video representation for a life oral history collection

Christel

Frisch

2008

Proceedings of the 8th ACM/IEEE-CS Joint Conference on Digital Libraries

View full text Add to dashboard Cite

A digital video library of over 900 hours of video and 18000 stories from The HistoryMakers is used to investigate the role of motion video for users of recorded life oral histories. Stories in the library are presented in one of two ways in two withinsubjects experiments: either as audio accompanied by a single still photographic image per story, or as the same audio within a motion video of the interviewee speaking.Twenty-four participants given a treasure-hunt fact-finding task, i.e., very directed search, showed no significant preference for either the still or video treatment, and no difference in task performance. Fourteen participants in a second study worked on an exploratory task in the same within-subjects experimental framework, and showed a significant preference for video. For exploratory work, video has a positive effect on user satisfaction. Implications for use of video in collecting and accessing recorded life oral histories, in student assignments and more generally, are discussed, along with reflections on long term user studies to complement the ones presented here.

show abstract

“…Eye-tracking studies have found that when surrogates include both thumbnails and text, users focus on both elements. [14,20].…”

Section: Vertical Query-sensementioning

confidence: 99%

The Effects of Vertical Rank and Border on Aggregated Search Coherence and Search Behavior

Arguello

Capra

2014

Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management

View full text Add to dashboard Cite

Aggregated search is the task of blending results from different search services, or verticals, into a set of web search results. Aggregated search coherence is the extent to which results from different sources focus on similar senses of an ambiguous or underspecified query. Prior work investigated the "spill-over" effect between a set of blended vertical results and the web results. These studies found that users are more likely to interact with the web results when the vertical results are more consistent with the user's intended querysense. We extend this prior work by investigating three new research questions: (1) Does the spill-over effect generalize across different verticals? (2) Does the vertical rank moderate the level of spill-over? and (3) Does the presence of a border around the vertical results moderate the level of spill-over? We investigate four different verticals (images, news, shopping, and video) and measure spill-over using interaction measures associated with varying levels of engagement with the web results (bookmarks, clicks, scrolls, and mouseovers). Results from a large-scale crowdsourced study suggest that: (1) The spill-over effect generalizes across verticals, but is stronger for some verticals than others, (2) Vertical rank has a stronger moderating effect for verticals with a mid-level of spill-over, and (3) Including a border around the vertical results has a subtle moderating effect for those verticals with a low level of spill-over.

show abstract

Text or Pictures? An Eyetracking Study of How People View Digital Video Surrogates

Cited by 52 publications

References 15 publications

Augmenting web search surrogates with images

Augmenting web search surrogates with images

Evaluating the contributions of video representation for a life oral history collection

The Effects of Vertical Rank and Border on Aggregated Search Coherence and Search Behavior

Contact Info

Product

Resources

About