Is there a universal instrument for measuring interactive information retrieval?

O’Brien, Heather; Toms, Elaine G.

doi:10.1145/1840784.1840835

Cited by 21 publications

(6 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At post-training, in addition to the outcome measures mentioned in 2.3.1, user engagement was assessed as an indicator of task engagement and motivation. For this purpose, we relied on the 12-item User Engagement Scale ( O'Brien and Toms, 2010 ), referred to as the Short Form UES (UES-SF; O’Brien et al, 2018 ). Items (e.g., “My experience was rewarding”) were rated on a scale ranging from 1 (“Strongly disagree”) to 5 (“Strongly agree”).…”

Section: Methodsmentioning

confidence: 99%

Individual differences associated with treatment adherence and transfer effects following gamified web-based cognitive control training for repetitive negative thinking

Hoorelbeke

Vervaeke

Siegle

et al. 2022

Internet Interventions

View full text Add to dashboard Cite

Section: Methodsmentioning

confidence: 99%

Individual differences associated with treatment adherence and transfer effects following gamified web-based cognitive control training for repetitive negative thinking

Hoorelbeke

Vervaeke

Siegle

et al. 2022

Internet Interventions

View full text Add to dashboard Cite

“…Indeed, within the last few years, the use of online and remote experimentation has grown, new methods have been pioneered and proposed (especially by researchers at search engine companies; see Dumais et al, 2011;Kelly, Dumais, & Pedersen, 2009;Kohavi et al, 2009), and new measures are being developed (c.f. O'Brien & Toms, 2010).…”

Section: Study Limitationsmentioning

confidence: 99%

A systematic review of interactive information retrieval evaluation studies, 1967–2006

Kelly

Sugimoto

2013

J Am Soc Inf Sci Tec

View full text Add to dashboard Cite

With the increasing number and diversity of search tools available, interest in the evaluation of search systems, particularly from a user perspective, has grown among researchers. More researchers are designing and evaluating interactive information retrieval (IIR) systems and beginning to innovate in evaluation methods. Maturation of a research specialty relies on the ability to replicate research, provide standards for measurement and analysis, and understand past endeavors. This article presents a historical overview of 40 years of IIR evaluation studies using the method of systematic review. A total of 2,791 journal and conference units were manually examined and 127 articles were selected for analysis in this study, based on predefined inclusion and exclusion criteria. These articles were systematically coded using features such as author, publication date, sources and references, and properties of the research method used in the articles, such as number of subjects, tasks, corpora, and measures. Results include data describing the growth of IIR studies over time, the most frequently occurring and cited authors and sources, and the most common types of corpora and measures used. An additional product of this research is a bibliography of IIR evaluation research that can be used by students, teachers, and those new to the area. To the authors' knowledge, this is the first historical, systematic characterization of the IIR evaluation literature, including the documentation of methods and measures used by researchers in this specialty.

show abstract

“…Social search tools can be evaluated via two main criteria: effectiveness (and hence user satisfaction) and elicited engagement [15][16][17][18]. Often, shorter time to completion (i.e.…”

Section: Search Tool Evaluationmentioning

confidence: 99%

Path Following in Social Web Search

Lorince

Donato²,

Todd

2014

Social Computing, Behavioral-Cultural Modeling and Prediction

View full text Add to dashboard Cite

Abstract. Many organisms, human and otherwise, engage in path following in physical environments across a wide variety of contexts. Inspired by evidence that spatial search and information search share cognitive underpinnings, we explored whether path information could also be useful in a Web search context. We developed a prototype interface for presenting a user with the "search path" (sequence of clicks and queries) of another user, and ran a user study in which participants performed a series of search tasks while having access to search path information. Results suggest that path information can be a useful search aid, but that better path representations are needed. This application highlights the benefits of a cognitive science-based search perspective for the design of Web search systems and the need for further work on aggregating and presenting search trajectories in a Web search context.

show abstract

Is there a universal instrument for measuring interactive information retrieval?

Cited by 21 publications

References 14 publications

Individual differences associated with treatment adherence and transfer effects following gamified web-based cognitive control training for repetitive negative thinking

Individual differences associated with treatment adherence and transfer effects following gamified web-based cognitive control training for repetitive negative thinking

A systematic review of interactive information retrieval evaluation studies, 1967–2006

Path Following in Social Web Search

Contact Info

Product

Resources

About