Untangling Cost, Effort, and Load in Information Seeking and Retrieval

McGregor, Molly; Azzopardi, Leif; Halvey, Martin

doi:10.1145/3406522.3446026

Cited by 10 publications

(10 citation statements)

References 61 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To calculate the cost related to this assumed gain, we use a time‐oriented metric (McGregor et al, 2021). Because of the time pressure legal professionals work under this appears to be the most suitable representation of cost or effort.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

Wiggers

Verberne

Loon

et al. 2023

Asso for Info Science & Tech

View full text Add to dashboard Cite

Bibliometric‐enhanced information retrieval uses bibliometrics (e.g., citations) to improve ranking algorithms. Using a data‐driven approach, this article describes the development of a bibliometric‐enhanced ranking algorithm for legal information retrieval, and the evaluation thereof. We statistically analyze the correlation between usage of documents and citations over time, using data from a commercial legal search engine. We then propose a bibliometric boost function that combines usage of documents with citation counts. The core of this function is an impact variable based on usage and citations that increases in influence as citations and usage counts become more reliable over time. We evaluate our ranking function by comparing search sessions before and after the introduction of the new ranking in the search engine. Using a cost model applied to 129,571 sessions before and 143,864 sessions after the intervention, we show that our bibliometric‐enhanced ranking algorithm reduces the time of a search session of legal professionals by 2 to 3% on average for use cases other than known‐item retrieval or updating behavior. Given the high hourly tariff of legal professionals and the limited time they can spend on research, this is expected to lead to increased efficiency, especially for users with extremely long search sessions.

show abstract

Section: Methodsmentioning

confidence: 99%

“…This sum of costs is then offset to the gains of the relevant documents found. McGregor et al (2021) differentiate between load, effort, and cost. Load is taken to refer to the total amount of resources used to complete the task, internally and externally.…”

Section: Usage In Evaluationmentioning

confidence: 99%

Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

Wiggers

Verberne

Loon

et al. 2023

Asso for Info Science & Tech

View full text Add to dashboard Cite

show abstract

“…Those results seem moderated by expertise within VR and the task demands (Aksoy et al 2019;Luong et al 2019;Armougum et al 2019). For instance, outside of VR, when time and load on the resources are high, humans hit the maximum resource allocation capacity (McGregor et al 2021).…”

Section: Mental Overload and Working In Vrmentioning

confidence: 99%

A narrative review of immersive virtual reality’s ergonomics and risks at the workplace: cybersickness, visual fatigue, muscular fatigue, acute stress, and mental overload

et al. 2022

View full text Add to dashboard Cite

This narrative review synthesizes and introduces 386 previous works about virtual reality-induced symptoms and effects by focusing on cybersickness, visual fatigue, muscle fatigue, acute stress, and mental overload. Usually, these VRISE are treated independently in the literature, although virtual reality is increasingly considered an option to replace PCs at the workplace, which encourages us to consider them all at once. We emphasize the context of office-like tasks in VR, gathering 57 articles meeting our inclusion/exclusion criteria. Cybersickness symptoms, influenced by fifty factors, could prevent workers from using VR. It is studied but requires more research to reach a theoretical consensus. VR can lead to more visual fatigue than other screen uses, influenced by fifteen factors, mainly due to vergence-accommodation conflicts. This side effect requires more testing and clarification on how it differs from cybersickness. VR can provoke muscle fatigue and musculoskeletal discomfort, influenced by fifteen factors, depending on tasks and interactions. VR could lead to acute stress due to technostress, task difficulty, time pressure, and public speaking. VR also potentially leads to mental overload, mainly due to task load, time pressure, and intrinsically due interaction and interface of the virtual environment. We propose a research agenda to tackle VR ergonomics and risks issues at the workplace.

show abstract

“…The demands imposed during the search process are well recognised, and numerous studies have demonstrated that the cost, effort, and load (CEL) experienced during the search process is affected by not only the search task [27,91,120], but also the system [21,23,37] and the individual characteristics [24,57] of the user. Despite this recognition, our recent perspectives paper [97] highlighted two prominent challenges facing the ISR community in regard to CEL research. The first challenge relates to the general lack of consensus regarding cost, effort, and load definition, which has ultimately left the field with no universal definitions to describe these constructs.…”

Section: Introductionmentioning

confidence: 99%

A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972–2020

McGregor

Azzopardi

Halvey

2023

ACM Trans. Inf. Syst.

Self Cite

View full text Add to dashboard Cite

During the Information Search and Retrieval (ISR) process, user-system interactions such as submitting queries, examining results, and engaging with information, impose some degree of demand on the user’s resources. Within ISR, these demands are well recognised, and numerous studies have demonstrated that the Cost, Effort, and Load (CEL) experienced during the search process are affected by a variety of factors. Despite this recognition, there is no universally accepted definition of the constructs of CEL within the field of ISR. Ultimately this has led to problems with how these constructs have been interpreted and subsequently measured. This systematic review contributes a synthesis of literature, summarising key findings relating to how researchers have been defining and measuring CEL within ISR over the past 50 years. After manually screening 1,109 articles, we detail and analyse 91 articles which examine CEL within ISR. The discussion focuses on comparing the similarities and differences between CEL definitions and measures before identifying the limitations of the current state of the nomenclature. Opportunities for future research are also identified. Going forward, we propose a CEL taxonomy that integrates the relationships between CEL and their related constructs, which will help focus and disambiguate future research in this important area.

show abstract

Untangling Cost, Effort, and Load in Information Seeking and Retrieval

Cited by 10 publications

References 61 publications

Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

A narrative review of immersive virtual reality’s ergonomics and risks at the workplace: cybersickness, visual fatigue, muscular fatigue, acute stress, and mental overload

A Systematic Review of Cost, Effort, and Load Research in Information Search and Retrieval, 1972–2020

Contact Info

Product

Resources

About