Injecting realism into simulated work tasks: A case study of the book domain

Abstract

Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predeter‐ mined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real‐world search requests—with the specific case of book search— to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

Use of mind mapping in search process to clarify information needs and improve search satisfaction

“…Two simulated search tasks (search scenarios) were designed for the experiment. Past researchers such as Borlund and Bogers [52] suggested the use of real-world examples (e.g. log files) in order to make search tasks more realistic and more similar to the real-life searches.…”