Usability Evaluation of the Digital Library DanteSources

Bartalesi, Valentina; Meghini, Carlo; Metilli, Daniele; Andriani, Paola

doi:10.1007/978-3-319-39513-5_18

Cited by 2 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In digital humanities studies, usability evaluation of tools and services is seen as a key part of the research (Bulatovic et al, 2016), and is published and discussed in detail (e.g. Steiner et al, 2014;Bartalesi et al, 2016;Hu, 2018). In archaeology specifically, usability studies are less routinely performed (or at least not often published), and seem to be limited to the fields of virtual reality and digital museums (Karoulis et al, 2006;Pescarin et al, 2014).…”

Section: Related Work In Usability Studiesmentioning

confidence: 99%

Usability Evaluation for Online Professional Search in the Dutch Archaeology Domain

Brandsen,

Verberne,

Lambers

et al. 2021

Preprint

View full text Add to dashboard Cite

This paper presents AGNES, the first information retrieval system for archaeological grey literature, allowing full-text search of these long archaeological documents. This search system has a web interface that allows archaeology professionals and scholars to search through a collection of over 60,000 Dutch excavation reports, totalling 361 million words. We conducted a user study for the evaluation of AGNES's search interface, with a small but diverse user group. The evaluation was done by screen capturing and a think aloud protocol, combined with a user interface feedback questionnaire. The evaluation covered both controlled use (completion of a pre-defined task) as well as free use (completion of a freely chosen task). The free use allows us to study the information needs of archaeologists, as well as their interactions with the search system. We conclude that: (1) the information needs of archaeologists are typically recall-oriented, often requiring a list of items as answer; (2) the users prefer the use of free-text queries over metadata filters, confirming the value of a free-text search system; (3) the compilation of a diverse user group contributed to the collection of diverse issues as feedback for improving the system. We are currently refining AGNES's user interface and improving its precision for archaeological entities, so that AGNES will help archaeologists to answer their research questions more effectively and efficiently, leading to a more coherent narrative of the past.

show abstract