A Federated Online Search Tool for Biospecimens (Sample Locator): Usability Study

Abstract

Background The German Biobank Alliance (GBA) aims to establish a cross-site biobank network. For this endeavor, the so-called Sample Locator, a federated search tool for biospecimens and related data, has been developed, forming the heart of its information technology (IT) infrastructure. Objective To ensure the sustainable use of such a tool, we included researchers as participants in an end user–based usability evaluation. Methods To develop a prototype ready for evaluation, we needed input from GBA IT experts. Thus, we conducted a 2-day workshop with 8 GBA IT team members. The focus was on the respective steps of a user-centered design process. With the acquired knowledge, the participants designed low-fidelity mock-ups. The main ideas of these mock-ups were discussed, extracted, and summarized into a comprehensive prototype using Microsoft PowerPoint. Furthermore, we created a questionnaire concerning the usability of the prototype, including the System Usability Scale (SUS), questions on negative and positive aspects, and typical tasks to be fulfilled with the tool. Subsequently, the prototype was pretested on the basis of this questionnaire with researchers who have a biobank background. Based on this preliminary work, the usability analysis was ultimately carried out with researchers and the results were evaluated. Results Altogether, 27 researchers familiar with sample requests evaluated the prototype. The analysis of the feedback certified a good usability, given that the Sample Locator prototype was seen as intuitive and user-friendly by 74% (20/27) of the participants. The total SUS score by the 25 persons that completed the questionnaire was 80.4, indicating good system usability. Still, the evaluation provided useful advice on optimization potential (eg, offering a help function). Conclusions The findings of this usability analysis indicate that the considerations regarding a user-friendly application that have been made in the development process so far strongly coincide with the perception of the study participants. Nevertheless, it was important to engage prospective end users to ensure that the previous development is going in the desired direction and that the Sample Locator will be used in the future. The user comments and suggestions for improvement will be considered in upcoming iterations for refinement.

Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study

“…The mean SUS score of the Sample Locator was 80.4, indicating good usability. Our study showed a similarly high SUS score of 77.03, which also indicates good usability of this tool and supports the results of the study by Schüttler et al [29].…”

“…A usability study by Schüttler et al [ 29 ] with 27 participants rated a mock-up version during the development phase of the Sample Locator as intuitive and user-friendly. The mean SUS score of the Sample Locator was 80.4, indicating good usability.…”

The journey to establishing an IT-infrastructure within the German Biobank Alliance

“…The first usability analysis of the Sample Locator’s graphical user interface was based on a mock-up and came to the conclusion that potential end users found the tool to be intuitive and easy to handle [ 13 ]. A further usability analysis based on the productive system could confirm this impression [ 14 ].…”

“…Though the backend using CQL imposed no restrictions for the “real-life” queries defined by researchers, the generic approach to configure the frontend using a metadata repository and implementing simple logic on fields, values, and operators failed in this regard. To make up for this omission, the team took part in a usability workshop and applied the acquired knowledge in a subsequent evaluation of a sample locator prototype [ 13 ], the results of which could be used in further development. Another lesson learned regarding the graphical interface concerned the framework.…”

“…The first one was based on a prototype of the user interface in the development phase, while the second one was carried out in a comparative analysis of three query builders in productive use. For both, user-friendliness was assessed using the widely used and standardized System Usability Scale [ 12 ] and qualitative questionnaires [ 13 , 14 ]. Moreover, the functionality of an additionally connected donor portal was evaluated by providing the biobanks with a demonstrator, which was then assessed using an exemplary user scenario and an associated checklist.…”