MeSH and text-word search strategies: precision, recall, and their implications for library instruction

Abstract

Objective: This study compared the recall and precision of MeSH-term versus text-word searching to better understand psychosocial MeSH terms and to provide guidance on whether to include both strategies in an information literacy session or how much time should be spent on teaching each search strategy. Methods: Using the relevant recall method, a total of 3,162 resources were considered and evaluated to form a gold standard set of 1,521 relevant resources. We compared resources discussing psychosocial aspects of children and adolescents living with type 1 diabetes using two search strategies: text-word strategy versus MeSH-term strategy. The frequency of MeSH terms, the MeSH hierarchy, and elements of each search strategy were also examined. Results: Using the 1,521 relevant articles, we found that the text-word search strategy had 54% recall, while the MeSH-term strategy had 75% recall. Also, the precision of the text-word strategy was 34.4%, while the precision of the MeSH-term strategy was 47.7%. Therefore, the MeSH-term search strategy yielded both greater recall and greater precision. The MeSH strategy was also more complicated in design and usage than the text-word strategy. Conclusions: This study demonstrates the effectiveness of text-word and MeSH search strategies on precision and recall. The combination of text-word and MeSH strategies is recommended to achieve the most comprehensive results. These results support the idea that MeSH or a similar controlled vocabulary should be taught to experienced and knowledgeable students and practitioners who require a myriad of resources for their literature searches.

Supervised Relation Extraction Between Suicide-Related Entities and Drugs: Development and Usability Study of an Annotated PubMed Corpus

“…However, the indexing time of MeSH is likely to miss the latest relevant articles [ 62 ]. DeMars and Perrusso [ 63 ] compared the precision and recall of each strategy after searching for relevant articles using MeSH and text words in PubMed. They recommended combining MeSH and text words to obtain the most comprehensive number of papers.…”

Recognizing the value of meta-research and making it easier to find

“…In fact, a fair amount of research being published in journals like the Journal of the Medical Library Association are examples of meta-research, even if they are not labeled as such. Examples of meta-research scholarship published in the Journal of the Medical Library Association include: bibliometric research exploring the presence of predatory journal publications in published literature reviews [ 7 ] and the creation of research performance metrics; [ 8 ] discussion around the implications of authorship order; [ 9 ] exploration of the challenges to research collaborations [ 10 ] and the roles played by librarians in systematic reviews; [ 11 ] study of the training needs and motivations of researchers [ 12 ] and librarians; [ 13 ] examination of the weaknesses in current publishing practices; [ 14 ] and the development [ 15 ] and assessment of search strategies [ 13 ].…”

“…Meta-research could strongly benefit from the establishment of its own indexing terms to increase the field's visibility and propel its research forward, as it is currently difficult to locate meta-research within citation databases which lack controlled vocabulary for meta-research [ 13 , 17 - 18 ]. As a discipline designed to study research itself and its practices, meta-research is not only multidisciplinary, but also comparably new as a distinct research field [ 4 , 5 ].…”

Mapping the Bibliometrics Landscape of AI in Medicine: Methodological Study

“…In addition, we incorporated the entry terms associated with the deep learning MeSH tag into our search criteria. This search strategy has been shown to enhance the efficiency of the literature review [31].…”