Performance of a Large Language Model in Screening Citations
Takehiko Oami,
Yohei Okada,
Taka-aki Nakada
Abstract:ImportanceLarge language models (LLMs) are promising as tools for citation screening in systematic reviews. However, their applicability has not yet been determined.ObjectiveTo evaluate the accuracy and efficiency of an LLM in title and abstract literature screening.Design, Setting, and ParticipantsThis prospective diagnostic study used the data from the title and abstract screening process for 5 clinical questions (CQs) in the development of the Japanese Clinical Practice Guidelines for Management of Sepsis a… Show more
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.