Background: Systematic reviews, i.e., research summaries that address focused questions in a structured and reproducible manner, are a cornerstone of evidence-based medicine and research. However, certain systematic review steps such as data extraction are labour-intensive which hampers their applicability, not least with the rapidly expanding body of biomedical literature. Objective: To bridge this gap, we aimed at developing a data mining tool in the R programming environment to automate data extraction from neuroscience in vivo publications. The function was trained on a literature corpus (n=45 publications) of animal motor neuron disease studies and tested in two validation corpora (motor neuron diseases, n=31 publications; multiple sclerosis, n=244 publications). Results: Our data mining tool Auto-STEED (Automated and STructured Extraction of Experimental Data) was able to extract key experimental parameters such as animal models and species as well as risk of bias items such as randomization or blinding from in vivo studies. Sensitivity and specificity were over 85 and 80%, respectively, for most items in both validation corpora. Accuracy and F-scores were above 90% and 0.9 for most items in the validation corpora. Time savings were above 99%. Conclusions: Our developed text mining tool Auto-STEED is able to extract key experimental parameters and risk of bias items from the neuroscience in vivo literature. With this, the tool can be deployed to probe a field in a research improvement context or to replace one human reader during data extraction resulting in substantial time-savings and contribute towards automation of systematic reviews. The function is available on Github.
Background: Systematic reviews, i.e., research summaries that address focused questions in a struc-tured and reproducible manner, are a cornerstone of evidence-based medicine and research. However, certain systematic review steps such as data extraction are labour-intensive which hampers their ap-plicability, not least with the rapidly expanding body of biomedical literature.Objective: To bridge this gap, we aimed at developing a data mining tool in the R programming envi-ronment to automate data extraction from neuroscience in vivo publications. The function was trained on a literature corpus (n=45 publications) of animal motor neuron disease studies and tested in two validation corpora (motor neuron diseases, n=31 publications; multiple sclerosis, n=244 publications).Results: Our data mining tool Auto-STEED (Automated and STructured Extraction of Experimental Data) was able to extract key experimental parameters such as animal models and species as well as risk of bias items such as randomization or blinding from in vivo studies. Sensitivity and specificity were over 85 and 80%, respectively, for most items in both validation corpora. Accuracy and F-scores were above 90% and 0.9 for most items in the validation corpora. Time savings were above 99%.Conclusions: Our developed text mining tool Auto-STEED is able to extract key experimental param-eters and risk of bias items from the neuroscience in vivo literature. With this, the tool can be deployed to probe a field in a research improvement context or to replace one human reader during data extrac-tion resulting in substantial time-savings and contribute towards automation of systematic reviews. The function is available on Github.
Background: Systematic reviews, i.e., research summaries that address focused questions in a structured and reproducible manner, are a cornerstone of evidence-based medicine and research. However, certain systematic review steps such as data extraction are labour-intensive which hampers their applicability, not least with the rapidly expanding body of biomedical literature. To bridge this gap, we aimed at developing a data mining tool in the R programming environment to automate data extraction from neuroscience in vivo publications. The function was trained on a literature corpus (n=45 publications) of animal motor neuron disease studies and tested in two validation corpora (motor neuron diseases, n=31 publications; multiple sclerosis, n=244 publications). Results: Our data mining tool Auto-STEED (Automated and STructured Extraction of Experimental Data) was able to extract key experimental parameters such as animal models and species as well as risk of bias items such as randomization or blinding from in vivo studies. Sensitivity and specificity were over 85 and 80%, respectively, for most items in both validation corpora. Accuracy and F-scores were above 90% and 0.9 for most items in the validation corpora. Time savings were above 99%. Conclusions: Our developed text mining tool Auto-STEED that can extract key experimental parameters and risk of bias items from the neuroscience in vivoliterature. With this, the tool can be deployed to probe a field in a research improvement context or to replace one human reader during data extraction resulting in substantial time-savings and contribute towards automation of syste99matic reviews. The function is available on Github.
Background and objectivesAnimal models for motor neuron diseases (MND) such as amyotrophic lateral sclerosis (ALS) are commonly used in preclinical research. However, it is insufficiently understood how much findings from these model systems can be translated to humans. Thus, we aimed at systematically assessing the translational value of MND animal models to probe their external validity with regards to magnetic resonance imaging (MRI) features.MethodsIn a comprehensive literature search in PubMed and Embase, we retrieved 201 unique publications of which 34 were deemed eligible for qualitative synthesis including risk of bias assessment.ResultsALS animal models can indeed present with human ALS neuroimaging features: Similar to the human paradigm, (regional) brain and spinal cord atrophy as well as signal changes in motor systems are commonly observed in ALS animal models. Blood-brain barrier breakdown seems to be more specific to ALS models, at least in the imaging domain. It is noteworthy that the G93A-SOD1 model, mimicking a rare clinical genotype, was the most frequently used ALS proxy.ConclusionsOur systematic review provides high-grade evidence that preclinical ALS models indeed show imaging features highly reminiscent of human ALS assigning them a high external validity in this domain. This opposes the high attrition of drugs during bench-to-bedside translation and thus raises concerns that phenotypic reproducibility does not necessarily render an animal model appropriate for drug development. These findings emphasize a careful application of these model systems for ALS therapy development thereby benefiting refinement of animal experiments.Systematic review registrationhttps://www.crd.york.ac.uk/PROSPERO/, identifier: CRD42022373146.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.