Systematic literature review supported by information retrieval techniques: A case study

Abílio, Ramon; Vale, Gustavo; Pereira, Denilson Alves; Oliveira, Claudiane Maria; Morais, Flávio; Costa, Heitor

doi:10.1109/clei.2014.6965144

Cited by 4 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Elsewhere, capture‐mark‐recapture methods are being borrowed from ecology to aid estimating total number of studies in existence to increase confidence in sample size estimates. Text mining and other techniques from computer science are being experimented with for semi‐automatised screening. If successful, this would markedly increase the manageable size of initial literature sets, thus reducing problems caused by low‐precision searching and allowing for increased search sensitivity.…”

Section: One Methods Among Manymentioning

confidence: 99%

“…Formalisation entails both structuring a practice and situating it within an overall IR logic, while evaluation should consider both records retrieved and impact on review conclusions. Many evaluative studies of IR techniques are heavily number‐focussed, limiting themselves to indicators of precision / specificity and sensitivity / recall (eg, Preston et al, Abilio et al, Ogilvie et al and Savoie et al). While certainly important for searches aiming for statistically valid recall, these concepts are less useful in understanding the value of IR techniques for other sampling logics.…”

Section: One Methods Among Manymentioning

confidence: 99%

See 1 more Smart Citation

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies

Delaney¹,

Tamás²

2017

Research Synthesis Methods

View full text Add to dashboard Cite

Despite recognition that database search alone is inadequate even within the health sciences, it appears that reviewers in fields that have adopted systematic review are choosing to rely primarily, or only, on database search for information retrieval. This commentary reminds readers of factors that call into question the appropriateness of default reliance on database searches particularly as systematic review is adapted for use in new and lower consensus fields. It then discusses alternative methods for information retrieval that require development, formalisation, and evaluation. Our goals are to encourage reviewers to reflect critically and transparently on their choice of information retrieval methods and to encourage investment in research on alternatives.

show abstract

Section: One Methods Among Manymentioning

confidence: 99%

Section: One Methods Among Manymentioning

confidence: 99%

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies

Delaney¹,

Tamás²

2017

Research Synthesis Methods

View full text Add to dashboard Cite

show abstract

“…However, there is not an available tool supporting the strategy. Another approach is presented in [15], whose authors propose two strategies to rank studies according to their importance considering the terms used in the search string: one based on the Vector Model, and the other one based on the simulation of the Boolean expression used in the search string. They are based on the frequency of search string terms found in the title or abstract of a paper.…”

Section: Background and Related Workmentioning

confidence: 99%

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Octaviano

Silva

Fabbri

2016

Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering

View full text Add to dashboard Cite

Context: Systematic Review (SR) is a well-defined and rigorous methodology used to find relevant evidence about a specific topic of interest. Depending on the number of identified primary studies, the selection activity can be very time-consuming and a strategy, like SCAS, to semi-automate this activity can be helpful. Objective: To present an experimental study carried out to evaluate the SCAS strategy. Method: We conducted an experiment to compare the efficiency and effectiveness between participants using SCAS and the manual approach. They received necessary training for applying SCAS using tool support. They were divided into five groups, which conducted SRs based on their research areas. Results: When applying SCAS, the average effort reduction was 22.33%, and the average percentage error was 3.95% with a minimal loss of 1.6 evidence per SR. In addition, results showed an overall precision of 65.49% on an overall recall of 90.24% when using SCAS. The overall Kappa showed that there is a substantial agreement level between the groups and SCAS. Conclusion: The experiment increased the confidence in the strategy, reinforcing that it can reduce the effort required to select primary studies without adversely affecting the overall results of SRs.

show abstract

Automating Systematic Literature Review

Felizardo

Carver

2020

Contemporary Empirical Methods in Software Engineering

View full text Add to dashboard Cite

Systematic literature review supported by information retrieval techniques: A case study

Cited by 4 publications

References 7 publications

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies

Searching for evidence or approval? A commentary on database search in systematic reviews and alternative information retrieval methodologies

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Automating Systematic Literature Review

Contact Info

Product

Resources

About