A tertiary study

Imtiaz, Salma; Bano, Muneera; Ikram, Naveed; Niazi, Mahmood

doi:10.1145/2460999.2461025

Cited by 33 publications

(19 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Besides the general guidelines for the search process and search validation described in Section 2, various issues related to search strategies that could affect the search completeness have been discussed in the literature [5,6,8,12,15]. We organized the reported issues into three groups.…”

Section: Related Workmentioning

confidence: 99%

“…The most common issue is the inadequacy of a search strategy in finding relevant publications [5,6,8,12,15], which directly affects the search completeness. Ampatzoglou et al [5,6] discussed the issue via one of their proposed validity categories, namely study selection validity.…”

Section: Related Workmentioning

confidence: 99%

“…They also noted that using any synonyms of experiment alone would omit a huge set of relevant papers when searching articles reporting software engineering experiments. Imitiaz et al [15], in their tertiary study, discussed different issues which could affect the adequacy of relevant publication in SLRs. These issues are search terms with many synonyms and unknown alternatives, the trade-off between generic and specific search string, search approaches (automated, manual, snowball sampling) selection, search level (title, abstract, keywords) and abstract quality.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Tran¹,

Börstler²,

Ali³

et al. 2022

EISEJ

View full text Add to dashboard Cite

Background: Systematic literature studies (SLS) have become a core research methodology in Evidence-based Software Engineering (EBSE). Search completeness, i.e., finding all relevant papers on the topic of interest, has been recognized as one of the most commonly discussed validity issues of SLSs. Aim: This study aims at raising awareness on the issues related to search string construction and on search validation using a quasi-gold standard (QGS). Furthermore, we aim at providing guidelines for search string validation. Method: We use a recently completed tertiary study as a case and complement our findings with the observations from other researchers studying and advancing EBSE. Results: We found that the issue of assessing QGS quality has not seen much attention in the literature, and the validation of automated searches in SLSs could be improved. Hence, we propose to extend the current search validation approach by the additional analysis step of the automated search validation results and provide recommendations for the QGS construction. Conclusion: In this paper, we report on new issues which could affect search completeness in SLSs. Furthermore, the proposed guideline and recommendations could help researchers implement a more reliable search strategy in their SLSs.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Tran¹,

Börstler²,

Ali³

et al. 2022

EISEJ

View full text Add to dashboard Cite

show abstract

“…Imtiaz, Bano, Ikram y Niazi [5] elaboran un estudio terciario a partir de experiencias elaborando RSL en la ingeniería de software proponiendo un protocolo de direccionamiento el cual define la estrategia de investigación y las fases que componen una RSL comenzando por la pregunta de investigación, la estrategia de búsqueda, el cadena de búsqueda, criterios de inclusión/exclusión, evaluación de la calidad, extracción de datos y síntesis de los datos, poniendo énfasis en el cuidado de cada fase de la investigación para lograr una mejor practica de realizar una RSL.…”

Section: Trabajo Relacionadounclassified

Estructuras metodológicas de revisiones sistemáticas de literatura en Ingeniería de Software: un estudio de mapeo sistemático

Carrizo

Moller

2018

Ingeniare. Rev. chil. ing.

View full text Add to dashboard Cite

Las revisiones sistemáticas de literatura se han convertido en una metodología importante dentro de la investigación de la ingeniería de software. Al aplicar esta metodología los aspectos críticos están relacionados con lograr un diseño y una ejecución apropiada, como también una estrategia de búsqueda efectiva. De allí la necesidad por encontrar enfoques de diseño, ejecución y evaluación, para extraer de manera óptima la información desde la literatura científica. El objetivo principal de esta investigación es analizar la estructura metodológica de las revisiones sistemáticas de literatura, llevadas a cabo en Ingeniería de Software evidenciando la evolución de las distintas etapas consideradas. Para esto, se realizó un estudio de mapeo sistemático utilizando las publicaciones en los últimos 8 años en las bases de datos Scopus y Wos. El estudio arrojó 13 revisiones que se focalizan principalmente en áreas de Calidad y Desarrollo. Además, los resultados muestran que aunque las revisiones utilizan una metodología similar, pocas consideran una agregación de evidencia. Las conclusiones principales del estudio apuntan a que los investigadores prefieren realizar revisiones dentro de áreas muy acotadas dentro de la Ingeniería de Software como es el caso del área de desarrollo y calidad, así como también que prefieren investigaciones no tan exhaustivas como son el mapeo sistemático por sobre las revisiones sistemáticas. Palabras clave: Revisión sistemática de literatura, estudio de mapeo sistemático, ingeniería de software.

show abstract

“…SLR conduction involves diverse challenges (IMTIAZ et al, 2013;CARVER et al, 2013;FELIZARDO et al, 2020b) especially for novice researchers (RIAZ et al, 2010a;IWAZAKI et al, 2022). Several of these challenges were already discussed in the literature, for instance, the lack of rigor of researchers in following well-experimented guidelines for SLR directly impacting the SLR quality (KUHRMANN et al, 2017) and poor documentation of SLR (BUDGEN et al, 2018a).…”

Section: Problem Statementmentioning

confidence: 99%

Sustainability of Systematic Literature Reviews

Santos

View full text Add to dashboard Cite

Context: Systematic Literature Review (SLR) has been increasingly adopted in Software Engineering (SE) because it is considered the most reliable way to gather evidence from the literature. At the same time, SLR currently consumes much time and effort to be conducted, and its results have not impacted the software industry as expected. Despite several solutions proposed to solve the problems of SLR, the research remains very fragmented failing to provide a bigger picture of the problems and associated solutions. Objective: This study introduces the concept of sustainability in SLRs to the SE community as a holistic view of the current research scenario putting together a solid knowledge base that includes definitions, guidelines, and the main leveraging points of sustainability in current SLR conducted in SE. Method: After conducting a tertiary study investigating the main characteristics of sustainability of software systems, we applied the meta-ethnographic method to transpose sustainability characteristics into SLR context by identifying, adapting, synthesizing, and validating those which could aid researchers in conducting more useful studies with less effort. Finally, we extracted a sample of high-quality studies conducted in the SE area, next, we applied a sustainability view to identify the flaws that lead to unsustainable SLR. Results: Our study provides an overview of the role of sustainability in the SLR context and provides important assets for SE community to identify what are sustainable SLR, such as 15 characteristics of sustainable SLR and 15 sensitive points of SLR process that are considered critical factors to achieve sustainability. In addition, we propose 16 guidelines to support researchers to improve sustainability in their SLR and identified 13 leveraging points found in relevant studies in SE area that together represent actions that should be adopted immediately to enhance the sustainability of SLR. Conclusion: Our work represents a starting point for a mindset shift in the SE community about the importance of creating more sustainable reviews. Furthermore, we believe that sustainability is the missing key concept that could connect many advances achieved over the years of research and remove barriers that hinder SLR from providing useful information in a timely manner for academia and industry. Henceforth, we believe that researchers should observe sustainability as a first-class citizen while conducting/updating SLR to make them compatible with the sustainability view.

show abstract

A tertiary study

Cited by 33 publications

References 13 publications

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Estructuras metodológicas de revisiones sistemáticas de literatura en Ingeniería de Software: un estudio de mapeo sistemático

Sustainability of Systematic Literature Reviews

Contact Info

Product

Resources

About