Guidelines for Promoting Software Product Line Experiments

Furtado, Viviane R.; OliveiraJr, Edson; Kalinowski, Marcos

doi:10.1145/3483899.3483909

Cited by 7 publications

(3 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When analyzing Figure 2, different elements can be noticed, such as conceptual model, recommender systems, ontology, trusted repositories, and model types. The conceptual model, the ontology, and the recommendation system are related to structures developed for recording and using experimental data [Furtado et al 2021, Vignando et al 2020. The model types are related to metadata (curation, data management, provenance, and preservation) and OS practices.…”

Section: Proposal Of Solutionmentioning

confidence: 99%

See 1 more Smart Citation

Towards a Framework Based on Open Science Practices for Promoting Reproducibility of Software Engineering Controlled Experiments

Cordeiro

2023

Anais Do XXVI Congresso Ibero-Americano Em Engenharia De Software (CIbSE 2023)

View full text Add to dashboard Cite

Experimentation in Software Engineering has increased in the last decades as a way to provide evidence on theories and technologies. In a controlled experiment life cycle, several artifacts are used/reused and even produced. Such artifacts are mostly in the form of data, which should favor the reproducibility of such experiments. In this context, reproducibility can be defined as the ability to reproduce a study. Different benefits, such as methodology and data reuse, can be achieved from this ability. Despite the recognized benefits, several challenges have been faced by researchers regarding the experiments’ reproducibility capability. To overcome them, we understand that Open Science practices, related to provenance, preservation, and curation, might aid in improving such a capability. Therefore, in this paper, we present the proposal for an open science-based Framework to deal with controlled experiment research artifacts towards making such experiments de facto reproducible. To do so, different models associated with open science practices are planned to be integrated into the Framework.

show abstract

Section: Proposal Of Solutionmentioning

confidence: 99%

“…For this definition, different experimental structures can be considered [Furtado et al 2021, Vignando et al 2020, Jedlitschka et al 2008…”

Section: Research Agendamentioning

confidence: 99%

Towards a Framework Based on Open Science Practices for Promoting Reproducibility of Software Engineering Controlled Experiments

Cordeiro

2023

Anais Do XXVI Congresso Ibero-Americano Em Engenharia De Software (CIbSE 2023)

View full text Add to dashboard Cite

show abstract

“…To do so, in previous works, our research group has carried out research on experiments formalization by: providing a panorama on how experiments are performed in SE; creating a set of guidelines to proper documenting SE experiments [Furtado et al 2021]; and specifying a conceptual model to support the creation of an ontology for SE experiments [Vignando et al 2020]. In recent studies, it was observed the possibility to incorporate practices related to the Open Science (OS) 2 context.…”

Section: Introductionmentioning

confidence: 99%

Towards an Open Science-Based Framework for Software Engineering Controlled (Quasi-)Experiments

Cordeiro¹,

OliveiraJr²,

Capretz³

2022

Anais Do XVI Brazilian E-Science Workshop (BRESCI 2022)

Self Cite

View full text Add to dashboard Cite

Experimental Software Engineering has straightforwardly evolved in the last decades due to the effort of the community in providing consolidated training, teaching and practice. Particularly, for controlled experiments and quasi-experiments, the software engineering community has discussed on the lack of reproducibility and the missing of experimental artifacts sharing policies, such as, dataset, baselines, metamodels, repositories, and scripts. These are, therefore, important issues that jeopardizes controlled experimentation to evolve as rigorous as in millennial sciences as Medicine and Physics. In this ongoing work, it is presented a proposal of a conceptual framework for software engineering controlled experiments and quasi-experiments based on the main principles and practices of Open Science. It is understood that Open Science is one of the pillars to the evolution of science, consequently, to software engineering. The FAIR data, metadata, repositories, curation and provenance are some of the main practices discussed in this paper. Ongoing activities are described, in terms of how they are being performed and their relationship with prospective ones.

show abstract