A Process-Oriented Environment for the Execution of Software Engineering Experiments

Freire, Marília; Sizílio, Gustavo; Campos, Edmilson; Kulesza, Uirá; Aranha, Eduardo

doi:10.1007/978-3-319-13835-0_24

Cited by 1 publication

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Knowledge is what should be communicated from an SE experiment; thus, it should be treated somehow to be stored, classified, and transmitted for internalization or externalization purposes. At present, knowledge is managed using software applications or web-oriented platforms [3], [29]. As knowledge refers to more complex information, it needs more complex tools that enable tracking changes and time [30].…”

Section: B Knowledge Management Generated During An Software Engineementioning

confidence: 99%

Resources for Reproducibility of Experiments in Empirical Software Engineering: Topics Derived From a Secondary Study

Anchundia

Fonseca

2020

IEEE Access

View full text Add to dashboard Cite

Background: Replication is a recurrent issue in empirical software engineering (ESE). Although it is a foundation of science, replication is hard to execute despite the many supporting tools meant to facilitate reproducibility. For example, in an experiment, which is the most used method in ESE, the number of replications is not enough compared to other sciences. Objective: In this study, we aim to identify tools that maximize reproducibility in software engineering experiments and how they are applied. Methods: We performed a Systematic Mapping Study and complementary strategies to analyze replication from three concerns (communication, knowledge management, and motivation). We analyzed more than 2,600 studies to get 40 primary studies, using a qualitative analytical tool (Atlas.ti) to create semantic maps for synthesizing our results. Result: We found that tools and practices depend on the experiment domain. Human-oriented experiments tend to use an informal mechanism that is costly and time-consuming. On the other hand, technology-oriented experiments are automated, domain-centric, and specialized so they require a learning process and are not transferable to other domains. Conclusion: Tools and practices still lack acceptation and usability among the ESE research community. Therefore, reproducibility is mostly relegated to internal replication, at which time and costs can be assumed within research groups. A focus on new alternatives should be considered to broaden replication.

show abstract

Section: B Knowledge Management Generated During An Software Engineementioning

confidence: 99%

Resources for Reproducibility of Experiments in Empirical Software Engineering: Topics Derived From a Secondary Study

Anchundia

Fonseca

2020

IEEE Access

View full text Add to dashboard Cite

show abstract

A Process-Oriented Environment for the Execution of Software Engineering Experiments

Cited by 1 publication

References 8 publications

Resources for Reproducibility of Experiments in Empirical Software Engineering: Topics Derived From a Secondary Study

Resources for Reproducibility of Experiments in Empirical Software Engineering: Topics Derived From a Secondary Study

Contact Info

Product

Resources

About