Presenting software engineering results using structured abstracts: a randomised experiment

Budgen, David; Kitchenham, Barbara; Charters, Stuart; Turner, Mark; Brereton, Pearl; Linkman, Stephen

doi:10.1007/s10664-008-9075-7

Cited by 68 publications

(62 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The measurement is the sorting of articles into the systematic map as explained in Section 2 and Section 3, based on a keywording of abstracts. We often noticed, in line with existing studies, that abstracts often lacked information regarding our categorization scheme and were misleading at times [6]. Mendes, for example, noted a high number of papers designated incorrectly, when using terms incorrectly (for example suggesting a specific research strategy, such as "experiment" [14]).…”

Section: Validity and Reliabilitysupporting

confidence: 57%

Evidence in architecture degradation and consistency checking research

Herold

Blom

Buckley

2016

Proccedings of the 10th European Conference on Software Architecture Workshops

View full text Add to dashboard Cite

Theory suggests that software development may benefit from applying architecture consistency checking and hence, academics have focused on this area. In such circumstances it is important to characterize the overall focus of the field, in order to assess the actual impact of the research work carried out to date, identifying where researchers are placing their effort and which sub-topics are being neglected. In doing so a map is provided for researchers allowing them focus on relevant research gaps and avoiding saturated sub-topics, to deliver results relevant for academia and industrial practice.The goal of this paper is to shed some light on the current state of research in software architecture degradation and consistency checking, particularly focusing on empirical evidence. Preliminary, yet significant results from an ongoing mapping study, as a precursor to a more detailed literature review, are presented and discussed. These results show that solution-proposals constitute a large part of the body of work. In addition, they show that case studies, with potentially limited external validity, are prevalent in terms of empirical design. We argue that the proportion of empirical studies needs to be expanded and that existing case studies should be complemented by experiments and surveys, assessing its impact in practice.

show abstract

Section: Validity and Reliabilitysupporting

confidence: 57%

Evidence in architecture degradation and consistency checking research

Herold

Blom

Buckley

2016

Proccedings of the 10th European Conference on Software Architecture Workshops

View full text Add to dashboard Cite

show abstract

“…These were respectively assessed using a set of 8 questions similar to those employed in previous studies, Budgen et al (2011Budgen et al ( , 2008, and a 10-point Likert-like scale. The completeness score for a specific abstract for each judge was calculated as:…”

Section: Independent and Dependent Variablesmentioning

confidence: 99%

“…In addition, the title and keywords were removed from each abstract. The questions were derived from those used in the previous studies (Budgen et al 2011(Budgen et al , 2008, with modifications to address the restriction of using only those papers that had an empirical element. For the purpose of data collection, each student judge was required to first complete a consent form, then a short form asking for demographic information, and would then receive the four data collection forms in the defined order, 11 and one at a time.…”

Section: Experimental Materialsmentioning

confidence: 99%

Robust Statistical Methods for Empirical Software Engineering

et al. 2016

Self Cite

View full text Add to dashboard Cite

There have been many changes in statistical theory in the past 30 years, including increased evidence that non-robust methods may fail to detect important results. The statistical advice available to software engineering researchers needs to be updated to address these issues. This paper aims both to explain the new results in the area of robust analysis methods and to provide a large-scale worked example of the new methods. We summarise the results of analyses of the Type 1 error efficiency and power of standard parametric and non-parametric statistical tests when applied to non-normal data sets. We identify parametric and non-parametric methods that are robust to non-normality. We present an analysis of a large-scale software engineering experiment to illustrate their use. We illustrate the use of kernel density plots, and parametric and non-parametric methods using four different software engineering data sets. We explain why the methods are necessary and the rationale for selecting a specific analysis. We suggest using kernel density plots rather than box plots to visualise data distributions. For parametric analysis, we recommend trimmed means, which can support reliable tests of the differences between the central location of two or

show abstract

“…This is sometimes hard as many abstracts often omit relevant information [38]. As a consequence, Brereton et al [36] recommend reviewing also the conclusions of the papers in addition to the titles and abstracts.…”

Section: Classification Of Papers and Missing Informationmentioning

confidence: 99%

Adoption of open source software in software-intensive organizations – A systematic literature review

Hauge¹,

Ayala²,

Conradi³

2010

Information and Software Technology

193

113

View full text Add to dashboard Cite

Context: Open source software (OSS) is changing the way organizations develop, acquire, use, and commercialize software. Objective: This paper seeks to identify how organizations adopt OSS, classify the literature according to these ways of adopting OSS, and with a focus on software development evaluate the research on adoption of OSS in organizations. Method: Based on the systematic literature review method we reviewed publications from 24 journals and seven conference and workshop proceedings, published between 1998 and 2008. From a population of 24289 papers, we identified 112 papers which provide empirical evidence on how organizations actually adopt OSS. Results: We show that adopting OSS involves more than simply using OSS products. We moreover provide a classification framework consisting of six distinctly different ways in which organizations adopt OSS. This framework is used to illustrate some of the opportunities and challenges organizations meet when approaching OSS, to show that OSS can be adopted successfully in different ways, and to organize and review existing research. We find that this research does not sufficiently describe the context of the organizations studied. It is furthermore fragmented and fails to benefit fully from related research fields. Finally, we present directions for future research.

show abstract

Presenting software engineering results using structured abstracts: a randomised experiment

Cited by 68 publications

References 20 publications

Evidence in architecture degradation and consistency checking research

Evidence in architecture degradation and consistency checking research

Robust Statistical Methods for Empirical Software Engineering

Adoption of open source software in software-intensive organizations – A systematic literature review

Contact Info

Product

Resources

About