XCorpus – An executable Corpus of Java Programs.

Abstract

Empirical studies on code require standardized datasets of significant size extracted from real-world programs in order to be reproducible and generalisable. We argue that there is a need for such data sets that are executable and can therefore be used for experiments using static and dynamic analysis. A harness for such a data set should have high coverage in order to facilitate the construction of comprehensive models of program execution.We present XCorpus, a set of 76 executable, real-world Java programs, including a subset of 70 programs from the Qualitas Corpus. XCorpus uses a harness that is a combination of built-in and generated test cases, resulting in a branch coverage that is significantly better than what is available from DaCapo.

Scented since the beginning: On the diffuseness of test smells in automatically generated test code

“…We aim at improving current automated testing tools in a way that they avoid the generation of smelly test suites. Furthermore, we aim at replicating the study taking into account testing tools that work on different programming languages as well as different datasets (e.g., the Xcorpus one [100]).…”

“…Furthermore, we conducted the experiments on a dataset composed of a large number of classes extracted from the SF110 dataset [26]. While previous research [7,24] widely exploited such a dataset, experimenting a different one (e.g., XCorpus [100]) would increases the generalizability of the results. This is part of our future agenda.…”

Casting about in the dark: an empirical study of cast operations in Java programs

“…A number of prior publications selected and curated corpora of projects, for performance benchmarking [Blackburn et al 2006], for static analysis [Tempero et al 2010], for dynamic analysis [Dietrich et al 2017b], and for repository mining in general [Allamanis and Sutton 2013]. Lopes et al [2017] conducted a study to measure code duplication in GitHub.…”

GHTraffic: A Dataset for Reproducible Research in Service-Oriented Computing

“…Standard datasets have been widely used to support research in many other areas of computer science. For instance, the programming language and software engineering communities use datasets such as DaCapo [17] and Qualitas Corpus/XCorpus [18], [19]…”

“…Standard datasets have been widely used to support research in many other areas of computer science. For instance, the programming language and software engineering communities use datasets such as DaCapo [17] and Qualitas Corpus/XCorpus [18], [19] for benchmarking and empirical studies on source code. Sourcerer [20] is an infrastructure for large-scale collection and analysis of open source code.…”