VerifyThis 2012

Huisman, Marieke; Klebanov, Vladimir; Monahan, Rosemary

doi:10.1007/s10009-015-0396-8

Cited by 28 publications

(13 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…CASC evaluates the performance of sound, fully automatic, classical logic Automated Theorem Proving (ATP) systems. The evaluation is [27,32,40,[51][52][53][54][55][56] in terms of: the number of problems solved, the number of problems solved with a solution output, and the average runtime for problems solved; in the context of: a bounded number of eligible problems, chosen from the TPTP Problem Library, and specified time limits on solution attempts. CASC is the longest running of the various logic solver competitions, with the 25th event to be held in 2020.…”

Section: Casc: the Cade Atp System Competitionmentioning

confidence: 99%

TOOLympics 2019: An Overview of Competitions in Formal Methods

Bartocci

Beyer

Black³

et al. 2019

Tools and Algorithms for the Construction and Analysis of Systems

Self Cite

View full text Add to dashboard Cite

Evaluation of scientific contributions can be done in many different ways. For the various research communities working on the verification of systems (software, hardware, or the underlying involved mechanisms), it is important to bring together the community and to compare the state of the art, in order to identify progress of and new challenges in the research area. Competitions are a suitable way to do that. The first verification competition was created in 1992 (SAT competition), shortly followed by the CASC competition in 1996. Since the year 2000, the number of dedicated verification competitions is steadily increasing. Many of these events now happen regularly, gathering researchers that would like to understand how well their research prototypes work in practice. Scientific results have to be reproducible, and powerful computers are becoming cheaper and cheaper, thus, these competitions are becoming an important means for advancing research in verification technology. TOOLympics 2019 is an event to celebrate the achievements of the various competitions, and to understand their commonalities and differences. This volume is dedicated to the presentation of the 16 competitions that joined TOOLympics as part of the celebration of the 25 th anniversary of the TACAS conference.

show abstract

Section: Casc: the Cade Atp System Competitionmentioning

confidence: 99%

TOOLympics 2019: An Overview of Competitions in Formal Methods

Bartocci

Beyer

Black³

et al. 2019

Tools and Algorithms for the Construction and Analysis of Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…More background information on the competition format and the rationale behind it can be found in [10]. Reports from previous competitions of similar nature can be found in [2,8,15], and in the special issue of the international journal on software tools for technology transfer (STTT) on the VerifyThis competition 2012 (see [11] for the introduction).…”

Section: Verifythis 2015mentioning

confidence: 99%

VerifyThis 2015

Huisman

Klebanov

Monahan

et al. 2016

Int J Softw Tools Technol Transfer

Self Cite

View full text Add to dashboard Cite

VerifyThis 2015 was a one-day program verification competition which took place on April 12th, 2015 in London, UK, as part of the European Joint Conferences on Theory and Practice of Software (ETAPS 2015). It was the fourth instalment in the VerifyThis competition series. This article provides an overview of the VerifyThis 2015 event, the challenges that were posed during the competition, and a high-level overview of the solutions to these challenges. It concludes with the results of the competition and some ideas and thoughts for future instalments of VerifyThis.

show abstract

“…Related Competitions. It is well-understood that competitions are an important evaluation method, and there are other competitions in the field of software verification: RERS 4 [40] and VerifyThis 5 [41]. While SV-COMP performs replicable experiments in a controlled environment (dedicated resources, resource limits), the RERS Challenges give more room for exploring combinations of interactive with automatic approaches without limits on the resources, and the VerifyThis Competition focuses on evaluating approaches and ideas rather than on fully automatic verification.…”

Section: Introductionmentioning

confidence: 99%

Automatic Verification of C and Java Programs: SV-COMP 2019

Beyer

2019

Tools and Algorithms for the Construction and Analysis of Systems

View full text Add to dashboard Cite

This report describes the 2019 Competition on Software Verification (SV-COMP), the 8 th edition of a series of comparative evaluations of fully automatic software verifiers for C programs, and now also for Java programs. The competition provides a snapshot of the current state of the art in the area, and has a strong focus on replicability of its results. The repository of benchmark verification tasks now supports a new, more flexible format for task definitions (based on YAML), which was a precondition for conveniently benchmarking Java programs in the same controlled competition setting that was successfully applied in the previous years. The competition was based on 10 522 verification tasks for C programs and 368 verification tasks for Java programs. Each verification task consisted of a program and a property (reachability, memory safety, overflows, termination). SV-COMP 2019 had 31 participating verification systems from 14 countries.

show abstract

VerifyThis 2012

Cited by 28 publications

References 26 publications

TOOLympics 2019: An Overview of Competitions in Formal Methods

TOOLympics 2019: An Overview of Competitions in Formal Methods

VerifyThis 2015

Automatic Verification of C and Java Programs: SV-COMP 2019

Contact Info

Product

Resources

About