Debugging temporal specifications with concept analysis

Ammons, Glenn; Mandelin, David; Bodík, Rastislav; Larus, James R.

doi:10.1145/780822.781152

Cited by 27 publications

(25 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The full concept lattice is depicted on the left side of Figure 1 Snelting first introduced the idea of concept analysis for use in software engineering tasks, specifically for configuration analysis [32]. Concept analysis has also been applied to evaluating class hierarchies [33], debugging temporal specifications [34], redocumentation [35], and recovering components [36]- [39]. Ball introduced the use of concept analysis of test coverage data to compute dynamic analogs to static control flow relationships [40].…”

Section: Concept Analysismentioning

confidence: 99%

Applying Concept Analysis to User-Session-Based Testing of Web Applications

Sampath

Sprenkle

Gibson

et al. 2007

IIEEE Trans. Software Eng.

100

View full text Add to dashboard Cite

The continuous use of the web for daily operations by businesses, consumers, and the government has created a great demand for reliable web applications. One promising approach to testing the functionality of web applications leverages user-session data collected by web servers. User-session-based testing automatically generates test cases based on real user profiles. The key contribution of this paper is the application of concept analysis for clustering user sessions and a set of heuristics for test case selection. Existing incremental concept analysis algorithms are exploited to avoid collecting and maintaining large user-session data sets and thus to provide scalability. We have completely automated the process from user session collection and test suite reduction through test case replay. Our incremental test suite update algorithm coupled with our experimental study indicate that concept analysis provides a promising means for incrementally updating reduced test suites in response to newly captured user sessions with little loss in fault detection capability and program coverage.

show abstract

Section: Concept Analysismentioning

confidence: 99%

Applying Concept Analysis to User-Session-Based Testing of Web Applications

Sampath

Sprenkle

Gibson

et al. 2007

IIEEE Trans. Software Eng.

100

View full text Add to dashboard Cite

show abstract

“…False is defined as ⊥ ≡ ¬ . In this paper, we assume that Bounded-MITL (3,2) formula is in Negation Normal Form (NNF) 4 where the negation operation is only applied on atomic propositions. NNF is easily obtainable by applying DeMorgan's Law, i.e ¬3 I ϕ ≡ 2 I ¬ϕ and ¬2 I ϕ ≡ 3 I ¬ϕ.…”

Section: A Metric Interval Temporal Logicmentioning

confidence: 99%

“…If the top operation of ϕ is a temporal operator (2 I , 3 I ), then the effective interval is modified according to Definition 10 and the interval I ← I ⊕ I is propagated to the subformulas of ϕ. For example, assume that the MITL specification is ϕ RR = 2 [1,2] (3 [3,5] b ⇒ (2 [4,6] (c ⇒ 3 [0,2] d))). The specification ϕ has two antecedents, α 1 = 3 [3,5] [5,8], respectively.…”

Section: Definition 8 (Request-response Mitl)mentioning

confidence: 99%

“…However, the specification ϕ is a tautology!, i.e. it Specification debugging can also be considered in areas such as system synthesis [43] and software verification [4]. In system synthesis, realizability is an important factor, which checks whether the system is implementable given the constraints (environment) and requirements (specification) [23], [35], [15], [43].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Formal Requirement Debugging for Testing and Verification of Cyber-Physical Systems

Dokhanchi

Hoxha

Fainekos

2017

ACM Trans. Embed. Comput. Syst.

View full text Add to dashboard Cite

A framework for the elicitation and debugging of formal specifications for Cyber-Physical Systems is presented. The elicitation of specifications is handled through a graphical interface. Two debugging algorithms are presented. The first checks for erroneous or incomplete temporal logic specifications without considering the system. The second can be utilized for the analysis of reactive requirements with respect to system test traces. The specification debugging framework is applied on a number of formal specifications collected through a user study. The user study establishes that requirement errors are common and that the debugging framework can resolve many insidious specification errors 1 . evaluates to true no matter what the system behavior is and, thus, the requirement ϕ is invalid. This is because, if at some time t between 0 and 30 seconds the predicate (v > 100) is false, then the implication (⇒) will trivially evaluate to true at time t and, thus, ϕ will evaluate to true as well. On the other hand, if the predicate (v > 100) is true for all time between 0 and 30 seconds, then the subformula 2 [0,20] (v > 100) will be true at all time between 0 and 10 seconds. This means that the subformula (v > 100) ⇒ 2 [0,20] (v > 100) is true at all time between 0 and 10 seconds. Thus, again, ϕ evaluates to true, which means that ϕ is a tautology.This implies that specification issues are not necessarily artifacts of the graphical user interface and that they can happen even for users who are familiar with temporal logics. Hence, specification elicitation can potentially become an issue as formal and semi-formal testing and verification methods and tools are being adopted by industry. This is because specification elicitation can be performed by untrained users. Therefore, effort can be wasted in checking incorrect requirements, or even worse, the system can pass the incorrect requirements. Clearly, this can lead to a false sense of system correctness, which leads us to the second question: What can be done in an automated way to prevent specification errors in CPS?In this work, we have developed a specification debugging framework to assist in the elicitation of formal requirements. The specification debugging algorithm identifies some of the logical issues in the specifications, but not all of them. Namely, it performs the following: 1) Validity detection: the specification is unsatisfiable or a tautology. 2) Redundancy detection: the formula has redundant conjuncts.3) Vacuity detection: some subformulas do not affect the satisfiability of the formula.Redundancy and vacuity issues usually indicate some misunderstanding in the requirements. As a result, a wide class of specification errors in the elicitation process can be corrected before any test and verification process is initiated. However, some specification issues cannot be detected unless we consider the system, and test the system behaviors with respect to the specification. We provide algorithms to detect specification vacuity with respect to system trace...

show abstract

“…In this paper, we describe our work in analyzing user session data. By making minimal configuration changes to a web server, data can be collected as a set of user sessions, each session being a sequence of URL and namevalue pairs 1 . The collection of logged user sessions can be viewed as a set of use cases where a use case is a behaviorally related sequence of events performed by the user through a dialogue with the system [11].…”

Section: Introductionmentioning

confidence: 99%

Towards defining and exploiting similarities in Web application use cases through user session analysis

Sampath¹

2004

"Second International Workshop on Dynamic Analysis (WODA 2004)" W10S Workshop - 26th International Conference on Software Engin

View full text Add to dashboard Cite

With the highly increased use of the web comes a significant demand to provide more reliable web applications. By learning more about the usage and dynamic behavior of these applications, we believe that some software development and maintenance tools can be designed with increased cost-effectiveness. In this paper, we describe our work in analyzing user session data. Particularly, the main contributions of this paper are the analysis of user session data with concept analysis, an experimental study of user session data analysis with two different types of web software, and an application of user session analysis to scalable test case generation for web applications. In addition to fruitful experimental results, the techniques and metrics themselves provide insight into future approaches to analyzing the dynamic behavior of web applications.

show abstract

Debugging temporal specifications with concept analysis

Cited by 27 publications

References 18 publications

Applying Concept Analysis to User-Session-Based Testing of Web Applications

Applying Concept Analysis to User-Session-Based Testing of Web Applications

Formal Requirement Debugging for Testing and Verification of Cyber-Physical Systems

Towards defining and exploiting similarities in Web application use cases through user session analysis

Contact Info

Product

Resources

About