A rigorous approach towards test case generation

Ding, Zuohua; Zhang, Kao; Hu, Jueliang

doi:10.1016/j.ins.2008.06.020

Cited by 15 publications

(6 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Published research in the general area of concurrent program testing has covered aspects such as failure injection , static analysis , controlled execution , mutation testing , model checking , model‐based testing , coverage testing , symbolic analysis , reachability testing and test case generation . In this section are discussed only the relevant related research.…”

Section: Related Workmentioning

confidence: 99%

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs

Souza

Brito

et al. 2015

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARYTesting is a key activity to assure the quality of concurrent applications. In recent years, a variety of different mechanisms have been proposed to test concurrent software. However, a persistent problem is the high testing cost because of the large number of different synchronization sequences that must be tested. When structural testing criteria are adopted, a large number of infeasible synchronization sequences is generated, increasing the testing cost. Although the use of reachability testing reduces the number of infeasible combination (because only feasible synchronization sequences are generated), many synchronization combinations are also generated, and this again results in a testing cost with exponential behavior. This paper presents a new composite approach that uses reachability testing to guide the selection of the synchronization sequences tests according to a specific structural testing criterion. This new composite approach is empirically evaluated in the context of message-passing concurrent programs developed with MPI. The experimental study evaluates both the cost and effectiveness of proposed composite approach in comparison with traditional reachability testing and structural testing. The results confirm that the use of the new composite approach has advantages for testing of concurrent applications. Copyright © 2015 John Wiley & Sons, Ltd. KEY WORDS: structural testing; reachability testing; concurrent programs; experimental study INTRODUCTIONConcurrent software is being increasingly used with the availability of multicore processors and computer clusters. Many modern business applications now use concurrency to improve overall system performance. However, all concurrent software contains features, such as nondeterminism, synchronization, and interprocess communication, which make concurrent software significantly more complex than sequential software. These features impose new challenges for testing and increase the difficulty of demonstrating the correct execution of the application in all possible conditions. Traditional testing techniques are often not well-suited to the testing of concurrent (or parallel) software. Many researchers have developed specific testing techniques to address specific issues such as nondeterminism, concurrency, communication, synchronization, race conditions, and replay testing [1][2][3][4][5][6][7][8][9][10][11].In previous work, structural testing criteria for concurrent programs were proposed by Souza et al. [12], defining test models and tools to test message-passing software. This work was extended by Sarmanho et al. [13] to test shared-memory software. These structural testing criteria are designed to explore information about the control, data, and communication flows of concurrent programs, considering both their sequential and parallel aspects. These contributions are related to the coverage analysis concept, in which a coverage model is first defined, and then the model is evaluated during the execution of the program to determine whether th...

show abstract

Section: Related Workmentioning

confidence: 99%

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs

Souza

Brito

et al. 2015

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…They can be classified in several different ways, considering for example static or dynamic approaches and shared‐memory and/or message‐passing paradigms and also considering the language and/or standard used. The published papers are distributed over a number of discrete testing topics, such as failure injection , formal verification , static analysis , testing‐driven development , controlled execution , mutation testing , model checking , model‐based testing , structural testing , symbolic analysis , search‐based testing , interleaving coverage testing , probabilistic concurrency testing , reachability testing , and test case generation .…”

Section: Related Workmentioning

confidence: 99%

Structural testing for message‐passing concurrent programs: an extended test model

Souza

Zaluska

2012

Concurrency and Computation

View full text Add to dashboard Cite

SUMMARYDeveloping high-quality, error-free message-passing concurrent programs is not trivial. Although a number of different primitives with associated semantics are available to assist such development, they often increase the complexity of the testing process. In this paper, we extend our previous test model for messagepassing programs and present new structural testing criteria, taking into account additional features used in this paradigm, such as collective communication, non-blocking sends, distinct semantics for non-blocking receives, and persistent operations. Our new model also recognizes that sender primitives cannot always be matched with every receive primitive. This improvement allows us to remove statically a significant number of infeasible synchronization edges that would otherwise have to be analyzed later by the tester. In this paper, the test model is presented using the Message-Passing Interface standard; however, our new model has been designed to be flexible, and it can be configured to support a range of different messagepassing environments or languages. We have carried out case studies showing the applicability of the new test model to represent message-passing programs and also to reveal errors, mainly those errors related to inter-process communication. In addition to increasing the number of features supported by the test model, we have also reduced the overall cost of testing significantly. Our case studies suggest that the number of synchronization edges can be reduced by up to 93%, mainly by eliminating infeasible edges between unmatchable communication primitives. The main contribution of the paper is to present a more flexible test model that provides improved coverage for message-passing programs and at the same time reduces the cost of testing significantly.

show abstract

“…The difference is that their method is used for the interfaces of function calls, reference to a value returned from a function, and reference to global variables shared by two or more functions, while ours is used for the interface of message passing. To obtain test suite, we developed a method called Condition Calculation in [3].…”

Section: Port Reliabilitymentioning

confidence: 99%

Port Based Reliability Computing for Service Composition

Ding

Jiang

2009

2009 IEEE International Conference on Services Computing

Self Cite

View full text Add to dashboard Cite

Web service composition is a distributed model to construct new web service on top of existing primitive or other composite web services. However, current service technologies, including proposed composition languages, do not address the reliability of web service composition. Thus it is hard to predict the system reliability. In this paper, we propose a method to compute system reliability based on Service Component Architecture(SCA), a standard that provides a language-independent way to define and compose service components in the system. We first present a formal service component signature model with respect to the specification of the SCA assembly model, and then propose a language-independent dynamic behaviour model for specifying the interface behaviour of the service component by port activities. Then the failure behaviors of ports are defined through the Enhanced Non-Homogeneous Poisson Process(ENHPP). Based on the semantics of ports, several rules have been generated to compute reliabilities of port expressions, thus the overall system reliability can be automatically computed. Finally, a testing bed is given to calculate port reliability.

show abstract

A rigorous approach towards test case generation

Cited by 15 publications

References 45 publications

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs

Empirical evaluation of a new composite approach to the coverage criteria and reachability testing of concurrent programs

Structural testing for message‐passing concurrent programs: an extended test model

Port Based Reliability Computing for Service Composition

Contact Info

Product

Resources

About