Canopus: A Domain-Specific Language for Modeling Performance Testing

Bernardino, Maicon; Zorzo, Avelino F.; Rodrigues, Elisa

doi:10.1109/icst.2016.13

Cited by 16 publications

(14 citation statements)

References 51 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Furthermore, we could also use the SMS results as the starting point to define the tools requirements and to support some decisions in the proposal of a software product line of MBT tools [2,[111][112][113]. Moreover, we used the SMS results, in particular the modelling notations, to elicit the requirements and to provide some design decisions to a domain-specific language for modelling performance testing [114,115].…”

Section: Resultsmentioning

confidence: 99%

Systematic mapping study on MBT: tools and models

et al. 2017

Self Cite

View full text Add to dashboard Cite

Every year several contributions to the model-based testing (MBT) field are published. Therefore, to follow the evolution and trends of several tools and models available is difficult. Moreover, since the variety of models and tools that became available in recent years, choosing an approach to support the MBT process is a challenging activity. The main objective of this study is to provide an overview on MBT tools and models used by those tools. Furthermore, the authors' study can help academic researchers and companies to understand the topics involving MBT. Therefore, a systematic mapping study was conducted in which 1197 distinct papers were evaluated. At the end, 87 primary studies were selected to be analysed in a quantitative and qualitative way. As a result, they classified the tools and models that are currently used to support MBT. Moreover, they identified 70 MBT tools, as well as different domains in which MBT is already applied to. Therefore, there are some evidence that MBT continues to be a broad and 'alive' research field since every year a significant number of papers presenting different kinds of contributions are published.

show abstract

Section: Resultsmentioning

confidence: 99%

Systematic mapping study on MBT: tools and models

et al. 2017

Self Cite

View full text Add to dashboard Cite

show abstract

“…Finally, there are domain‐specific languages (DSLs) for load or performance testing, which also model workloads including input data and further parameterizations . Similar workloads are modelled by load testing tools .…”

Section: Related Workmentioning

confidence: 99%

Reducing the maintenance effort for parameterization of representative load tests using annotations

Schulz¹,

Hoorn

Wert³

2019

Software Testing Verif & Rel

View full text Add to dashboard Cite

Summary Directly affecting the user experience, performance is a crucial aspect of today's software applications. Representative load testing allows to effectively test and preserve the performance before delivery by mimicking the actually expected workload. In the literature, various approaches have been proposed for extracting representative load tests from recorded user sessions. However, these approaches require manual parameterization for specifying input data and adjusting static properties such as a request's domain name. This manual effort accumulates when load tests need to be updated due to changing production workloads and APIs. In this paper, we address the reduction of the maintenance effort for representative load testing. We introduce input data and properties annotations (IDPAs) that store manual parameterizations and can be evolved automatically. Experts only have to parameterize extracted load tests initially. For dealing with API changes, we develop approaches to evolve IDPAs for the types of changes described in the literature. We evaluated our approach in two experimental studies, by deriving effort estimation models, and in an industrial case study including four different software projects. Our evaluation shows that IDPAs can parameterize generated load tests for restoring the representativeness, especially for applications with workloads dominated by request orders and rates. The maintenance effort can be reduced from a quadratic cumulative effort over time to a linear cumulative effort for a typical mix of API changes. Furthermore, we were able to express all parameterizations required by the industrial projects using the IDPA but also had to integrate extensions using the provided extension mechanisms.

show abstract

“…Based on assumptions presented before, it seems a matter of huge importance accessing mechanisms for software performance assessment. So that, by employing a Performance Testing it is possible to plan, execute, monitor, and analyze the results of a system under certain conditions, thereby obtaining the possible expected behaviors of a given software when subjected to these conditions [Bernardino et al 2016]. In this context, Software Performance Engineering (SPE) [Woodside et al 2007] can be divided into two general approaches.…”

Section: Introductionmentioning

confidence: 99%

“…Performance testing is a possibility to plan, execute, monitor, and analyze the results of a system under certain conditions, thereby obtaining the possible expected behaviors of determining software, when subjected to these conditions [Bernardino et al 2016]. According to Freitas and Vieira [Freitas and Vieira 2014], performance testing is a test that aims to evaluate the performance of the system at a given load scenario.…”

Section: Introductionmentioning

confidence: 99%

Systematic Literature Review on Web Performance Testing

Legramante¹,

Bernardino²,

Rodrigues³

et al. 2020

Anais Da IV Escola Regional De Engenharia De Software (ERES 2020)

Self Cite

View full text Add to dashboard Cite

Performance Testing is essential to ensure the quality and scalability of Web applications. A well-defined process may guide Performance Testing Engineer in conducting this task. We intended to enlighten some major inputs related to web performance testing. For this, we have formulated and executed a given protocol, according to the Systematic Literature Review (SLR) protocol in Software Engineering. So, 37 papers were selected/analyzed and we have extracted their most relevant contribution in order to answer our research questions. This analysis enabled us discovering preeminent performance testing profiles/roles, approaches, artifacts, methods, stages or phases and activity flows that have been reported in the literature. We believe that, despite those several studies that mapping performance test context, there are a few remarks in which a clarification might be needed, once there is no well-established process that comprises the whole activities mapped as well as established a relation with other studies. Therefore, this study intends to provide relevant input that one may establish a novel web performance testing process.

show abstract

Canopus: A Domain-Specific Language for Modeling Performance Testing

Cited by 16 publications

References 51 publications

Systematic mapping study on MBT: tools and models

Systematic mapping study on MBT: tools and models

Reducing the maintenance effort for parameterization of representative load tests using annotations

Systematic Literature Review on Web Performance Testing

Contact Info

Product

Resources

About