Using performance models to support load testing in a large SOA environment

Vögele, Christian; Brunnert, Andreas; Danciu, Alexandru; Tertilt, Daniel; Krcmar, Helmut

doi:10.1145/2577036.2577038

Cited by 6 publications

(4 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We want to extend the set of supported logging formats and load testing tools. The measurement-based approach will be combined with model-based performance evaluation approaches [16] by generating workload specifications of performance models from WESSBAS-DSL instances. Moreover, the evaluation of other clustering algorithms and the integration of approaches for the generation of varying workload intensities [13] will be investigated.…”

Section: Discussionmentioning

confidence: 99%

Automatic Extraction of Probabilistic Workload Specifications for Load Testing Session-Based Application Systems

Hoorn¹,

Vögele²,

Schulz³

et al. 2015

Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools

Self Cite

View full text Add to dashboard Cite

Workload generation is essential to systematically evaluate performance properties of application systems under controlled conditions, e.g., in load tests or benchmarks. The definition of workload specifications that represent the real workload as accurately as possible is one of the biggest challenges in this area. This paper presents our approach for the modeling and automatic extraction of probabilistic workload specifications for load testing session-based application systems. The approach, called Wessbas, comprises (i.) a domain-specific language (DSL) enabling layered modeling of workload specifications as well as support for (ii.) automatically extracting instances of the DSL from recorded sessions logs and (iii.) transforming instances of the DSL to workload specifications of existing load testing tools. During the extraction process, different groups of customers with similar navigational patterns are identified using clustering techniques. We developed corresponding tool support including a transformation to probabilistic test scripts for the Apache JMeter load testing tool. The evaluation of the proposed approach using the industry standard benchmark SPECjEnterprise2010 demonstrates its applicability and the representativeness of the extracted workloads.

show abstract

Section: Discussionmentioning

confidence: 99%

Automatic Extraction of Probabilistic Workload Specifications for Load Testing Session-Based Application Systems

Hoorn¹,

Vögele²,

Schulz³

et al. 2015

Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools

Self Cite

View full text Add to dashboard Cite

show abstract

“…Furthermore, we plan to evaluate the proposed approach by transforming the WESSBAS-DSL into other architecture-level performance models such as the Descartes Modeling Language [7]. The prioritization of load test cases using the generated performance models will be investigated [14]. Moreover, we plan to implement the transformation between the WESSBAS-DSL and PCM in a bidirectional way.…”

Section: Discussionmentioning

confidence: 99%

“…As the Repository Model offers this kind of structuring, we generate parts of the workload specification into the Repository Model (cf. [14]). This violates the clear separation of the PCM models but reduces the complexity of the transformation considerably.…”

Section: Transformationmentioning

confidence: 99%

Automatic Extraction of Session-Based Workload Specifications for Architecture-Level Performance Models

Vögele

Hoorn

Krcmar

2015

Proceedings of the 4th International Workshop on Large-Scale Testing

Self Cite

View full text Add to dashboard Cite

Workload specifications are required in order to accurately evaluate performance properties of session-based application systems. These properties can be evaluated using measurement-based approaches such as load tests and model-based approaches, e.g., based on architecture-level performance models. Workload specifications for both approaches are created separately from each other which may result in different workload characteristics. To overcome this challenge, this paper extends our existing WESSBAS approach which defines a domain-specific language (WESSBAS-DSL) enabling the layered modeling and automatic extraction of workload specifications, as well as the transformation into load test scripts. In this paper, we extend WESSBAS by the capability of transforming WESSBAS-DSL instances into workload specifications of architecture-level performance models.The transformation demonstrates that the WESSBAS-DSL can be used as an intermediate language between system-specific workload specifications on the one side and the generation of required inputs for performance evaluation approaches on the other side. The evaluation using the standard industry benchmark SPECjEnterprise2010 shows that workload characteristics of the simulated workload match the measured workload with high accuracy.

show abstract

“…According to Vögele et al [19], the challenge in evaluating Web Services is the fact that services belong from different parties. To study the workload that these services receive, it is necessary to quantify the amount of requests per hour.…”

Section: Related Workmentioning

confidence: 99%

A low cost workload generation approach through the cloud for capacity planning in service-oriented systems

Ferreira¹,

Estrella²,

Nunes³

et al. 2017

Proceedings of the Second International Conference on Internet of Things, Data and Cloud Computing

View full text Add to dashboard Cite

This paper presents a cloud approach for low cost capacity planning evaluations. To perform these evaluations we have to specify and measure the workload on the target system to discover issues and make the necessary adjustments. However, due to high costs, these evaluations are usually done using simulations, which does not consider stochastic effects. We propose to use a tool named PEESOS, a generic and flexible approach to apply real workloads and measure used resources on these real systems. As a proof of concept, our case study use a real ticket sales service to evaluate the influence of scalability in the resource provisioning to show how PEESOS can lower the cost of such real evaluations. The results show the efficiency and savings that we can obtain using PEESOS for large-scale capacity planning evaluations before the real services are deployed. This approach can avoid several problems that real services faces when they launch.

show abstract

Using performance models to support load testing in a large SOA environment

Cited by 6 publications

References 4 publications

Automatic Extraction of Probabilistic Workload Specifications for Load Testing Session-Based Application Systems

Automatic Extraction of Probabilistic Workload Specifications for Load Testing Session-Based Application Systems

Automatic Extraction of Session-Based Workload Specifications for Architecture-Level Performance Models

A low cost workload generation approach through the cloud for capacity planning in service-oriented systems

Contact Info

Product

Resources

About