Antipattern-Based Problem Injection for Assessing Performance and Reliability Evaluation Techniques

Keck, Philipp; Hoorn, André van; Okanović, Dušan; Pitakrat, Teerat

doi:10.1109/issrew.2016.36

Cited by 6 publications

(3 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In (Keck et al, 2016), the feasibility of injecting SPAs in a system under study was evaluated. It provided an example of the implementation of a proposed performance antipattern framework, where the Ramp and the One Lane Bridge implementation were demonstrated.…”

Section: Spa Detection In Real-time Systemsmentioning

confidence: 99%

Scalability testing automation using multivariate characterization and detection of software performance antipatterns

Avritzer¹,

Britto²,

Trubiani³

et al. 2022

Journal of Systems and Software

View full text Add to dashboard Cite

Section: Spa Detection In Real-time Systemsmentioning

confidence: 99%

Scalability testing automation using multivariate characterization and detection of software performance antipatterns

Avritzer¹,

Britto²,

Trubiani³

et al. 2022

Journal of Systems and Software

View full text Add to dashboard Cite

“…Majority of the papers (34) that used monitored data also proposed a continuous approach to monitoring performance features and then used them mainly for analysis and prediction (e.g., [SP11], [SP62], [SP41], and [SP28]). In contrast, other studies applied simulation ([SP38]), system execution modelling [45] ( [SP43]), and performance model generator leveraging execution data (e.g., [SP57]).…”

Section: Input Datamentioning

confidence: 99%

Architectural Support for Software Performance in Continuous Software Engineering: A Systematic Mapping Study

Eramo,

Tucci,

Di Pompeo

et al. 2022

SSRN Journal

View full text Add to dashboard Cite

“…In [17], the feasibility of injecting SPAs in a system under study was evaluated. It provided an example of the implementation of a proposed performance antipattern framework, where the Ramp and the One Lane Bridge implementation were demonstrated.…”

Section: Literature Reviewmentioning

confidence: 99%

A Multivariate Characterization and Detection of Software Performance Antipatterns

Avritzer¹,

Britto

Trubiani

et al. 2021

Proceedings of the ACM/SPEC International Conference on Performance Engineering

View full text Add to dashboard Cite

Context: Software Performance Antipatterns (SPAs) research has focused on algorithms for the characterization, detection, and solution of antipatterns. However, existing algorithms are based on the analysis of runtime behavior to detect trends on several monitored variables (e.g., response time, CPU utilization, and number of threads) using pre-defined thresholds.Objective: In this paper, we introduce a new approach for SPA characterization and detection designed to support continuous integration/delivery/deployment (CI/CDD) pipelines, with the goal of addressing the lack of computationally efficient algorithms.Method: Our approach includes SPA statistical characterization using a multivariate analysis approach of load testing experimental results to identify the services that have the largest impact on system scalability. More specifically, we introduce a layered decomposition approach that implements statistical analysis based on response time to characterize load testing experimental results. A distance function is used to match experimental results to SPAs.Results: We have instantiated the introduced methodology by applying it to a large complex telecom system. We were able to automatically identify the top five services that are scalability choke points. In addition, we were able to automatically identify one SPA. We have validated the engineering aspects of our methodology and the expected benefits by means of a domain experts' survey. Conclusion:We contribute to the state-of-the-art by introducing a novel approach to support computationally efficient SPA characterization and detection in large complex systems using performance testing results. We have compared the computational efficiency of the proposed approach with state-of-the-art heuristics. We have found that the approach introduced in this paper grows linearly, which is a significant improvement over existing techniques.

show abstract

Antipattern-Based Problem Injection for Assessing Performance and Reliability Evaluation Techniques

Cited by 6 publications

References 33 publications

Scalability testing automation using multivariate characterization and detection of software performance antipatterns

Scalability testing automation using multivariate characterization and detection of software performance antipatterns

Architectural Support for Software Performance in Continuous Software Engineering: A Systematic Mapping Study

A Multivariate Characterization and Detection of Software Performance Antipatterns

Contact Info

Product

Resources

About