Verification of Microservices Using Metamorphic Testing

Luo, Gang; Zheng, Xi; Liu, Huai; Xu, Rongbin; Nagumothu, Dinesh; Janapareddi, Ranjith Nagendra Kumar; Zhuang, Er; Liu, Xiao

doi:10.1007/978-3-030-38991-8_10

Cited by 1 publication

(1 citation statement)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…ChaT is motivated by MT that removes the burden of determining software oracles in various application domains [6]. Luo et al proposed simple uses of the verification technique on microservices using MT and they proved the effectiveness of the technique in detecting failures using the defined MRs [7]. ChaT enhances the proposal by not only detecting and validating the failures using MRs, but also using some anomaly detection algorithms.…”

Section: Related Workmentioning

confidence: 99%

ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing

Pranata

Barais

Bourcier

et al. 2021

2021 IEEE Global Communications Conference (GLOBECOM)

View full text Add to dashboard Cite

Detecting faults in distributed network systems is challenging because of their complexity, but this is required to evaluate and improve their reliability. This paper proposes ChaT, a testing and evaluation methodology under system reconfigurations and perturbations for distributed network systems, to evaluate QoS reliability by discriminating safe and failure-prone behaviors from different testing scenarios. Motivated by metamorphic testing technique that removes the burden of defining software oracles, we propose some metamorphic relationships that correlate system inputs and outputs to find patterns in executions. Classification techniques based on machine learning (principal component analysis and support vector machine) are used to identify system states and validate the proposed metamorphic relationships. These metamorphic relationships are also used to help anomaly detection. We verify this with several anomaly detection techniques (isolation forest, one-class SVM, local outlier factor, and robust covariance) that categorize experiments belonging to either safe or failure-prone states. We apply ChaT to a video streaming application use case. The simulation results show the effectiveness of ChaT to achieve our goals: identifying execution classes and detecting failure-prone experiments based on metamorphic relationships with high level of statistical scores.

show abstract

Section: Related Workmentioning

confidence: 99%