Automatic cloud service testing and bottleneck detection system with scaling recommendation

Abstract

Performance problems in a cloud service are difficult to diagnose because they may be caused by various system components. This study proposes an automatic cloud service testing and bottleneck detection system that is applicable to different types of services. With the proposed test module, the user can customize test scenarios to automatically test and collect the corresponding metrics of the target service. Afterward, the proposed bottleneck detection algorithm analyzes the collected metrics and determines whether a bottleneck is presented in the target system. The bottleneck detection module also provides a scaling recommendation for the service provider to facilitate the service system reconfiguration. The experimental results reveal that the proposed system could detect a potential bottleneck in a service system accurately. In accordance with the scaling recommendation, the performance of the target cloud service can be improved efficiently after reconfiguration. Therefore, usage of the proposed system can ensure a high quality of service, and the service level objective could be fulfilled.

Performance testing as a service using cloud computing environment: A survey

“…They recommended vertical scaling for the corresponding resource to overcome AUT performance deficiencies. For instance, an automatic testing and bottleneck detection framework based on the cloud infrastructure was presented by Liu et al 69 The proposed framework can automatically create a test environment based on the cloud infrastructure, detect AUT performance bottlenecks by increasing the workload iteratively, and monitors the AUT performance metrics simultaneously. The proposed framework can efficiently provide a recommendation for the vertical scaling of the corresponding resource to overcome AUT performance deficiencies.…”

Convergence of deep machine learning and parallel computing environment for bio‐engineering applications

“…Liu et al have proposed an automatic cloud service testing and bottleneck detection system that ensures the high Quality of Service for cloud services. A testing environment can be generated automatically by using the proposed test module, and the weak point of the target service can be eliminated efficiently by using the proposed bottleneck detection algorithm.…”