Automated testing of cloud-based elastic systems with AUToCLES

Abstract

Abstract-Cloud-based elastic computing systems dynamically change their resources allocation to provide consistent quality of service and minimal usage of resources in the face of workload fluctuations. As elastic systems are increasingly adopted to implement business critical functions in a cost-efficient way, their reliability is becoming a key concern for developers. Without proper testing, cloud-based systems might fail to provide the required functionalities with the expected service level and costs. Using system testing techniques, developers can expose problems that escaped the previous quality assurance activities and have a last chance to fix bugs before releasing the system in production.System testing of cloud-based systems accounts for a series of complex and time demanding activities, from the deployment and configuration of the elastic system, to the execution of synthetic clients, and the collection and persistence of execution data. Furthermore, clouds enable parallel executions of the same elastic system that can reduce the overall test execution time. However, manually managing the concurrent testing of multiple system instances might quickly overwhelm developers' capabilities, and automatic support for test generation, system test execution, and management of execution data is needed.In this demo we showcase AUToCLES, our tool for automatic testing of cloud-based elastic systems. Given specifications of the test suite and the system under test, AUToCLES implements testing as a service (TaaS): It automatically instantiates the SUT, configures the testing scaffoldings, and automatically executes test suites. If required, AUToCLES can generate new test inputs. Designers can inspect executions both during and after the tests.

Fuzzy Multicriteria Decision-Making Approach for Measuring the Possibility of Cloud Adoption for Software Testing

“…On the contrary, if a service requires tremendous human effort, this might negatively affect adoption [75]. (vii) Despite the great importance of Cloud-based testing, it is extremely complex and at present lacks proper tools to support it [76]. (viii) Extra efforts are required to deploy application and setup test environment in the Cloud [77].…”

Controlling the elasticity of web applications on cloud computing

“…Gambi et al have two works that address elasticity testing [5,3]. In the first work, the authors predict elasticity state transition based on workload variations, and test whether cloud infrastructures react accordingly.…”

Generating Test Sequences to Assess the Performance of Elastic Cloud-Based Systems

“…However, the ETS do not consider scaling states (scale in/out) and ignore testing requirements such as coverage of workload or coverage of all possible sequences. The authors also present AUToCLES [9], a test-as-a-service (TaaS) tool. Given an input, the tool ensures the correct ETS is reached, however it is not very clear how they guarantee the reachability.…”