Testing in a DevOps Era: Perceptions of Testers in Norwegian Organisations

Abstract

To better understand the challenges encountered by testers in DevOps development, we have performed an empirical investigation of what are the trends and challenges for the testers in the DevOps environment. We have discussed the quality assurance in the difference focus areas of DevOps: Social Aspects, automation, leanness, sharing, measurement.The results were then themed in five different topics of concern to testers: collaboration, roles and responsibilities, types of tests, automation and monitoring and infrastructure. In Testing, there has been a change on the roles and responsibilities of testers, where there is much more focus on the responsibilities for testing across the teams, instead of a sole responsibility of the tester. Testers are also forced to collaborate more with other stakeholders as operations and business. Testing is brought to another level of automation in DevOps but there is still need for manual tests, that have to be much more risk-based than before. And finally, testing transparency is a must in this process and should involve not only development team but also operations and customers. This paper contributes to the body of knowledge on what are the areas we need to focus for improvement in testing for the DevOps environment. This paper also contributes to practitioners to improve their testing focusing on specific areas that needs attention.

Selection of DevOps best test practices: A hybrid approach using ISM and fuzzy TOPSIS analysis

“…Similarly, Zimmere 10 characterized the continuous testing in DevOps (iDevOps) into two phases: (i) strategies for test automation and (ii) continuous testing from start till end. Cruzes et al 11 discussed five major concerns of testers while working in DevOps environment, that is, coordination, automation, role and responsibilities, monitoring, test types, and infrastructures. They developed an infrastructural model for continuous testing based on five concerns of DevOps testers.…”

A survey on software test automation return on investment, in organizations predominantly from Bengaluru, India

“…It is interesting to note that automation practice is researched by region . Industry practice adopted by professionals from various regions is presented in References 83–85. Again automation practice by industry verticals and its study on different organizations are highlighted in References 86–88.…”

Defining TestOps: Collaborative Behaviors and Technology-Driven Workflows Seen as Enablers of Effective Software Testing in DevOps

“…The emergence of continuous testing is one particular facet of this shift, being enthusiastically promoted as “the key for DevOps” [ 9 ]. Yet, from an overall perspective, the possible synergy between software testing and DevOps is still poorly understood, having been discussed in only a handful of empirical studies [ 10 ] and practitioner reports [ 6 , 9 ] so far. Also, in practitioner forums, the discussion seems to be somewhat fragmented.…”