Testing Self-Organizing, Adaptive Systems

Eberhardinger, Benedikt

doi:10.1109/sasow.2015.28

Cited by 5 publications

(5 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Note that although there are 74 studies that apply at least one testing approach, this does not mean they all involve distinct approaches. As an example, Eberhardinger et al [43] applied the same approach in two distinct studies [43,103]; the approach explores constraints and model-based testing to decrease the number of test cases to be generated. One of the studies [103] introduced the main concepts and used a running example, whereas the other [43] proposed a different test modelbased on the first one and presented results of an exploratory study.…”

Section: Testing Approaches For Adaptive Systems or Context-aware Systemsmentioning

confidence: 99%

“…Eberhardinger et al [102] addressed the use of oracles for minimizing the number of test cases to be generated. The first study [103] focused on defining a model of constraints to reduce the testing scope, while the second study [102] focused on minimizing the test set. Hansel et al [112], also in the runtime perspective, investigated testing approaches for control loops.…”

Section: • Definition Of Test Sets For Built-in and Runtime (3-a): Eberhardinger [103] Andmentioning

confidence: 99%

Section: Generic Challenges For Adaptive System or Context-aware System Testingmentioning

confidence: 99%

“…Eberhardinger [103] mentioned the need for synchronizing components to ensure harmony between the closed control loops (SC-9). The same research group ⋆ [43,103] mentioned the difficulty of testing a system that has asynchronous behaviour. Finally, ⋆ Püschel et al [109] mentioned the issue of testing a system with a common layer architecture to encapsulate context management from the usage of contexts (SC-10).…”

Section: Generic Challenges For Adaptive System or Context-aware System Testingmentioning

confidence: 99%

“…⋆ Xu et al [19] highlighted the issue of identifying reliably important adaptive changes within the system and its execution environment (SC-14). ⋆ Nehring and Liggesmeyer [96] and Eberhardinger [103] mentioned the difficulty of testing systems whose structure and behaviour may change during its execution (SC-19). ⋆ Püschel et al [108] and ⋆ Püschel et al [44] mentioned the difficulty of validating design models that contain uncertain or learning characteristics (SC-16).…”

Section: Generic Challenges For Adaptive System or Context-aware System Testingmentioning

confidence: 99%

See 4 more Smart Citations

Testing of adaptive and context‐aware systems: approaches and challenges

Siqueira

Ferrari

Souza

et al. 2021

Software Testing Verif & Rel

View full text Add to dashboard Cite

Adaptive systems (ASs) and context-aware systems (CASs) are able to evaluate their own behaviour and to adapt it when the system fails to accomplish its goals or when better functionality or performance is possible. Ensuring the reliability of ASs and CASs is demanding because failures might have undesirable consequences. Testing ASs and CASs effectively is not trivial because of the inherent characteristics of these systems. The literature lacks a comprehensive review that provides a broad picture of the area; current reviews are outdated and incomplete. The objectives of this study are characterizing the state of the art in AS and CAS testing and discussing approaches, challenges, observed trends, and research limitations and directions. We performed a systematic literature review (SLR) and a thematic analysis of studies, reporting up-to-date, refined and extended results when compared with existing reviews. Based on 102 selected studies, we (i) characterized testing approaches by grouping techniques for ASs and CASs; (ii) updated and refined a characterization of testing challenges for ASs and CASs; and (iii) analysed and discussed research trends and implications for AS and CAS testing. There are recurring research concerns regarding AS and CAS testing. Examples are the generation of test cases and built-in tests. Moreover, we also identified recurring testing challenges such as context monitoring and runtime decisions. Moreover, there are some trends such as model-based testing and hybrid techniques and some little investigated issues like uncertainty and prediction of changes. All in all, our results may provide guidance for developers and researchers with respect to the practice and the future research on AS and CAS testing.

show abstract