2016
DOI: 10.1002/j.2334-5837.2016.00179.x
|View full text |Cite
|
Sign up to set email alerts
|

Testing of Autonomous Systems – Challenges and Current State‐of‐the‐Art

Abstract: Autonomous systems are on the rise. However, the challenge to test autonomous systems to ensure their safe and fault‐free behaviour is not solved yet. This is especially critical when we consider the fact that autonomous systems are often safety‐critical systems envisaged to interact with humans without explicit human supervision. This paper points out why testing autonomous systems is such a challenge and provides an overview of the current state‐of‐the‐art theory and practice. The gathered information is the… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
27
0

Year Published

2018
2018
2024
2024

Publication Types

Select...
5
5

Relationship

0
10

Authors

Journals

citations
Cited by 47 publications
(29 citation statements)
references
References 31 publications
(43 reference statements)
0
27
0
Order By: Relevance
“…At the same time, testing becomes one of the biggest challenges, while existing software testing methodologies cannot cope with the challenges of testing autonomous systems, mainly due to the fact that systems' behavior not only depends on design and implementation, but also on the acquired knowledge of the system (Helle, Schamai, & Strobel, 2016). Furthermore, as AI matures, it will be critical to study its influence on humans and society, on a short-term and long-term basis, which requires engagement with interdisciplinary groups, including computer scientists, social scientists, psychologists, economists, and lawyers, developing assessments and guidance through focused studies, monitoring, and analysis (Horvitz, 2017).…”
Section: Human Safetymentioning
confidence: 99%
“…At the same time, testing becomes one of the biggest challenges, while existing software testing methodologies cannot cope with the challenges of testing autonomous systems, mainly due to the fact that systems' behavior not only depends on design and implementation, but also on the acquired knowledge of the system (Helle, Schamai, & Strobel, 2016). Furthermore, as AI matures, it will be critical to study its influence on humans and society, on a short-term and long-term basis, which requires engagement with interdisciplinary groups, including computer scientists, social scientists, psychologists, economists, and lawyers, developing assessments and guidance through focused studies, monitoring, and analysis (Horvitz, 2017).…”
Section: Human Safetymentioning
confidence: 99%
“…Although in theory upfront design-time verification techniques could be used to analyze their properties, research has shown that the complexity of these systems makes static analysis practically unfeasible (Helle et al 2016;Koopman & Wagner 2016). In contrast, run-time techniques, such as simulation or monitoring, can still provide very relevant information at a lower cost (Babikian 2020).…”
Section: Simulationmentioning
confidence: 99%
“…An 'autonomous system' is defined as one that takes actions on its own to achieve goals provided independently by whomever defines them or will benefit from their achievement. Also, the decision-making process is local and offline (13)(14)(15)(16) .…”
Section: Autonomous Versus Automatedmentioning
confidence: 99%