A Review of Verification and Validation for Space Autonomous Systems

Abstract

Purpose of Review The deployment of hardware (e.g., robots, satellites, etc.) to space is a costly and complex endeavor. It is of extreme importance that on-board systems are verified and validated through a variety of verification and validation techniques, especially in the case of autonomous systems. In this paper, we discuss a number of approaches from the literature that are relevant or directly applied to the verification and validation of systems in space, with an emphasis on autonomy. Recent Findings Despite advances in individual verification and validation techniques, there is still a lack of approaches that aim to combine different forms of verification in order to obtain system-wide verification of modular autonomous systems. Summary This systematic review of the literature includes the current advances in the latest approaches using formal methods for static verification (model checking and theorem proving) and runtime verification, the progress achieved so far in the verification of machine learning, an overview of the landscape in software testing, and the importance of performing compositional verification in modular systems. In particular, we focus on reporting the use of these techniques for the verification and validation of systems in space with an emphasis on autonomy, as well as more general techniques (such as in the aeronautical domain) that have been shown to have potential value in the verification and validation of autonomous systems in space.

A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence

“…V&V of ML is an important topic in current research. For this reason, there are recent works and surveys that deal with this topic [7], [8], [14]- [16]. Current surveys in this domain either deal with a specific area, such as autonomous systems [16], in which ML is used, or only investigate one aspect like ML testing [14], [15] or formal verification of ML [7], which are only parts of the entire V&V process.…”

Formal Modelling and Runtime Verification of Autonomous Grasping for Active Debris Removal

“…A comprehensive overview of the state-of-the-art verification and validation for autonomous space robotics can be found in (Cardoso et al, 2021). This includes both formal (model checking, theorem proving and runtime verification) and nonformal techniques (testing, simulation).…”

Model Checking for Closed-Loop Robot Reactive Planning

“…In autonomous robotic systems, model checking has been used for static and runtime verification [23,10,5,33] and has been proposed for strategy synthesis [11,17]. It has been used in many contexts, for example: to generate real-time action plans with formal guarantees for steerable needles [21]); industrial robots [32]; and for assistive-care robots which dynamically re-calibrate their path in real-time [12].…”