Empowering Adaptive Human Autonomy Collaboration with Artificial Intelligence

Alix, Christophe; Lafond, Daniel; Mattioli, Juliette; Heer, Johan de; Chattington, Mark; Robic, Pierre-Olivier

doi:10.1109/sose52739.2021.9497497

Cited by 2 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Trust in any AI system depends on many characteristics. Alix et al [17] give: reliability; robustness; resistance to attack; transparency; predictability; data security; and protection against incorrect use. They then propose that an AI-based system has to implement the three following features:…”

Section: Dynamic Human Machine Teaming and Trustmentioning

confidence: 99%

Building trust and responsibility into autonomous human-machine teams

Gillespie¹

2022

Front. Phys.

View full text Add to dashboard Cite

Harm can be caused to people and property by any highly-automated system, even with a human user, due to misuse or design; but which human has the legal liability for the consequences of the harm is not clear, or even which laws apply. The position is less clear for an interdependent Autonomous Human Machine Team System (A-HMT-S) which achieves its aim by reallocating tasks and resources between the human Team Leader and the Cyber Physical System (CPS). A-HMT-S are now feasible and may be the only solution for complex problems. However, legal authorities presume that humans are ultimately responsible for the actions of any automated system, including ones using Artificial Intelligence (AI) to replace human judgement. The concept of trust for an A-HMT-S using AI is examined in this paper with three critical questions being posed which must be addressed before an A-HMT-S can be trusted. A hierarchical system architecture is used to answer these questions, combined with a method to limit a node’s behaviour, ensuring actions requiring human judgement are referred to the user. The underpinning issues requiring Research and Development (R&D) for A-HMT-S applications are identified and where legal input is required to minimize financial and legal risk for all stakeholders. This work takes a step towards addressing the problems of developing autonomy for interdependent human-machine teams and systems.

show abstract

Section: Dynamic Human Machine Teaming and Trustmentioning

confidence: 99%