The TRUSTS Work System Resilience Framework:  A Foundation for Resilience-Aware Development and Transition

Neville, Kelly; Pires, Bianica; Madhavan, Poornima; Booth, Matthew; Rosfjord, Kris; Patterson, Emily S.

doi:10.1177/1071181322661177

Cited by 8 publications

(12 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The RAD-X generated 15 user stories in one hour. Three resilience engineering experts coded each user story using the TRUSTS framework (Neville et al, 2022) to characterize their relevance to work system resilience. Coding showed that 13 of 15 (87%) were resilience-focused, while two (13%) did not support resilience but instead described basic functionality.…”

Section: Resultsmentioning

confidence: 99%

“…Recent research has argued that a failure to consider work system resilience during development can result in failed technology transition (Neville et al, 2022). One response was to introduce the paradigm of Resilience Aware Development (RAD): The idea that a technology's effects on work system resilience must be considered throughout its development, especially in cases of high-consequence work.…”

Section: Overviewmentioning

confidence: 99%

See 1 more Smart Citation

The Value of Wargames and Tabletop Exercises as Naturalistic Tools

Dorton,

Fersch,

Barrett

et al. 2023

Proceedings of the Human Factors and Ergonomics Society Annual

Self Cite

View full text Add to dashboard Cite

Wargames and tabletop exercises (TTXs) have existed for centuries in military planning contexts but have seen relatively limited use as methods of inquiry within the human factors community of practice. We argue that that the use of these tools is not commensurate with their value, as they are effective and efficient means to conduct naturalistic inquiry. We demonstrate the value of wargames and TTXs by presenting two case studies of their use in different domains, highlighting how their outputs were used to achieve research objectives and to glean insights about human cognition in the context of work. We also discuss the similarity of wargames and TTXs to other methods of inquiry, and suggest future areas for research.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Overviewmentioning

confidence: 99%

The Value of Wargames and Tabletop Exercises as Naturalistic Tools

Dorton,

Fersch,

Barrett

et al. 2023

Proceedings of the Human Factors and Ergonomics Society Annual

Self Cite

View full text Add to dashboard Cite

show abstract

“…This value extends beyond developing ethical AI. NDM approaches have been used to glean insights on developing trustworthy AI (e.g., Dorton and Harper, 2022 and Dorton, 2022 ) and resilient AI technologies (e.g., Neville et al, 2022 ). In summary, we have attempted to craft our argument while providing different messages to two different audiences.…”

Section: Discussionmentioning

confidence: 99%

Foresight for ethical AI

Dorton

Ministero

Alaybek

et al. 2023

Front. Artif. Intell.

View full text Add to dashboard Cite

There is growing expectation that artificial intelligence (AI) developers foresee and mitigate harms that might result from their creations; however, this is exceptionally difficult given the prevalence of emergent behaviors that occur when integrating AI into complex sociotechnical systems. We argue that Naturalistic Decision Making (NDM) principles, models, and tools are well-suited to tackling this challenge. Already applied in high-consequence domains, NDM tools such as the premortem, and others, have been shown to uncover a reasonable set of risks of underlying factors that would lead to ethical harms. Such NDM tools have already been used to develop AI that is more trustworthy and resilient, and can help avoid unintended consequences of AI built with noble intentions. We present predictive policing algorithms as a use case, highlighting various factors that led to ethical harms and how NDM tools could help foresee and mitigate such harms.

show abstract

“…We have developed a framework that specifies the characteristics of work systems that enable resilience (Neville et al, 2022). This framework, called the Transform with Resilience during Upgrades to Socio-Technical Systems, or TRUSTS, is the basis of an effort to improve system development methodology and, by reducing negative impacts on work system resilience, improve the likelihood of successful technology transition and use.…”

Section: Technology Development That Preserves Work-system Resilience...mentioning

confidence: 99%

Safety Frameworks for Emerging Technologies

Boring

Neville

Spielman

et al. 2022

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

New and advancing technologies bring capabilities to current systems and tools expected to improve safety, efficiency, or impact within their respective domain. To ensure such emerging technologies are implemented as to not negatively disrupt a system but empower it, the new design is analyzed using any variety of methods. Unfortunately, most process industry and transportation accidents have a human error component, despite methods to predict when errors will occur based on the technology design. The prospect of anticipating human error traps becomes even more challenging for emerging technologies when implemented in a hybrid or mixed-generation system. Since human error remains a threat to system safety, this panel was convened to review existing and planned safety frameworks to evaluate the impact emergent technologies have on human behavior. Of special interest are techniques that predict when technology will lead to degraded human behavior leading to error (including vigilance decrement, poor failure detection, a lack of currency, automation complacency, etc.). Safety frameworks that can anticipate system states and provide robust, resilient human-system responses to novel situations are an essential part of future system design.

show abstract

The TRUSTS Work System Resilience Framework: A Foundation for Resilience-Aware Development and Transition

Cited by 8 publications

References 33 publications

The Value of Wargames and Tabletop Exercises as Naturalistic Tools

The Value of Wargames and Tabletop Exercises as Naturalistic Tools

Foresight for ethical AI

Safety Frameworks for Emerging Technologies

Contact Info

Product

Resources

About