A Situation Awareness Perspective on Human-AI Interaction: Tensions and Opportunities

Jiang, Jinglu; Karran, Alexander J.; Coursaris, Constantinos K.; Léger, Pierre‐Majorique; Beringer, Joerg

doi:10.1080/10447318.2022.2093863

Cited by 22 publications

(9 citation statements)

References 113 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Particularly, cross-modal reasoning is expected to enhance cross-modal design generation, which may allow humans to ideate at an abstract level and AI to create designs accordingly at a concrete level, accelerating design generation and broadening design exploration. In recent years, AI's interactive attributes have seen notable advancements, particularly in sensing and predictability (Endsley, 2023), adaptability (Wang et al, 2023), and awareness sharing (Jiang et al, 2023). However, compared to the task-oriented capabilities, AI's interactive attributes are still less developed .…”

Section: Trust Enablersmentioning

confidence: 99%

Human-AI collaboration by design

Song,

Zhu,

Luo

2024

Proc. Des. Soc.

View full text Add to dashboard Cite

Human-AI collaboration (HAIC) is a promising strategy to transform engineering design and innovation, yet how to design artificial intelligence (AI) to boost HAIC remains unclear. Accordingly, this paper provides a new, unified, and comprehensive scheme for classifying AI roles. On this basis, we develop an AI design framework that outlines expected AI capabilities, interactive attributes, and trust enablers across various HAIC scenarios, offering guidance for integrating AI into human teams effectively. We also discuss current advancements, challenges, and prospects for future research.

show abstract

Section: Trust Enablersmentioning

confidence: 99%

Human-AI collaboration by design

Song,

Zhu,

Luo

2024

Proc. Des. Soc.

View full text Add to dashboard Cite

show abstract

“…Therefore, in the ideal state of digital twinning, the digital twin system for cultural heritage risk management can be considered an independent arti cial intelligence entity or a nonhuman agent. Another research focus of digital twinning is how to enhance and amplify human performance (heritage site managers, heritage experts, and stakeholders) [24]. As mentioned in studies by [66-68], digital twinning can provide additional information to humans, allowing operators to anticipate future system behavior and providing more guidance for maintenance tasks [60].…”

Section: Theoretical Background and Hypothesesmentioning

confidence: 99%

“…Situation awareness (SA), de ned as the perception of elements in the environment within a certain time and space, understanding their signi cance, and predicting their future states [23], re ects the extent to which users perceive, comprehend, and project context-relevant elements they want to understand [24].…”

Section: Introductionmentioning

confidence: 99%

Extending X-reality technologies to digital twin in cultural heritage risk management：A comparative evaluation from the perspective of situation awareness

Guo,

Lu,

Shen

et al. 2024

Preprint

View full text Add to dashboard Cite

Digital twins possess characteristics such as real-time capability, high precision, and high integration. The digital twin system for cultural heritage risk management includes comprehensive information about heritage, contextual data, and expert knowledge. Considering the role of Situational Awareness (SA), it facilitates more efficient risk assessment, analysis, and strategic decision-making for management personnel, thereby reducing damage to cultural heritage.This study extends X-reality technologies into the digital twin system for cultural heritage risk management. It simulates three sets of procedures for remote risk management of cultural heritage (2D desktop, VR, and AR) and explores the effectiveness of VR and AR in enhancing situational awareness from three dimensions of SART (SART-DAR, SART-SAR, SART-UOS). Additionally, we further analyze how the technological attributes of VR and AR (immersion and interactivity) impact the functional mechanism of situational awareness.The results indicate that, compared to the traditional 2D desktop, VR and AR have advantages in enhancing situational awareness of heritage risk. However, in AR mode, SART-DAR and SART-SAR dimensions did not show significant improvement. Furthermore, there is a significant difference in immersion's impact on the SART-DAR dimension. Regarding interactivity, although the results show differences in the impact on the SART-DAR dimension between VR and AR, no significant differences were observed.This study provides design references for building a digital twin system for cultural heritage risk management by deeply understanding the impact of X-reality technologies on the functional mechanism of cultural heritage risk situational awareness. Simultaneously, it offers insights for heritage site managers, heritage experts, and relevant stakeholders to enhance efficiency in risk perception.

show abstract

“…HAR enables machines to monitor and grasp diverse human actions using sensors along with multimodal input data. [3]. Early HAR efforts, dating back to the 1990s, achieved over 95% accuracy in controlled data collection scenarios [7].…”

Section: Advances In Sensor Technology and Human Activity Recognitionmentioning

confidence: 99%

“…Several applications have been developed as a result of substantial research in these areas. Video surveillance systems, for example, benefit from identifying human actions to improve security and situational awareness [3]. Understanding human actions also helps in the creation of more intuitive and responsive interfaces in the field of human-computer interaction.…”

Section: Introductionmentioning

confidence: 99%

A Systematic Literature Review on Human Activity Recognition

Ananda Ravuri

2024

jes

View full text Add to dashboard Cite

Human Activity Recognition (HAR) plays a significant role in several fields by automatically identifying and monitoring human activities using advanced techniques. It enhances safety, improves healthcare services, optimizes fitness routines, and enables context-aware applications in various fields. HAR contributes to a more efficient and intelligent interaction between humans and technology. It has emerged as an essential research domain with applications in healthcare, smart environments, and human-computer interaction. This study aims to provide a comprehensive survey of the evolving landscape of HAR, including key methodologies, techniques, and trends in existing research. The study discusses various applications of HAR and their significance in modern smart environments. The survey also highlights different types of HAR and data collection techniques. Additionally, it explores various methods for analyzing the collected data and provides a comprehensive analysis of existing human activity classification datasets. It offers valuable insights into understanding the strengths and limitations of various HAR techniques. The study also discusses various challenges and future directions for HAR.

show abstract

A Situation Awareness Perspective on Human-AI Interaction: Tensions and Opportunities

Cited by 22 publications

References 113 publications

Human-AI collaboration by design

Human-AI collaboration by design

Extending X-reality technologies to digital twin in cultural heritage risk management：A comparative evaluation from the perspective of situation awareness

A Systematic Literature Review on Human Activity Recognition

Contact Info

Product

Resources

About