Nonparametric Bayesian Method for Robot Anomaly Monitoring

Zhou, Xuefeng; Wu, Hongmin; Rojas, Juan; Xu, Zhihao; Li, Shuai

doi:10.1007/978-981-15-6263-1_4

Cited by 2 publications

(1 citation statement)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Among recent works, [30] extends planning with a visionbased execution monitoring system, [31] analyzes different preprocessing techniques for introspective data to detect gearbox failures. Non-parametric Bayesian models [32] and Non-parametric Hidden Markov Models (HMMs) [33] are investigated to detect and classify anomalies.…”

Section: Related Workmentioning

confidence: 99%

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

İnceoğlu

Aksoy

et al. 2021

2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

View full text Add to dashboard Cite

An autonomous service robot should be able to interact with its environment safely and robustly without requiring human assistance. Unstructured environments are challenging for robots since the exact prediction of outcomes is not always possible. Even when the robot behaviors are well-designed, the unpredictable nature of physical robotobject interaction may prevent success in object manipulation. Therefore, execution of a manipulation action may result in an undesirable outcome involving accidents or damages to the objects or environment. Situation awareness becomes important in such cases to enable the robot to (i) maintain the integrity of both itself and the environment, (ii) recover from failed tasks in the short term, and (iii) learn to avoid failures in the long term. For this purpose, robot executions should be continuously monitored, and failures should be detected and classified appropriately. In this work, we focus on detecting and classifying both manipulation and post-manipulation phase failures using the same exteroception setup. We cover a diverse set of failure types for primary tabletop manipulation actions. In order to detect these failures, we propose FINO-Net [1], a deep multimodal sensor fusion based classifier network. Proposed network accurately detects and classifies failures from raw sensory data without any prior knowledge. In this work, we use our extended FAILURE dataset [1] with 99 new multimodal manipulation recordings and annotate them with their corresponding failure types. FINO-Net achieves 0.87 failure detection and 0.80 failure classification F1 scores. Experimental results show that proposed architecture is also appropriate for real-time use.

show abstract

Section: Related Workmentioning

confidence: 99%

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

İnceoğlu

Aksoy

et al. 2021

2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

View full text Add to dashboard Cite

show abstract

Multimodal Detection and Classification of Robot Manipulation Failures

Inceoglu,

Aksoy,

Sariel

2024

IEEE Robot. Autom. Lett.

View full text Add to dashboard Cite

Expect the Unexpected: Leveraging the Human-Robot Ecosystem to Handle Unexpected Robot Failures

Honig

Oron-Gilad

2021

Front. Robot. AI

View full text Add to dashboard Cite

Unexpected robot failures are inevitable. We propose to leverage socio-technical relations within the human-robot ecosystem to support adaptable strategies for handling unexpected failures. The Theory of Graceful Extensibility is used to understand how characteristics of the ecosystem can influence its ability to respond to unexpected events. By expanding our perspective from Human-Robot Interaction to the Human-Robot Ecosystem, adaptable failure-handling strategies are identified, alongside technical, social and organizational arrangements that are needed to support them. We argue that robotics and HRI communities should pursue more holistic approaches to failure-handling, recognizing the need to embrace the unexpected and consider socio-technical relations within the human robot ecosystem when designing failure-handling strategies.

show abstract

Nonparametric Bayesian Method for Robot Anomaly Monitoring

Cited by 2 publications

References 27 publications

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

Multimodal Detection and Classification of Robot Manipulation Failures

Expect the Unexpected: Leveraging the Human-Robot Ecosystem to Handle Unexpected Robot Failures

Contact Info

Product

Resources

About