IoT-Based Activity Recognition for Process Assistance in Human-Robot Disaster Response

Abstract

Mobile robots like drones or ground vehicles can be a valuable addition to emergency response teams, because they reduce the risk and the burden for human team members. However, the need to manage and coordinate human-robot team operations during ongoing missions adds an additional dimension to an already complex and stressful situation. BPM approaches can help to visualize and document the disaster response processes underlying a mission. In this paper, we show how data from a ground robot's reconnaissance run can be used to provide process assistance to the officers. By automatically recognizing executed activities and structuring them as an ad-hoc process instance, we are able to document the executed process and provide real-time information about the mission status. The resulting mission progress process model can be used for additional services, such as officer training or mission documentation. Our approach is implemented as a prototype and demonstrated using data from an ongoing research project on rescue robotics.

Digital Twins for Lighting Analysis: Literature Review, Challenges, and Research Opportunities

“…Among the recent works that deal with the automation of a traditional process based on IoT technology and robots, we cite (Rebmann et al, 2020b) that designed and developed a global architecture for a real-time recognition of robot activities integrated into traditional process assistance during a rescue mission. Towards this objective, the authors use, on the one hand, an ad-hoc process model that is modeled via the BPMN language, and on the other hand, they use a rescue robot that is equipped with some IoT sensors.…”

“…Therefore, integrating IoRT within BP comes to bring the gap of the IoT-aware BP and the RPA. Recently, (Rebmann et al, 2020b) presented an approach for the real-time recognition of robot activities used for process assistance during a rescue mission based on IoT data. However, this model is applied to a specific field as it does not comply with any meta-model.…”

“…However, this model is applied to a specific field as it does not comply with any meta-model. In (Rebmann et al, 2020a), the authors define the incorporation of IoRT within BP as a supplementary dimension to an already stressful and complicated situation. whereas (Masuda et al, 2021) defines it as a firms digitization through the automation of its process tasks.…”

ECMS 2022 Proceedings edited by Ibrahim A. Hameed, Agus Hasan, Saleh Abdel-Afou Alaliyat

“…Therefore, integrating IoRT within BP comes to bring the gap of the IoT-aware BP and the RPA. Recently, (Rebmann et al, 2020b) presented an approach for the real-time recognition of robot activities used for process assistance during a rescue mission based on IoT data. However, this model is applied to a specific field as it does not comply with any meta-model.…”

“…However, this model is applied to a specific field as it does not comply with any meta-model. In (Rebmann et al, 2020a), the authors define the incorporation of IoRT within BP as a supplementary dimension to an already stressful and complicated situation. whereas (Masuda et al, 2021) defines it as a firms digitization through the automation of its process tasks.…”