Designing Multimodal Interactive Dashboard of Disaster Management Systems

Abstract

Disasters and crises are inevitable in this world. In the aftermath of a disaster, a society’s overall growth, resources, and economy are greatly affected as they cause damages from minor to huge proportions. Around the world, countries are interested in improving their emergency decision-making. The institutions are paying attention to collecting different types of data related to crisis information from various resources, including social media, to improve their emergency response. Previous efforts have focused on collecting, extracting, and classifying crisis data from text, audio, video, or files; however, the development of user-friendly multimodal disaster data dashboards to support human-to-system interactions during an emergency response has received little attention. Our paper seeks to fill this gap by proposing usable designs of interactive dashboards to present multimodal disaster information. For this purpose, we first investigated social media data and metadata for the required elicitation and analysis purposes. These requirements are then used to develop interactive multimodal dashboards to present complex disaster information in a usable manner. To validate our multimodal dashboard designs, we have conducted a heuristic evaluation. Experts have evaluated the interactive disaster dashboards using a customized set of heuristics. The overall assessment showed positive feedback from the evaluators. The proposed interactive multimodal dashboards complement the existing techniques of collecting textual, image, audio, and video emergency information and their classifications for usable presentation. The contribution will help the emergency response personnel in terms of useful information and observations for prompt responses to avoid significant damage.

Design and Implementation of an Interactive Visualization Dashboard for Monitoring the Flood Vulnerability and Mapping

“…Based on research conducted by Gayane et al in 2018, dashboard development aims to improve performance in the decision-making process by visualizing based on expected conditions to detect potential problems that may occur [9]. By using an interactive dashboard, users are expected to easily monitor and visualize emergency response conditions quickly when there is a certain disaster [10]. According to [11]- [14] Geospatial dashboards strongly support the purpose of smart cities, namely with their ability to track city performance measurements.…”

Social Media Multimodal Information Analysis based on the BiLSTM-Attention-CNN-XGBoost Ensemble Neural Network

“…Social media platforms involving Weibo, WeChat, Facebook, Instagram, and Twitter have evolved into (1) key real-time information acquisition channels in disaster management and (2) information communication tools in physical and virtual contexts following the advent of the mobile Internet [1][2][3]. A vast amount of rescue and assistance information is promptly shared on digital platforms.…”

Automatic Classification of Eyewitness Messages for Disaster Events Using Linguistic Rules and ML/AI Approaches

“…The capacity of Twitter in terms of event detection was also studied widely, and various techniques were proposed to detect events from tweets [4,5]. Researchers in this domain have proposed systems for news recommendations [6,7], sentiment analysis [8][9][10], disaster and emergency alerts [11], response systems [12,13], etc. Analyzing such data is essential for event detection, especially in emergency conditions due to natural disasters such as floods, hurricanes, fires, or earthquakes [1,14].…”