A deep multi-modal neural network for informative Twitter content classification during emergencies

Abstract

People start posting tweets containing texts, images, and videos as soon as a disaster hits an area. The analysis of these disaster-related tweet texts, images, and videos can help humanitarian response organizations in better decision-making and prioritizing their tasks. Finding the informative contents which can help in decision making out of the massive volume of Twitter content is a difficult task and require a system to filter out the informative contents. In this paper, we present a multi-modal approach to identify disaster-related informative content from the Twitter streams using text and images together. Our approach is based on long-short-term-memory (LSTM) and VGG-16 networks that show significant improvement in the performance, as evident from the validation result on seven different disaster-related datasets. The range of F1-score varied from 0.74 to 0.93 when tweet texts and images used together, whereas, in the case of only tweet text, it varies from 0.61 to 0.92. From this result, it is evident that the proposed multi-modal system is performing significantly well in identifying disaster-related informative social media contents.

Social media and sensemaking patterns in new product development: demystifying the customer sentiment

“…Hence, we extend current studies (e.g. Kumar et al 2020) in that we use this data to make sense of the proposed products during the NPD process, reinvigorating the role of customers as active participants in the process of co-creation (Irani et al 2017). Therefore, we contribute to the research on effective customer involvement to create synergies and networks that are necessary for the creation of products that satisfy customer needs and aspirations and the strategic goals of the organisation (Romero and Molina 2011; Niesten and Stefan 2019).…”

“…Social media in general, and Twitter feeds in particular, are often used for expression of public opinion in the political discussion (Stieglitz and Dang-Xuan 2013), crisis management in emergencies Kumar et al 2020;Singh et al 2019) and information sharing for humanitarian operations (Maresh-Fuehrer and Smith 2016; Panagiotopoulos et al 2016). Bruns and Stieglitz (2013) explain that often Twitter can support and influence various situations, spanning from isolated crises to cultural interactions, but also reviews of products and services (Rehman et al 2016; See-To and Ngai 2018).…”

A Framework for Hate Speech Detection Using Deep Convolutional Neural Network

“…To mitigate this misclassification, we further used another deep neural model called LSTM. The LSTM model works well with sequential data, where the model needs to preserve the context of long-sequence [42], [43]. As it can be seen from Fig 2, a LSTM unit mainly has four gates, (i) input gate (I t ), (ii) output gate (O t ), (iii) forget gate (F t ) and (iv) memory unit (c t ).…”

Human Sentiment and Activity Recognition in Disaster Situations Using Social Media Images Based on Deep Learning

“…To this end, visual content will deliver precise information on the severity and extent of the damage, a better understanding of shelter needs, a more precise assessment of current emergency operations, and easier identification of missing and wounded. Early studies explore the significance of analyzing social media visual content in diverse catastrophe/disaster situations, such as flooding [ 43 ], fires, and earthquakes [ 44 , 45 ], motivated by this phenomenon.…”