Modeling Spatiotemporal Factors Associated With Sentiment on Twitter: Synthesis and Suggestions for Improving the Identification of Localized Deviations

Abstract

Background Studies examining how sentiment on social media varies depending on timing and location appear to produce inconsistent results, making it hard to design systems that use sentiment to detect localized events for public health applications. Objective The aim of this study was to measure how common timing and location confounders explain variation in sentiment on Twitter. Methods Using a dataset of 16.54 million English-language tweets from 100 cities posted between July 13 and November 30, 2017, we estimated the positive and negative sentiment for each of the cities using a dictionary-based sentiment analysis and constructed models to explain the differences in sentiment using time of day, day of week, weather, city, and interaction type (conversations or broadcasting) as factors and found that all factors were independently associated with sentiment. Results In the full multivariable model of positive (Pearson r in test data 0.236; 95% CI 0.231-0.241) and negative (Pearson r in test data 0.306; 95% CI 0.301-0.310) sentiment, the city and time of day explained more of the variance than weather and day of week. Models that account for these confounders produce a different distribution and ranking of important events compared with models that do not account for these confounders. Conclusions In public health applications that aim to detect localized events by aggregating sentiment across populations of Twitter users, it is worthwhile accounting for baseline differences before looking for unexpected changes.

What news sparks interest on YouTube? A study of news content uploaded by India's top five Hindi news networks

“…Parabhoi (2019) analysed the sentiments of tweets from Twitter of ten university libraries ranked in World University ranking 2019 using Mozdeh and reported that the Bodleian Library of Oxford University library is high on positive sentiments and exhibition and archive are revealed to have top word frequency. Shah et al. (2019) used a dictionary-based sentiment analysis technique to detect the variation of Twitter posts among 100 cities with the time frame of July 13th to November 30th, 2017 identifying the positive sentiments and negative sentiments by comparing the time, location and social interactions on Twitter.…”

Spatiotemporal data mining: a survey on challenges and open problems

“…( 2011 ) and sentiment analysis Shah et al. ( 2019 ). However, recent studies have shown that such models may have biasness and discrimination against different races and genders.…”

Spatiotemporal Data Mining: A Survey on Challenges and Open Problems

“…The spatiotemporal analysis of social data is an evolving area. It has different tasks such as density estimation [295], collaborative filtering for recommender systems [205,152] and sentiment analysis [241]. However, recent studies have shown that such models may have biasness and discrimination against different races and genders.…”