The Reliability of Tweets as a Supplementary Method of Seasonal Influenza Surveillance

Abstract

BackgroundExisting influenza surveillance in the United States is focused on the collection of data from sentinel physicians and hospitals; however, the compilation and distribution of reports are usually delayed by up to 2 weeks. With the popularity of social media growing, the Internet is a source for syndromic surveillance due to the availability of large amounts of data. In this study, tweets, or posts of 140 characters or less, from the website Twitter were collected and analyzed for their potential as surveillance for seasonal influenza.ObjectiveThere were three aims: (1) to improve the correlation of tweets to sentinel-provided influenza-like illness (ILI) rates by city through filtering and a machine-learning classifier, (2) to observe correlations of tweets for emergency department ILI rates by city, and (3) to explore correlations for tweets to laboratory-confirmed influenza cases in San Diego.MethodsTweets containing the keyword “flu” were collected within a 17-mile radius from 11 US cities selected for population and availability of ILI data. At the end of the collection period, 159,802 tweets were used for correlation analyses with sentinel-provided ILI and emergency department ILI rates as reported by the corresponding city or county health department. Two separate methods were used to observe correlations between tweets and ILI rates: filtering the tweets by type (non-retweets, retweets, tweets with a URL, tweets without a URL), and the use of a machine-learning classifier that determined whether a tweet was “valid”, or from a user who was likely ill with the flu.ResultsCorrelations varied by city but general trends were observed. Non-retweets and tweets without a URL had higher and more significant (P<.05) correlations than retweets and tweets with a URL. Correlations of tweets to emergency department ILI rates were higher than the correlations observed for sentinel-provided ILI for most of the cities. The machine-learning classifier yielded the highest correlations for many of the cities when using the sentinel-provided or emergency department ILI as well as the number of laboratory-confirmed influenza cases in San Diego. High correlation values (r=.93) with significance at P<.001 were observed for laboratory-confirmed influenza cases for most categories and tweets determined to be valid by the classifier.ConclusionsCompared to tweet analyses in the previous influenza season, this study demonstrated increased accuracy in using Twitter as a supplementary surveillance tool for influenza as better filtering and classification methods yielded higher correlations for the 2013-2014 influenza season than those found for tweets in the previous influenza season, where emergency department ILI rates were better correlated to tweets than sentinel-provided ILI rates. Further investigations in the field would require expansion with regard to the location that the tweets are collected from, as well as the availability of more ILI data.

Tanning bed burns reported on Twitter: over 15,000 in 2013

“…The growing popularity of Twitter among teenagers and young adults may provide opportunities for understanding indoor tanning behaviors and resulting injuries. The social networking service has been used to track the spread of infectious diseases such as influenza [11], H1N1 [12], pertussis [13], and foodborne illness [14]. Similar to foodborne illnesses, acute health consequences of tanning bed use, such as burns, are not routinely monitored or reported.…”

Exploring the Use of Big Data Analytics for Improving Support to Students in Higher Education

“…Through analysis of information flow, Big Data analytics looks for hidden threads, trends and patterns (Matteson, 2013). Influential examples of Big Data applications include Google Flu Trends, which provides predictions and estimates of influenza activity for more than 25 countries, through aggregation of Google search queries (Pervaiz, Pervaiz, Rehman & Saif, 2012); and the research of Aslam et al (2014), which reported on influenza-like illness rates through the collection and analysis of 159,802 tweets. While Big Data analytics is having a wide impact on public health and businesses' commercialization and marketing, its application remains limited in the field of education.…”

The new informatics of pandemic response: humanitarian technology, efficiency, and the subtle retreat of national agency

“…Scholars have explored a number of ways in which technology improves humanitarian diagnostics, including the use of mobile phone network data for human mobility mapping and contact tracing (Tatem et al 2009;Aslam et al 2014;Wesolowski et al 2014;Gittelman et al 2015;Bharti et al 2015;Bengtsson et al 2015), and big data or social media scraping for contagion modeling (Brownstein et al 2009;Chunara et al 2012). Such techniques allow humanitarian actors to extract information, diagnosing needs and epidemiological trends without direct contact with affected populations.…”