Web Scraping of Disease Information From Social Media Twitter

Abstract

Environmental degradation caused by land conversion, trash (both domestic and industrial), and natural catastrophes is all variables that contribute to the establishment of disease susceptibility. Experts throughout the world suggest “ONE HEALTH” as a strategy for dealing with the threat of zoonoses. The One Health concept is a worldwide strategy to expand interdisciplinary collaboration and communication in all aspects of health care for humans, animals, and the environment. To overcome this disease of zoonoses, we developed a system of information zoonoses and Emerging Infectious Disease (SIZE). In this system of SIZE, we gather the disease information from social media. The disease information was collected from Twitter are Demam Berdarah Dengue (DBD), malaria disease, Antraks Disease, Canine Madness (Anjing Gila), Bird Flu (flu burung), and Ebola Disease. Twitter is a social media platform that has become a constant resource developing for data collectors. To perform this task to get the data of disease information, related tweets and Twitter user details the data collection using web scraping. Data Collection from Twitter was carried out by applying web scraping technology using python language. The scraping experiment from twitter in this study has succeeded in retrieving disease information from 2015-2020 using an advanced tool for Twitter scrapping called Twint using the python script. As the results lately have been increased number of tweets of diseases from canine madness (anjing gila) 34477, followed by Malaria Disease (28046) and Demam Berdarah Dengue (DBD) 11950 in 2020.

Web Scraping Scientific Repositories: Springer and Nature for University of Basrah

“…Regular expressions are most common in extracting information from HTML components, as well as using string manipulation methods. [14] Retrieval of structured data through online table extraction. In such cases, a complex approach is applied that includes the detection of certain patterns across rows and columns and determining the search content [15]Dynamic rendering usually demands more complicated technologies, which are particularly relevant for a page with JavaScript involved.…”

Analisis Sentimen Pengguna Sosial Media Twitter Terhadap Perokok Di Indonesia

“…Twint adalah alat untuk mengambil informasi dari Twitter. Python adalah bahasa pemrograman untuk membuat Twint, dan pip atau conda dapat digunakan untuk menginstal python [16]. Library Twint dipilih karena dapat mengambil data tweet pada twitter tanpa memerlukan Twitter API [17].…”

Analisis Topic Modelling Persepsi Pengguna Internet Menggunakan Metode Latent Dirichlet Allocation

“…Berita adalah suatu peristiwa yang baru terjadi, dimana di dalam berita terbagi menjadi judul, teras, dan tubuh berita. Berita dibuat guna untuk memberikan informasi mengenai suatu topik permasalahan yang dibahas secara lengkap guna untuk informasi dan pengetahuan [8]. Pada era sebelumnya berita hanya dapat kita nikmati dalam bentuk offline, yaitu dalam bentuk media cetak, lisan, radio, siaran televisi.…”