Infodemic: Challenges and solutions in topic discovery and data process

Abstract

Background The COVID-19 pandemic was a huge shock to society, and the ensuing information problems had a huge impact on society at the same time. The urgent need to understand the infodemic, i.e. the importance of the spread of misinformation and rumors related to the epidemic, has been highlighted. However, while there is a growing interest in this phenomenon, studies on the subject discovery, data collection, and data preparation phases of the information analysis process have been lacking. Objective Since the epidemic is unprecedented and has not ended to this day, we aimed to examine the existing infodemic-related literature from the beginning of the epidemic to December 2022. Methods We have systematically searched ScienceDirect and IEEE Xplore databases with some search limitations. From the searched literature we selected titles, abstracts and keywords, and limitations sections. We conducted an extensive structured literature search and analysis by filtering the literature and sorting out the available information. Results A total of 47 papers ended up meeting the requirements of this review. Researchers in all of these literatures encountered different challenges, most of which were focused on the data collection step, with few challenges encountered in the data preparation phase and almost none in the topic discovery section. The challenges were mainly divided into the points of how to collect data quickly, how to get the required data samples, how to filter the data, what to do if the data set is too small, and how to pick the right classifier. In addition, researchers have proposed partial solutions to the challenges, and we have also proposed possible solutions. Conclusions This review found that information epidemics is a rapidly growing research area that attracts the interest of researchers from different disciplines. The number of studies in this field has increased significantly in recent years, with researchers from different countries, including the United States, India, and China. Infodemic topic discovery, data collection, and data preparation are not easy, and each step faces different challenges. While there is some research in this emerging field, there are still many challenges that need to be addressed. These findings highlight the need for more articles to address these issues and fill these gaps.