What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context

Abstract

Predicting the political bias and the factuality of reporting of entire news outlets are critical elements of media profiling, which is an understudied but an increasingly important research direction. The present level of proliferation of fake, biased, and propagandistic content online, has made it impossible to fact-check every single suspicious claim, either manually or automatically. Alternatively, we can profile entire news outlets and look for those that are likely to publish fake or biased content. This approach makes it possible to detect likely "fake news" the moment they are published, by simply checking the reliability of their source.From a practical perspective, political bias and factuality of reporting have a linguistic aspect but also a social context. Here, we study the impact of both, namely (i) what was written (i.e., what was published by the target medium, and how it describes itself on Twitter) vs. (ii) who read it (i.e., analyzing the readers of the target medium on Facebook, Twitter, and YouTube). We further study (iii) what was written about the target medium on Wikipedia. The evaluation results show that what was written matters most, and that putting all information sources together yields huge improvements over the current state-of-the-art.

Causal Extraction to Measure Media Bias? A Comparative Analysis of Causal Attributions in Reporting of the Israel-Palestine Conflict

“…One such paper, which rates articles by degree of polarisation, identifies a set of 130 content-based features that span 7 categories: structure, complexity, sentiment, bias, morality, topic and engagement [12], and show that they all contribute towards media bias detection. In contrast, media bias has also been classified by its stance towards an event [13] or by its place on the political compass [14].…”

Mimicking Human Verification Behavior for News Media Credibility Evaluation

“…In addition to textual content information, it is also possible to use relevant features, such as domain names, certificates, and hosting attributes of news media websites [12], webpage design [13], and websites linked [14], in order to estimate the credibility of news media. By using the social background information of news media websites, the internal connection between news websites and social background information was studied [15]. Hounsel et al made predictions based on the domain, the certificate, and the hosting information from the website infrastructure as potential indicators of source reliability [12].…”

Large-scale, Language-agnostic Discourse Classification of Tweets During COVID-19

“…Studies involving Twitter data have been utilizing these contextual sentence embeddings successfully as well [69,70,71,72].…”