How do metrics of link analysis correlate to quality, relevance and popularity in wikipedia?

Abstract

Many links between Web pages can be viewed as indicative of the quality and importance of the pages they pointed to. Accordingly, several studies have proposed metrics based on links to infer web page content quality. However, as far as we know, the only work that has examined the correlation between such metrics and content quality consisted of a limited study that left many open questions. Despite the fact that these metrics showed to be successful in the task of ranking pages provided as answers to queries submitted to search engines, it is not possible to determine the specific contribution that factors such as quality, popularity, and importance have on the results. This difficulty is partially due to the fact that such information about Web pages in general is hard to obtain. Unlike ordinary Web pages, the quality, importance and popularity of Wikipedia articles are evaluated by human experts or might be easily estimated. Thus, it is feasible to verify the relationship between link analysis metrics and the afore mentioned factors in Wikipedia articles. This is our goal in this work. In order to accomplish that, we implemented several link analysis algorithms and compared their resulting rankings with the ones created by human evaluators regarding factors such as quality, popularity and importance. We found that the metrics are more correlated to quality and popularity than to importance, and that the correlations are moderate.

Relative Quality and Popularity Evaluation of Multilingual Wikipedia Articles

“…Furthermore, the references themselves can have their own quality metrics (e.g., impact factor), which can be used as an indirect indicator of the article's quality. For popularity measurementsm it can be useful to add some metrics related to link analysis in Wikipedia articles [26]. In the future, we plan to continue studies on new metrics and their extraction methods for improving the Wikipedia article quality assessment model.…”

A wikification prediction model based on the combination of latent, dyadic, and monadic features

“…The aforementioned studies assume that the manual quality assessment of Wikipedia articles and the associated reviewing processes lead to reliable ground truth about content quality. This idea has been challenged because missing links can exist for a long time (Sunercan & Birturk, ), links can be biased towards popularity and importance (Hanada, Cristo, & Pimentel, ), and links are rarely clicked (Paranjape, West, Zia, & Leskovec, ). This last issue is remarkable as it would be expected that appropriate links should be followed once they are created.…”

A wikification prediction model based on the combination of latent, dyadic and monadic features

“…The aforementioned studies assume that the manual quality assessment of Wikipedia articles and the associated reviewing processes lead to reliable ground truth about content quality. This idea has been challenged because missing links can exist for a long time (Sunercan & Birturk, 2010), links can be biased towards popularity and importance (Hanada, Cristo, & Pimentel, 2013), and links are rarely clicked (Paranjape, West, Zia, & Leskovec, 2016). This last issue is remarkable as it would be expected that appropriate links should be followed once they are created.…”