Improving Named Entity Linking Corpora Quality

Weichselbraun, Albert; Brașoveanu, Adrian; Kuntschik, Philipp; Nixon, Lyndon

doi:10.26615/978-954-452-056-4_152

Cited by 3 publications

(1 citation statement)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…More recently, lenses have been used to understand entity annotations (Braşoveanu et al, 2018a) and to study the effect of relaxed annotation schemas that include more types than usual (Rosales-Méndez et al, 2018a). A theoretical treatment of automatic procedures for building lenses is presented in (Weichselbraun et al, 2019a). The paper showcases how to automatically build lenses by following simple rules (e.g., expand the surface form to the maximum length -the longest mention -or reduce the surface form to the minimal possible length -the shortest mention).…”

Section: Related Workmentioning

confidence: 99%

In Media Res: A Corpus for Evaluating Named Entity Linking with Creative Works

Brașoveanu

Weichselbraun

Nixon

2020

Proceedings of the 24th Conference on Computational Natural Language Learning

Self Cite

View full text Add to dashboard Cite

Annotation styles express guidelines that direct human annotators by explicitly stating the rules to follow when creating gold standard annotations of text corpora. These guidelines not only shape the gold standards they help create, but also influence the training and evaluation of Named Entity Linking (NEL) tools, since different annotation styles correspond to divergent views on the entities present in a document. Such divergence is particularly relevant for texts from the media domain containing references to creative works. This paper presents a corpus of 1000 annotated documents from sources such as Wikipedia, TVTropes and WikiNews that are organized in ten partitions. Each document contains multiple gold standard annotations representing various annotation styles. The corpus is used to evaluate a series of Named Entity Linking tools in order to understand the impact of the differences in annotation styles on the reported accuracy when processing highly ambiguous entities such as names of creative works. Relaxed annotation guidelines that include overlap styles, for instance, lead to better results across all tools.

show abstract

Section: Related Workmentioning

confidence: 99%