Visualization, Search, and Error Analysis for Coreference Annotations

Abstract

We present the ICARUS Coreference Explorer, an interactive tool to browse and search coreference-annotated data. It can display coreference annotations as a tree, as an entity grid, or in a standard textbased display mode, and lets the user switch freely between the different modes. The tool can compare two different annotations on the same document, allowing system developers to evaluate errors in automatic system predictions. It features a flexible search engine, which enables the user to graphically construct search queries over sets of documents annotated with coreference.

Knowledge-lean projection of coreference chains across languages

“…Problems (2) and ( 3) are the more interesting ones for a qualitative error analysis. For this purpose, we visualized the projected files and the gold standard using the coreference module of the ICARUS corpus analysis platform (Gärtner et al, 2014). 50% of the data was randomly selected for the detailed analysis, and we determined the most frequent projection errors and categorized them into three different groups.…”

Digitale Infrastrukturen für die germanistische Forschung

“…ICARUS entstand als Werkzeug zur Visualisierung und beispielbasierten Suche auf Dependenz-Baumbanken und wurde kontinuierlich erweitert, um sowohl Annotationen für Koreferenz (Gärtner et al 2014), als auch Prosodie (Gärtner et al 2015) Abb. 6.5: Exploration der tonalen Realisierung von engen Appositionen.…”

A method for in-depth comparative evaluation: How (dis)similar are outputs of pos taggers, dependency parsers and coreference resolvers really?

“…Another branch of evaluation related to our work is error analysis. Gärtner et al (2014) presented a tool to explore coreference errors visually, but does not aggregate and classify them. Kummerfeld and devised a set of error classes for coreference and analysed quantitatively which systems make which errors.…”