Evaluation of the Syntactic Annotation in EPEC, the Reference Corpus for the Processing of Basque

Uria, Larraitz; Estarrona, Ainara; Aldezabal, Izaskun; Aranzabe, Maxux; Ilarraza, Arantza Díaz de; Iruskieta, Mikel

doi:10.1007/978-3-642-00382-0_6

Cited by 1 publication

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This coefficient provides a good measure of agreement (Artstein and Poesio 2008) as it takes into consideration the agreement by chance along the observed agreement. The Kappa coefficient κ is widely regarded as a measurement of IAA, and has been used by several researchers to evaluate their work, such as the evaluation of the Irish Treebank (Lynn et al 2012), evaluation of Hindi Treebank (Gupta et al 2010), and evaluation of Basque corpus (Uria et al 2009). In addition, it has been used as a measure of annotators' objectivity in different tasks; such as POS annotation (Mieskes and Strube 2006), discourse annotation in the GNOME corpus (Poesio 2004), and word sense disambiguation (Bruce and Wiebe 1998;Véronis 1998).…”

Section: Metricsmentioning

confidence: 99%

Curras: an annotated corpus for the Palestinian Arabic dialect

Jarrar

Habash

Alrimawi

et al. 2016

Lang Resources & Evaluation

View full text Add to dashboard Cite

In this article we present Curras, the first morphologically annotated corpus of the Palestinian Arabic dialect. Palestinian Arabic is one of the many primarily spoken dialects of the Arabic language. Arabic dialects are generally under-resourced compared to Modern Standard Arabic, the primarily written and official form of Arabic. We start in the article with a background description that situates Palestinian Arabic linguistically and historically and compares it to Modern Standard Arabic and Egyptian Arabic in terms of phonological, morphological, orthographic, and lexical variations. We then describe the methodology we developed to collect Palestinian Arabic text to guarantee a variety of representative domains and genres. We also discuss the annotation process we used, which extended previous efforts for annotation guideline development, and utilized existing automatic annotation solutions for Standard Arabic and Egyptian Arabic. The annotation guidelines and annotation meta-data are described in detail. The Curras Palestinian Arabic corpus consists of more than 56 K tokens, which are annotated with rich morphological and lexical features. The inter-annotator agreement results indicate a high degree of consistency.

show abstract

Section: Metricsmentioning

confidence: 99%