European Language Grid: A Joint Platform for the European Language Technology Community

Rehm, Georg; Piperidis, Stelios; Bontcheva, Kalina; Hajič, Jan; Arranz, Victoria; Vasiļjevs, Andrejs; Backfried, Gerhard; Gómez-Pérez, José Manuel; Germann, Ulrich; Calizzano, Rémi; Feldhus, Nils; Hegele, Stefanie; Kintzel, Florian; Marheinecke, Katrin; Schneider, Julián Moreno; Galanis, Dimitris; Labropoulou, Penny; Deligiannis, Miltos; Gkirtzou, Katerina; Kolovou, Athanasia; Gkoumas, Dimitris; Voukoutis, Leon; Roberts, Ian; Hamrlová, Jana; Variš, Dušan; Kačena, Lukáš; Choukri, Khalid; Mapelli, Valérie; Rigault, M.; Melnika, Julija; Janosik, Miro; Prinz, Katja; García-Silva, Andrés; Berrio, Cristian; Klejch, Ondřej; Renals, Steve

doi:10.18653/v1/2021.eacl-demos.26

Cited by 20 publications

(25 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, we offer Docker images 7 for enhanced reproducibility and compatibility with various platforms. Finally, we integrated a running instance 8 of the software into the European Language Grid 9 [50,51], a European platform for language technologies. This integration has multiple implications: First of all, it is open and free, which enables us to provide our backend software as a service to not just the design team, but anyone interested in ACA.…”

Section: Methodsmentioning

confidence: 99%

User Experience Design for Automatic Credibility Assessment of News Content About COVID-19

Schulz¹,

Rauenbusch²,

Jan³

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

The increasingly rapid spread of information about COVID-19 on the web calls for automatic measures of credibility assessment [18]. If large parts of the population are expected to act responsibly during a pandemic, they need information that can be trusted [20].In that context, we model the credibility of texts using 25 linguistic phenomena, such as spelling, sentiment and lexical diversity. We integrate these measures in a graphical interface and present two empirical studies to evaluate its usability for credibility assessment on COVID-19 news. Raw data for the studies, including all questions and responses, has been made available to the public using an open license: https://github.com/ konstantinschulz/credible-covid-ux. The user interface prominently features three sub-scores and an aggregation for a quick overview. Besides, metadata about the concept, authorship and infrastructure of the underlying algorithm is provided explicitly. Our working definition of credibility is operationalized through the terms of trustworthiness, understandability, transparency, and relevance. Each of them builds on well-established scientific notions [41,65,68] and is explained orally or through Likert scales. In a moderated qualitative interview with six participants, we introduce information transparency for news about COVID-19 as the general goal of a prototypical platform, accessible through an interface in the form of a wireframe [43]. The participants' answers are transcribed in excerpts. Then, we triangulate inductive and deductive coding methods [19] to analyze their content. As a result, we identify rating scale, sub-criteria and algorithm authorship as important predictors of the usability. In a subsequent quantitative online survey, we present a questionnaire with wireframes to 50 crowdworkers. The question formats include Likert scales, multiple choice and open-ended types. This way, we aim to strike a balance between the known strengths and weaknesses of open vs. closed questions [11]. The answers reveal a conflict between transparency and conciseness in the interface design: Users tend to ask for more information, but do not necessarily make explicit use of it when given. This discrepancy is influenced by capacity constraints of the human working memory [38]. Moreover, a perceived hierarchy of metadata

show abstract

Section: Methodsmentioning

confidence: 99%

User Experience Design for Automatic Credibility Assessment of News Content About COVID-19

Schulz¹,

Rauenbusch²,

Jan³

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…To overcome this limitation and to support a metadata harmonization process, several initiatives (e.g., LRE map 1 [12], European Language Grid 2 [48], CLARIN 3 [35], Nexus Linguarum 4 [22], Prêt-à-LLOD 5 [23], Elexis 6 [40]) have been proposed to promote community-based documentation and definitions of existing resources and standards. However, many challenges about resource discovery, reuse and integration are still present, due to the fact that issues of interoperability between different types of resources persist [14].…”

Section: Mp DI Buono Et Al / Enriched Metadata Of Lldmentioning

confidence: 99%

“…the property source from the Dublin Core Metadata Terms 46 is used to specify whether the resource comes from Annohub or LOD Cloud; the property sameAs from the OWL Web Ontology 47 is used to link together two resources that have both an URI from Annohub and one from LOD Cloud; the property hasIdentifier from DataCite ontology 48 is used to specify the ORCID for contacts.…”

Section: Metadata Alignmentmentioning

confidence: 99%

See 1 more Smart Citation

Paving the way for enriched metadata of linguistic linked data

Buono

Oliveira

Mititelu

et al. 2022

View full text Add to dashboard Cite

The need for reusable, interoperable, and interlinked linguistic resources in Natural Language Processing downstream tasks has been proved by the increasing efforts to develop standards and metadata suitable to represent several layers of information. Nevertheless, despite these efforts, the achievement of full compatibility for metadata in linguistic resource production is still far from being reached. Access to resources observing these standards is hindered either by (i) lack of or incomplete information, (ii) inconsistent ways of coding their metadata, and (iii) lack of maintenance. In this paper, we offer a quantitative and qualitative analysis of descriptive metadata and resources availability of two main metadata repositories: LOD Cloud and Annohub. Furthermore, we introduce a metadata enrichment, which aims at improving resource information, and a metadata alignment to META-SHARE ontology, suitable for easing the accessibility and interoperability of such resources.

show abstract

“…Large scale research infrastructure projects like CLARIN (De Jong et al, 2018), DARIAH (Edmond et al, 2017) or ELG (Rehm et al, 2021) aim at making language resources and tools available to, sustainable for and easily reusable by their stakeholders. These efforts have proven to create standards and frameworks and have become a reference point for visibility.…”

Section: Introductionmentioning

confidence: 99%

Collaborating on Language Resource Infrastructures with Non-ResearchPartners: Practicalities and Challenges

Lyding¹,

Stemle²,

König³

2022

Linköping Electronic Conference Proceedings

View full text Add to dashboard Cite

European Language Grid: A Joint Platform for the European Language Technology Community

Cited by 20 publications

References 4 publications

User Experience Design for Automatic Credibility Assessment of News Content About COVID-19

User Experience Design for Automatic Credibility Assessment of News Content About COVID-19

Paving the way for enriched metadata of linguistic linked data

Collaborating on Language Resource Infrastructures with Non-ResearchPartners: Practicalities and Challenges

Contact Info

Product

Resources

About