Linked Data in the European Data Portal: A Comprehensive Platform for Applying DCAT-AP

Kirstein, Fabian; Dittwald, Benjamin; Dutkowski, Simon; Glikman, Yury; Schimmler, Sonja; Hauswirth, Manfred

doi:10.1007/978-3-030-27325-5_15

Cited by 24 publications

(21 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Fourth, it supports various functions for data providers and users. Therefore, CKAN has become the most popular open-data distribution platform widely adopted by many governments, including the United States (data.gov), United Kingdom (data.gov.uk), Canada (open.canada.ca), Australia (data.gov.au), and the European Union (europ eanda tapor tal.eu) [10].…”

Section: Open Data and Distribution Platformsmentioning

confidence: 99%

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

et al. 2021

View full text Add to dashboard Cite

refer to data that anyone can easily access, (re) use, and redistribute over the Internet without particular restrictions. Representative data platforms for distributing such open data include the Comprehensive Knowledge Archive Network (CKAN) [1], Open Government Platform (OGPL) [2], and Socrata [3]. CKAN is an open-data distribution platform used in more than 40 countries, including the United Kingdom, the United States, and Canada. It is a data management project initiated by the Open Knowledge Foundation (OKF), a nonprofit foundation based on the United Kingdom. In addition to basic functions, such as data registration, publication, and statistics, CKAN supports specialized functions, such as visualization and API extraction, by combining with other open sources, including Drupal [4]. CKAN supports this specialized function under the name Extension.

show abstract

Section: Open Data and Distribution Platformsmentioning

confidence: 99%

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Charalabidis et al [1] survey the domain of Open Data and describe differences and similarities to government data, big data and linked data. Government agencies have a long history of publishing their data as open government data and Open Data portals have adopted linked data principles and serve linked open data on a large scale [11,12]. This makes linked open government data an established part of data published on the Web.…”

Section: Related Workmentioning

confidence: 99%

“…Therefore, we applied the general use statistics of the European Data Portal (EDP) as a rough baseline. The EDP is one of the biggest Open Data portals in the world and in 2018 an average of 1.300 visitors per day was measured [11]. We liberally assume that around 10% of these users will constantly subscribe to a real-time data stream, leading to a threshold of 100 simultaneous requests.…”

Section: Performance Evaluationmentioning

confidence: 99%

Ronda: Real-Time Data Provision, Processing and Publication for Open Data

Kirstein

Bacher

Bohlen

et al. 2021

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

The provision and dissemination of Open Data is a flourishing concept, which is highly recognized and established in the government and public administrations domains. Typically, the actual data is served as static file downloads, such as CSV or PDF, and the established software solutions for Open Data are mostly designed to manage this kind of data. However, the rising popularity of the Internet of things and smart devices in the public and private domain leads to an increase of available real-time data, like public transportation schedules, weather forecasts, or power grid data. Such timely and extensive data cannot be used to its full potential when published in a static, file-based fashion. Therefore, we designed and developed Ronda - an open source platform for gathering, processing and publishing real-time Open Data based on industry-proven and established big data and data processing tools. Our solution easily enables Open Data publishers to provide real-time interfaces for heterogeneous data sources, fostering more sophisticated and advanced Open Data use cases. We have evaluated our work through a practical application in a production environment.

show abstract

“…In order to comply with established Open Data publishing concepts, the first version was based on an extended CKAN with an additional layer for transforming and replicating all metadata into RDF. This setup required additional mechanisms to transform data and, thus, proved to be too complex and limited for the growing amounts of Open Data in Europe [19]. We successfully improved this first version with our solution Piveau.…”

Section: The European Data Portalmentioning

confidence: 99%

Piveau: A Large-Scale Open Data Management Platform Based on Semantic Web Technologies

Kirstein

Stefanidis

Dittwald

et al. 2020

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

The publication and (re)utilization of Open Data is still facing multiple barriers on technical, organizational and legal levels. This includes limitations in interfaces, search capabilities, provision of quality information and the lack of definite standards and implementation guidelines. Many Semantic Web specifications and technologies are specifically designed to address the publication of data on the web. In addition, many official publication bodies encourage and foster the development of Open Data standards based on Semantic Web principles. However, no existing solution for managing Open Data takes full advantage of these possibilities and benefits. In this paper, we present our solution "Piveau", a fully-fledged Open Data management solution, based on Semantic Web technologies. It harnesses a variety of standards, like RDF, DCAT, DQV, and SKOS, to overcome the barriers in Open Data publication. The solution puts a strong focus on assuring data quality and scalability. We give a detailed description of the underlying, highly scalable, service-oriented architecture, how we integrated the aforementioned standards, and used a triplestore as our primary database. We have evaluated our work in a comprehensive feature comparison to established solutions and through a practical application in a production environment, the European Data Portal. Our solution is available as Open Source.

show abstract

Linked Data in the European Data Portal: A Comprehensive Platform for Applying DCAT-AP

Cited by 24 publications

References 4 publications

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

Ronda: Real-Time Data Provision, Processing and Publication for Open Data

Piveau: A Large-Scale Open Data Management Platform Based on Semantic Web Technologies

Contact Info

Product

Resources

About