VACIT: Tool for Consumption, Analysis and Machine Learning for LOD Resources on CKAN Instances

Varón-Capera, Álvaro; Gaona-García, Paulo Alonso; Cubides, Jhon Francined Herrera; Montenegro-Marín, Carlos Enrique

doi:10.1007/978-3-030-03577-8_60

Cited by 3 publications

(5 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As explained in [48], the metadata describes the dataset and specifes its content. Tese tags allow us to relate datasets of diferent instances to a specifc knowledge domain.…”

Section: Analysis Of Resultsmentioning

confidence: 99%

“…Two main challenges were posed to carry out the experimental phase: how to query the selected data instances and how to tabulate and visualize the queried information, taking into account the defned variables? Visual analytics for CKAN instances Tool was built for this purpose [48]. Te tool provides a series of visual analytics about the current state of the datasets queried from the diferent datasets published in CKAN instances.…”

Section: Data Exploitation Strategymentioning

confidence: 99%

See 1 more Smart Citation

The Relevance of Open Data Principles for the Web of Data

Herrera-Cubides,

Gaona-García,

Montenegro-Marin

et al. 2023

Journal of Electrical and Computer Engineering

Self Cite

View full text Add to dashboard Cite

Open data has been improving both publishing platforms and the consumers-oriented process over the years, providing better openness policies and transparency. Although organizations have tried to open their data, the enrichment of their resources through the Web of Data has been decreasing. Linked data has been suffering from notable difficulties in different stages of its life cycle, becoming over the years less attractive to users. According to that, we decided to explore how the lack of some opening requirements affects the decline of the Web of Data. This paper presents the Web of Data radiography, analyzing the governmental domain as a case study. The results indicate that it is necessary to strengthen the data opening process to improve resource enrichment on the Web and have better datasets. These improvements describe that open data must be public, accessible (in machine-readable formats), described (use of robust, granular metadata), reusable (made available under an open license), complete (published in primary forms), and timely (preserve the value of the data). The implementation of these characteristics would enhance the availability and reuse of datasets. Besides, organizations must understand that opening and enriching their data require a completely new approach, and they have to pay special attention and control to this project, generally by putting money, the commitment by management at all levels, and lots of time. On the contrary, given the magnitude of availability and reuse problems identified in the opening and enrichment data process, it is believed that the Web of Data model would inevitably lose the interest it aroused at the beginning if not addressed immediately by data quality, openness, and enrichment issues. Besides, its use would be restricted to a few particular niches or would even disappear altogether.

show abstract

“…As explained in [48], the metadata describes the dataset and specifes its content. Tese tags allow us to relate datasets of diferent instances to a specifc knowledge domain.…”

Section: Analysis Of Resultsmentioning

confidence: 99%

Section: Data Exploitation Strategymentioning

confidence: 99%

The Relevance of Open Data Principles for the Web of Data

Herrera-Cubides,

Gaona-García,

Montenegro-Marin

et al. 2023

Journal of Electrical and Computer Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Open data lakes: We classify research on open data lakes into (1) data platforms, [34][35][36][37] (2) government open data portals, 33,38,39 (3) systems operating on open data lakes, [40][41][42][43] and ( 4) custom open data lakes. 16 First, research on data platforms is mainly to improve or expand CKAN, and there are also studies on new data platforms that focus on sustainability and improve user consumption environments, such as SuDaMa.…”

Section: Related Workmentioning

confidence: 99%

Demeter: An automatic framework for data migration in open data lakes

Kim,

Han,

Son

et al. 2023

Softw Pract Exp

View full text Add to dashboard Cite

An open data lake stores various forms and types of open data, and there is an increasing demand to manage raw data in tables rather than files for efficient data exploration and analysis. In this paper, we investigate the data management of open data lakes and recognize the limitations of table migration and related problems. First, open data lakes have problems of preprocessing complexity, scale limitation, and platform dependency due to the traditional data management method and open data characteristics. Second, existing studies for table migration have problems of lack of scalability, migration incompleteness, and scale limitation. In this work, we present a novel automation framework, called Demeter, which solves three problems inherent in open data lakes by expanding automation. Specifically, it supports automating catalog collection and preprocessing tasks to solve preprocessing complexity and scale limitation. It also supports platform universality for representative data platforms through the automation of catalog analysis and detailed processing logic. Demeter then solves three problems in table migration by adopting Airbyte, an open‐source ELT platform, and by enhancing automation capability with the Airbyte manager. We verify that Demeter resolves all the problems above through extensive experiments and proves its scalability and universality. In addition, significantly outperforms CKAN by Demeter up to 508.5% in automation performance, up to 207.28% in processing time, and up to 917.17% in migration performance. These results indicate that Demeter is an excellent automation framework that increases the utilization of large‐scale open data and supports reliable Internet‐scale migration.

show abstract

“…Macedo [24] proposed the CKAN Extension for easier data publication and management compared with the existing CKAN. Varon-Capera et al [25] proposed a visualization tool that provides visual analysis to increase the CKAN data utilization. Scholz et al [26] proposed a CKAN plug-in that stores actual data in HDFS by utilizing CKAN as a metadata catalog.…”

Section: Related Workmentioning

confidence: 99%

“…Internet | with [24,25], we propose various solutions in the viewpoint of data providers and platform administrators. In addition, our method fundamentally solves the data inconsistency and storage waste problems compared with [26].…”

Section: Routesmentioning

confidence: 99%

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

et al. 2021

View full text Add to dashboard Cite

refer to data that anyone can easily access, (re) use, and redistribute over the Internet without particular restrictions. Representative data platforms for distributing such open data include the Comprehensive Knowledge Archive Network (CKAN) [1], Open Government Platform (OGPL) [2], and Socrata [3]. CKAN is an open-data distribution platform used in more than 40 countries, including the United Kingdom, the United States, and Canada. It is a data management project initiated by the Open Knowledge Foundation (OKF), a nonprofit foundation based on the United Kingdom. In addition to basic functions, such as data registration, publication, and statistics, CKAN supports specialized functions, such as visualization and API extraction, by combining with other open sources, including Drupal [4]. CKAN supports this specialized function under the name Extension.

show abstract

VACIT: Tool for Consumption, Analysis and Machine Learning for LOD Resources on CKAN Instances

Cited by 3 publications

References 7 publications

The Relevance of Open Data Principles for the Web of Data

The Relevance of Open Data Principles for the Web of Data

Demeter: An automatic framework for data migration in open data lakes

Comprehensive Knowledge Archive Network harvester improvement for efficient open‐data collection and management

Contact Info

Product

Resources

About