Accounting for quality in data integration systems: a completeness-aware integration approach

Daraio, Cinzia; Leo, Simone Di; Scannapieco, Monica

doi:10.1007/s11192-022-04266-0

Cited by 8 publications

(3 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…is approach allows the user to prepare all the maximum information available from an integrated data system without the need for preliminary data quality analysis of each database contained within it. A case study by Daraio C on research infrastructure for scientific and innovative research demonstrated the usefulness of the proposed approach [6]. Dalla Valle and Kenett proposed a new data integration method that can calibrate online generated big data using interview-based customer survey data.…”

Section: Related Workmentioning

confidence: 99%

Data Integration Method Design of Decision Spatial Information System

2022

Security and Communication Networks

View full text Add to dashboard Cite

With the development of technology, more and more enterprises have begun to use data integration analysis to make decisions. The decision spatial information system is an information system that provides decision support after analyzing and processing the spatial information. Data integration refers to a method of reasonably centralizing different or multisource data for data sharing, which can assist in decision management. This paper aims to study a more efficient data integration method for decision space information system. In this paper, an emergency information decision-making system for digital water network is designed, and a specific data integration algorithm is proposed. And the performance test of the early warning capability and power consumption of the system is carried out. The results show that the early warning time of the system designed in this paper is within 1 to 4 seconds, while the early warning time of the traditional system is within 1.5 seconds to 8 seconds. The power consumption of the system designed in this paper is not more than 25 W, while the traditional system power consumption is up to 50 W. The power consumption of the system in this paper is about half of the traditional system. Compared with the traditional system early warning capability, the system designed in this paper is significantly faster, the system power consumption is lower, and the system is more stable.

show abstract

Section: Related Workmentioning

confidence: 99%

Data Integration Method Design of Decision Spatial Information System

2022

Security and Communication Networks

View full text Add to dashboard Cite

show abstract

“…Due to the relevance of the issue, many authors have proposed methods or guidelines to assess problems on data quality [6][7][8][9][10][11][12][13]. However, few works focus on the problems that specifically regards the case of numerical data describing repeated observations of the same units over a period of time.…”

Section: Introductionmentioning

confidence: 99%

Flexible Techniques to Detect Typical Hidden Errors in Large Longitudinal Datasets

Bruni,

Daraio,

Di Leo

2024

Preprint

View full text Add to dashboard Cite

The increasing availability of longitudinal data (repeated numerical observations of same units at different times) requires the development of flexible techniques to automatically detect common errors in such data. Besides obvious and easily identifiable cases, such as missing or out-of-range data, large longitudinal dataset often present problems not easily traceable by the techniques used for generic datasets. In particular, elusive and baffling problems are i) inversion of one or more values from one unit to another; ii) anomalous jumps in the series of values, iii) errors in the timing of the values due to a recalculation operated by the data providers to compensate previous errors. This work proposes a statistical-mathematical approach based on a system of indicators that is able to capture the complexity of the described problems by working at the formal level, regardless of the specific meaning of the data. The proposed approach identifies suspect erroneous data and is applicable in a variety of contexts. We implement this approach in a relevant database of European Higher Education institutions (ETER) by analyzing Total academic staff, that is one of the most important variables, used in empirical analysis as proxy of size and also considered by policy makers at European level.

show abstract

“…It can be used to avoid time-consuming manual database browsing. A relational database's entries, rows, and columns can easily be increased or decreased without affecting any of the relevant applications (Al-Saffar et al, 2018;Hu, et al, 2018).Creation of relationships among tablesRelationships between tables are the most important aspect of the architecture, as this is where the power of a relational database is realized(Le et al, 2013;Boguslawski et al, 2015;Breunig et al, 2020;Mekala et al, 2020;Daraio et al,2022). The present study compiled a set of metadata describing each Feature, attribute, and sub-attributes used to ease the development of a unified database.…”

mentioning

confidence: 99%

Integrated geospatial database design for land use pattern analysis and its impact on local governance: A case study of Manesar Urban Complex, Gurugram, India

Dev,

Krishna,

Kumar

et al. 2023

JANS

View full text Add to dashboard Cite

The absence of an integrated geospatial database hinders effective decision-making among various stakeholders in national projects and programs. The study aimed to create an integrated geospatial database for the Manesar tehsil, District Gurugram, Haryana. Another objective was to create a land use map to analyze the temporal change in land use patterns and its socioeconomic impact along the surrounding areas. The first stage of the study involved creating an integrated database after interviewing different stakeholders. In the second stage, the satellite imagery was georeferenced using Ground Control Points, and the land use patterns were digitized using Landsat imagery for 1987, 2011, 2014, and 2022. The study suggested that the construction area has grown up to 6% while cultivation has dropped significantly from 76% in 1987 to 50% in 2022. Likewise, the industrial area has grown up to 2% and natural vegetation dropped in coverage from 11% to 4%. The area witnessed a population growth rate of 3.2% per year and a decadal growth rate of 39.7%. Less than 50% of the land in the tehsil is used for agricultural purposes. It estimates that 4% of the tehsil's entire surface was covered by natural vegetation in 2019, down from 11% in 1987. The study recommends the creation of an integrated geospatial database that will help reduce duplication and speed up decision-making in government. This will pave the way for improving e-governance in local bodies. The framework created for developing the database system is universally applicable and can be used appropriately by other states, regions, and the entire country.

show abstract

Accounting for quality in data integration systems: a completeness-aware integration approach

Cited by 8 publications

References 21 publications

Data Integration Method Design of Decision Spatial Information System

Data Integration Method Design of Decision Spatial Information System

Flexible Techniques to Detect Typical Hidden Errors in Large Longitudinal Datasets

Integrated geospatial database design for land use pattern analysis and its impact on local governance: A case study of Manesar Urban Complex, Gurugram, India

Contact Info

Product

Resources

About