Early Integration Testing for Entity Reconciliation in the Context of Heterogeneous Data Sources

Abstract

Entity reconciliation (ER) aims to combine data from different sources for a unified vision. The management of large volumes of data has given rise to significant challenges to the ER problem due to facts such as data becoming more unstructured, unclean, and incomplete or the existence of many datasets that store information about the same topic. Testing the applications that implement the ER problem is crucial to ensure both the correctness of the reconciliation process and the quality of the reconciled data. This paper presents an approach based on model-driven engineering that allows the creation of test models for the early integration testing of ER applications, contributing in three main aspects: the description of the elements of the proposed framework, the definition of the testing model, and the validation of the proposal through two real-world case studies. This validation verifies that the early integration testing of the ER application is capable of detecting a series of deficiencies, which a priori are not known and that will help to improve the final result that the ER application offers.

Software Process Simulation Modeling: Systematic literature review

“…We refer to investigate the possibilities offered by model-driven engineering paradigm to facilitate the integration, definition and management of simulation models in the BPM context in practical environments. The use of this paradigm has obtained satisfactory results in other areas [72][73][74][75] and it could be interesting its application is our future objective.…”

Using Blockchain to Improve Collaborative Business Process Management: Systematic Literature Review

“…Specially, we will research model-driven mechanisms to facilitate the integration between blockchain technology and collaborative process management. The use of model-driven engineering paradigm has obtained satisfactory results in other areas [66][67][68] and it could be interesting its application in this topic to reduce costs and improve quality. For example, we are exploring model-driven early testing techniques to approve and validate smart contracts that are tied to business rules on critical processes.…”

Data reconciliation and fusion methods: a survey

“…The explosion of the number of data sources and the emergence of unstructured data led information to be unclean, incomplete and redundant. [44]. For years, the worlds of structured systems (transactions, databases, Oracle, DB2, Teradata, and others) have grown side by side with the world of unstructured systems (email, phone conversation transcripts, spreadsheets, reports, documents, and others).…”