A survey analysis on duplicate detection in Hierarchical Data

Abstract

Electronic Data Processing used automated methods for processing commercial data. There is big amount of work on discovering duplicates in relational data; merely elite findings concentrate on duplication in additional multifaceted hierarchical structures. Electronic information is one of the key factors in several business operations, applications, and determinations, at the same time as an outcome, guarantee its superiority is necessary. Data superiority, on the other hand, can be adjusted by different kind of errors from the heterogeneous domains. Duplicates are several delegacy of the identical real world thing which is dissimilar from each other. Duplicate finding a little assignment because of the actuality that duplicates are not accurately equivalent, frequently because of the errors in the information. Accordingly, many data processing techniques never apply widespread assessment algorithms which identify precise duplicates. As an alternative, evaluate all objective representations, by means of a probably compound identical approach, to identifying that the object is real world or not. In this paper we given detailed survey analysis and groundwork on duplicate detection in hierarchical data. Also we proposed a new idea i.e. use of pruning algorithm to detect similarity between the objects. This survey paper is useful to the persons who are doing research in Duplicate Detection in XML data or Hierarchical Data.

Entity reconciliation in big data sources: A systematic mapping study

“…Yumusak, Dogdu, and Kodaz (2014) , present a brief survey dealing with linked data ranking, classifying methods in: ontology ranking, RDF (Resource Description Framework) document ranking, graph ranking, entity ranking and document/source ranking. Gaikwad and Bogiri (2015) , present a survey analysis on duplicated detection in the domain of hierarchical data. They have oriented the paper to experts who are doing research in duplicate detection in xml data or hierarchical data.…”

Entropic Statistical Description of Big Data Quality in Hotel Customer Relationship Management

“…ER is a significant and common data cleaning problem, and it consists of detecting data duplicate representations for the same external entities, and merging them into single representations [ 43 ]. This problem can be applied to many different domains, such as deduplication in databases [ 44 ], duplicate detection in data or hierarchical data [ 45 ], cross-document co-reference resolution methods and tools [ 46 ], blocking techniques [ 43 , 47 ], bug reports [ 48 ], customer recognition [ 31 ], and E-health [ 49 ]. Most of the existing studies have been validated using real-world datasets, but very few of them have applied their proposal in a real case in the industry [ 42 ].…”