Fast Detection of Functional Dependencies in XML Data

Shi, Hongbo; Amagasa, Toshiyuki; Kitagawa, Hiroyuki

doi:10.1007/978-3-642-15684-7_10

Cited by 1 publication

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To the best of our knowledge, only a few papers address the problem of supporting the discovery of data integrity constraints in the Web context. One such study discusses how to find functional dependencies in an XML document [13].…”

Section: Introductionmentioning

confidence: 99%

Efficient filtering and ranking schemes for finding inclusion dependencies on the web

Morishima

Yumiya

Takahashi

et al. 2013

Proceedings of the 22nd ACM International Conference on Information &Amp; Knowledge Management

Self Cite

View full text Add to dashboard Cite

Data integrity constraints are fundamental in various applications, such as data management, integration, cleaning, and schema extraction. This paper presents the results of a first comprehensive study on finding inclusion dependencies on the Web. The problem is important because (1) applications of inclusion dependencies, such as data quality management, are beneficial in the Web context, and (2) such dependencies are not explicitly given in general. In our approach, we enumerate pairs of HTML/XML elements that possibly represent inclusion dependencies and then rank the results for verification. First, we propose a bit-based signature scheme to efficiently select candidates (element pairs) in the enumeration process. The signature scheme is unique in that it supports Jaccard containment to deal with the incomplete nature of data on the Web, and preserves the semiorder inclusion relationship among sets of words. Second, we propose a ranking scheme to support a user in checking whether each enumerated pair actually suggests inclusion dependencies. The ranking scheme sorts the enumerated pairs so that we can examine a small number of pairs for simultaneously verifying many pairs. Finally, we prove that there exist efficient algorithms for the ranking scheme. In addition to the theoretical results for the signature and ranking schemes, we present a comprehensive set of experimental results using various real Web sites. The results show that in the enumeration process the signature scheme reduces the number of candidate pairs by orders of magnitude, and that the ranking scheme allows a small number of higher ranked results to cover many other pairs.2

show abstract

Section: Introductionmentioning

confidence: 99%