Monitoring XML data on the Web

Nguyen, Benjamin; Abiteboul, Serge; Cobena, Grégory; Preda, Mihai

doi:10.1145/376284.375723

Cited by 15 publications

(3 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…2. Stream queries: streams of data are brought from the web (typically from web robots) and these streams of data are filtered; see, e.g., [7].…”

Section: Web Surveillancementioning

confidence: 99%

Issues in Monitoring Web Data

Abiteboul

2002

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

The web is turning from a collection of static documents to a global source of dynamic knowledge. First, HTML is increasingly complemented by the more structured XML format augmented with mechanisms for providing semantics such as RDF. Also, we believe that the very passive vision of web sites promoted by the current HTTP will soon turn into a much more active one based on pub/sub and web services. Thus, the monitoring of the web is likely to raise new challenges for many years. We consider here some applications involving web monitoring and some issues they raise.

show abstract

“…2. Stream queries: streams of data are brought from the web (typically from web robots) and these streams of data are filtered; see, e.g., [7].…”

Section: Web Surveillancementioning

confidence: 99%

Issues in Monitoring Web Data

Abiteboul

2002

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…Η πρώτη, εφαρµόζει παραδοσιακές τεχνικές διαχείρισης ϐάσεων δεδοµένων και προσφέρει τη σχετική µε αυτό το περιβάλλον λειτουργικότητα (όπως για παράδειγµα το PIER [56], και άλλες σχετικές εργασίες [16,24,74]). [60,70] καλύπτεται από τη συνδροµή s1 µε περιορισµό διαστήµατος [50,100]).…”

Section: συστήµατα ∆ηµοσιεύσεων συνδροµώνunclassified

Ανάπτυξη Συστημάτων Δημοσιεύσεων / Συνδρομών Σε Δομημένα Δίκτυα Ομότιμων Εταίρων

Αικατερινίδης¹

View full text Add to dashboard Cite

“…Le Subscribe [75], the monitoring subsystem of Xyleme [151] and others). [43] is also notable because it considers a data model based on attribute-value pairs but goes beyond conjunctive queries -the standard class of queries considered by other systems [75].…”

Section: Information Filtering In Information Retrieval Databases and Distributed Systemsmentioning

confidence: 99%

Peer-to-peer techniques for web information retrieval and filtering

Τρυφωνόπουλος¹

View full text Add to dashboard Cite

Much information of interest to humans is today available on the Web. People can easily gain access to information but at the same time, they have to cope with the problem of information overload. Consequently, they have to rely on specialised tools and systems designed for searching, querying and retrieving information from the Web. Currently, Web search is controlled by a few search engines that are assigned the burden to follow this information explosion by utilising centralised search infrastructures. Additionally, users are striving to stay informed by sifting through enormous amounts of new information, and by relying on tools and techniques that are not able to capture the dynamic nature of the Web. In this setting, peer-to-peer Web search seems an ideal candidate that can offer adaptivity to high dynamics, scalability, resilience to failures and leverage the functionality of the traditional search engine to offer new features and services. In this thesis, we study the problem of peer-to-peer resource sharing in wide-area networks such as the Internet and the Web. In the architecture that we envision, each peer owns resources which it is willing to share: documents, web pages or files that are appropriately annotated and queried using constructs from information retrieval models. There are two kinds of basic functionality that we expect this architecture to offer: information retrieval and information filtering (also known as publish/subscribe or information dissemination). The main focus of our work is on providing models and languages for expressing publications, queries and subscriptions, protocols that regulate peer interactions in this distributed environment and indexing mechanisms that are utilized locally by each one of the peers.Initially, we present three progressively more expressive data models, WP, AWP and AWPS, that are based on information retrieval concepts and their respective query languages. Then, we study the complexity of query satisfiability and entailment for models WP and AWP using techniques from propositional logic and computational complexity. Subsequently, we propose a peer-to-peer architecture designed to support fullfledged information retrieval and filtering functionality in a single unifying framework. In the context of this architecture, we focus on the problem of information filtering using the model AWPS, and present centralised and distributed algorithmsfor efficient, adaptive information filtering in a peer-to-peer environment. We use two levels of indexing to store queries submitted by users. The first level corresponds to the partitioning of the global query index to different peers using a distributed hash table as the underlying routing infrastructure. Each node is responsible for a fraction of the submitted user queries through a mapping of attribute values to peer identifiers. The distributed hash table infrastructure is used to define the mapping scheme and also manages the routing of messages between different nodes. Our set of protocols, collectively called DHTrie, extend the basic functionality of the distributed hash table to offer filtering functionality in a dynamic peer-to-peer environment. Additionally, the use of a self-maintainable routing table allows efficient communication between the peers, offering significantly lower network load and latency. This extra routing table uses only local informationcollected by each peer to speed up the retrieval and filtering process. The second level of our indexing mechanism is managed locally by each peer, and is used for indexing the user queries the peer is responsible for. In this level of the index, each peer is able to store large numbers of user queries and match them against incoming documents. We have proposed data structures and localindexing algorithms that enable us to solve the filtering problem efficiently for large databases of queries. The main idea behind these algorithms is to store sets of words compactly by exploiting their common elements using trie-like data structures. Since these algorithms use heuristics to cluster user queries, we also consider the periodic re-organisation of the query database when the clustering of queries deteriorates. Our experimental results show the scalability and efficiency of the proposed algorithms in a dynamic setting. The distributed protocols manage to provide exact query answering functionality (precision and recall are the same as those of a centralised system) at a low network cost and low latency. Additionally, the local algorithms we have proposed outperform solutions in the current literature. Our trie-based query indexing algorithms proved more than 20% faster than their counterparts, offering sophisticated clustering of user queries and mechanisms for the adaptive reorganisation of the query database when filtering performance drops.

show abstract

Monitoring XML data on the Web

Cited by 15 publications

References 8 publications

Issues in Monitoring Web Data

Issues in Monitoring Web Data

Ανάπτυξη Συστημάτων Δημοσιεύσεων / Συνδρομών Σε Δομημένα Δίκτυα Ομότιμων Εταίρων

Peer-to-peer techniques for web information retrieval and filtering

Contact Info

Product

Resources

About