Applying an information gathering architecture to Netfind: a white pages tool for a changing and growing Internet

Schwartz, Michael F.; Pu, Calton

doi:10.1109/90.336327

Cited by 5 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…NetFind, WAIS, and Harvest are examples of the distributed model. The authors of [10] introduced NetFind, a system that addressed the problem of finding information about people on the Web by employing a distributed search technique. WAIS employed a distributed set of indexes and a vector-space retrieval paradigm.…”

Section: Related Workmentioning

confidence: 99%

A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers

Farooqui¹,

Muqeem²,

Ahmad³

et al. 2023

IJACSA

View full text Add to dashboard Cite

Search engines are the instruments for website navigation and search, because the Internet is big and has expanded greatly. By continuously downloading web pages for processing, search engines provide search facilities and maintain indices for web documents. Online crawling is the term for this process of downloading web pages. This paper proposes solution to network traffic problem in migrating parallel web crawler. The primary benefit of a parallel web crawler is that it does local analysis at the data's residence rather than inside the web search engine repository. As a result, network load and traffic are greatly reduced, which enhances the performance, efficacy, and efficiency of the crawling process. Another benefit of moving to a parallel crawler is that as the web gets bigger, it becomes important to parallelize crawling operations in order to retrieve web pages more quickly. A web crawler will produce pages of excellent quality. When the crawling process moves to a host or server with a specific domain, it begins downloading pages from that domain. Incremental crawling will maintain the quality of downloaded pages and keep the pages in the local database updated. Java is used to implement the crawler. The model that was put into practice supports all aspects of a three-tier, realtime architecture. An implementation of a parallel web crawler migration is shown in this paper. The method for efficient parallel web migration detects changes in the content and structure using neural network-based change detection techniques in parallel web migration. This will produce highquality pages and detection for changes will always download new pages. Either of the following strategies is used to carry out the crawling process: either crawlers are given generous permission to speak with one another, or they are not given permission to communicate with one another at all. Both strategies increase network traffic. Here, a fuzzy logic-based system that predicts the load at a specific node and the path of network traffic is presented and implemented in MATLAB using the fuzzy logic toolbox.

show abstract

Section: Related Workmentioning

confidence: 99%

A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers

Farooqui¹,

Muqeem²,

Ahmad³

et al. 2023

IJACSA

View full text Add to dashboard Cite

show abstract

Resource location in large scale heterogeneous and autonomous databases

1995

View full text Add to dashboard Cite

Advances in Network Information Discovery and Retrieval

Eichmann

1995

Int. J. Soft. Eng. Knowl. Eng.

View full text Add to dashboard Cite

Access to information using the Internet has undergone dramatic change and expansion recently. The unrivaled success of the World Wide Web has altered the Internet from something approachable only by the initiated to something of a media craze — the information superhighway made manifest in the personal "home page". This paper surveys the beginnings of network information discovery and retrieval, how the Web has created a surprising level of integration of these systems, and where the current state of the art lies in creating globally accessible information spaces and supporting access to those information spaces.

show abstract

Applying an information gathering architecture to Netfind: a white pages tool for a changing and growing Internet

Cited by 5 publications

References 16 publications

A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers

A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers

Resource location in large scale heterogeneous and autonomous databases

Advances in Network Information Discovery and Retrieval

Contact Info

Product

Resources

About