Learnable topic-specific web crawler

Rungsawang, Arnon; Angkawattanawit, N.

doi:10.1016/j.jnca.2004.01.001

Cited by 47 publications

(25 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…While earth observation approaches can be used for spatial change detection [Chen, 2013a], some other situation changes can be collected using topic-specific web crawlers from the huge source of information contained in the internet [Rungsawang and Angkawattanawit, 2005]. …”

Section: Collaborative Information Servicementioning

confidence: 99%

Borderlands Modelling and Understanding with GISs: Challenges and Research Agenda

Chen

Cheng

et al. 2013

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

ABSTRACT:Borderland regions are special areas and deserve more attention in global sustainable development. Reliable information and effective analysis tools are requested to support borderlands studies through the integrated utilization of geospatial analysis, web service, as well as the other domain-specific expertise. This paper has reviewed the state-of-the-art of borderlands modelling and understanding. From the perspective of geospatial information sciences (GIS), integrated data modelling, comprehensive analysis and collaborative information service are identified as the three major challenges in this filed. A research agenda is further proposed with four topics, i.e., classification and representation of borderland information, derivation of neighborhood information, development of synergetic analysis, and design and development of a geo-portal for borderlands studies. This interdisciplinary study requires a closer and in-depth collaboration of geopolitics, international relation, geography and geo-spatial information sciences.

show abstract

Section: Collaborative Information Servicementioning

confidence: 99%

Borderlands Modelling and Understanding with GISs: Challenges and Research Agenda

Chen

Cheng

et al. 2013

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…But, it is believed that [10] the crawler with good starting URLs is capable of gathering more relevant web pages.…”

Section: Related Workmentioning

confidence: 99%

“…The processing of crawler begins from a seed page and then it uses the external links within the seed page to deal with other pages [8]. The algorithm [10], covers the discussion of both the initial and successive crawling.…”

Section: Related Workmentioning

confidence: 99%

Web Searching With Logarithmic and Probability Measure

SubatraDevi¹,

Khader²

2013

IJCA

View full text Add to dashboard Cite

The web is a huge and highly dynamic environment which is growing exponentially in content and developing fast in structure. No search engine can cover the whole web, but it has to focus on the most valuable pages for crawling. Many methods have been developed based on link and text analysis for retrieving the pages. In this paper, an algorithm based on link, text, logarithmic distance and probabilistic measure is presented to find the relevancy of the web pages. Here, the most relevant pages are retrieved. It has been proved experimentally that this method provides more number of relevant pages.

show abstract

“…If the result is high, it means that the crawler is efficient and it reached to desired web pages that are more than irrelevant web pages during the crawling process [17].…”

Section: Introductionmentioning

confidence: 99%

Web Pages Retrieval by Using Proposed Focused Crawler

Hameed¹,

Hashem²

2016

JNUS

View full text Add to dashboard Cite

Abstract"Focused Crawler" is designed to visit a part of the web to collect documents that are related to only a particular topic. The objective of focused crawler is to identify good links that lead to target required documents, and to avoid branches that don't lead to the required topic. There is a number of motivations for designing focused crawler such as: fetching relevant data from the web with simplified data indexing, personalizing the human-computer interaction, making the system adaptive with each user, needing for a tool to change the searching strategy, keeping the freshness of the web pages and filtering the links to keep track focusing on the user's preference. In this paper, we will explain two methods to retrieve web pages by using traditional crawler and proposed focused crawler. We make several experiments and it shows that proposed focused crawler is more efficient than traditional crawler in retrieving the desired web pages.

show abstract

Learnable topic-specific web crawler

Cited by 47 publications

References 15 publications

Borderlands Modelling and Understanding with GISs: Challenges and Research Agenda

Borderlands Modelling and Understanding with GISs: Challenges and Research Agenda

Web Searching With Logarithmic and Probability Measure

Web Pages Retrieval by Using Proposed Focused Crawler

Contact Info

Product

Resources

About