Search engines and Web dynamics

Risvik, Knut Magne; Michelsen, Rolf

doi:10.1016/s1389-1286(02)00213-x

Cited by 86 publications

(55 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It is a big challenge to build up and maintain an index generated by Web robots. A good overview is given in Risvik and Michelsen (2002).…”

Section: Index Qualitymentioning

confidence: 99%

See 1 more Smart Citation

‘Googling’ Terrorists: Are Northern Irish Terrorists Visible on Internet Search Engines?

Reilly

2008

Web Search

View full text Add to dashboard Cite

SummaryThe purpose of this paper is to describe various quality measures for search engines and to ask whether these are suitable. We especially focus on user needs and their use of Web search engines. The paper presents an extensive literature review and a first quality measurement model, as well. Findings include that Web search engine quality can not be measured by just retrieval effectiveness (the quality of the results), but should also consider index quality, the quality of the search features and Web search engine usability . For each of these sections, empirical results from studies conducted in the past, as well as from our own research are presented. These results have implications for the evaluation of Web search engines and for the development of better search systems that give the user the best possible search experience. IntroductionWeb search engines have become important for information seeking in many different contexts (e.g., personal, business, and scientific). Research questions not answered satisfactorily are, as of now, how well these engines perform regarding user expectations and what measures should be used to get an overall picture of search engine quality . It is well known that search engine quality in its entirety cannot be measured with the use of traditional retrieval measures. But the development of new, search engine specific measures, as proposed in Vaughan (2004) are not sufficient, either. Search engine quality must be defined more extensively and integrate factors beyond retrieval performance such as index quality and the quality of the search features.One aspect neglected is the user himself. But to discuss and judge the quality of search engines, it is important to focus on the user of such systems, too. Better performance of ranking algorithms or providing additional services does not always lead to users' satisfaction and to better search results. We focus on the Web search engine user behaviour to derive strategies to measure Web search engine quality . Additionally, quality assurance is an important aspect to improve customer satisfaction and loyalty. This is fundamental to protect market shares and revenues from

show abstract

“…It is a big challenge to build up and maintain an index generated by Web robots. A good overview is given in Risvik and Michelsen (2002).…”

Section: Index Qualitymentioning

confidence: 99%

“…Ke et al (2006) give a good overview of the problems for search engines resulting from Web dynamics. Crawling and indexing problems resulting from Web dynamics from a commercial search engine's point of can be found in Risvik and Michelsen (2002).…”

Section: Up-to-datednessmentioning

confidence: 99%

‘Googling’ Terrorists: Are Northern Irish Terrorists Visible on Internet Search Engines?

Reilly

2008

Web Search

View full text Add to dashboard Cite

show abstract

“…Thus, the amount of resources (and, hence, the cost) is proportional to both Q and D, and so can be expressed as βQD, where β is a constant reflecting the resource costs. An examination of the architecture of the FAST search engine (www.alltheweb.com) shows that our cost function is not that far from reality [4].…”

Section: Search Engine Performancementioning

confidence: 99%

Optimising Performance of Competing Search Engines in Heterogeneous Web Environments

Khoussainov

Kushmerick

2003

Machine Learning: ECML 2003

View full text Add to dashboard Cite

Abstract. Distributed heterogeneous search environments are an emerging phenomenon in Web search, in which topic-specific search engines provide search services, and metasearchers distribute user's queries to only the most suitable search engines. Previous research has explored the performance of such environments from the user's perspective (e.g., improved quality of search results). We focus instead on performance from the search service provider's point of view (e.g, income from queries processed vs. resources used to answer them). We analyse a scenario in which individual search engines compete for queries by choosing which documents to index. We propose the COUGAR algorithm that specialised search engines can use to decide which documents to index on each particular topic. COUGAR is based on a game-theoretic analysis of heterogeneous search environments, and uses reinforcement learning techniques to exploit the sub-optimal behaviour of its competitors.

show abstract

“…This task would require a focused or specialized crawler. The fast growth of the Web requires more specific search engines and a specialized search engine would operate much more efficiently (Risvik and Michelsen, 2002).…”

Section: Introductionmentioning

confidence: 99%

“…SCS has a few key elements: Risvik and Michelsen (2002) mention that systems usually run the crawler, indexer and searcher sequentially and in cycles. This is not the case with SCS; all the components of the system can run simultaneously using multi-threaded logic.…”

Section: Introductionmentioning

confidence: 99%

An architecture for SCS: A specialized web crawler on the topic of security

Özmutlu

Ozmutlu

2004

Proc of Assoc for Info

View full text Add to dashboard Cite

Mining for correct and relevant information in the World Wide Web is a difficult task, handled by Web crawlers. This study outlines the components of a specialized crawler on the topic of security (SCS) that heavily makes use of artificial neural networks and rule-based expert systems to establish successful focused crawling on the topic of security. SCS is designed to find, index and follow the updates of Web pages of interest, and proposes new approaches for reaching relevant pages, which might stay hidden to other crawling approaches. SCS consists of four new page explorers, a database of relevant pages, a relevance evaluator using artificial neural networks and an updater using rule-based expert systems. SCS is a multi-threaded multi-object Java Applet and Application combination with embedded SQL and PHP elements and is applicable on single or multiple machines through parallel processing with its expandable and modular structure.

show abstract

Search engines and Web dynamics

Cited by 86 publications

References 12 publications

‘Googling’ Terrorists: Are Northern Irish Terrorists Visible on Internet Search Engines?

‘Googling’ Terrorists: Are Northern Irish Terrorists Visible on Internet Search Engines?

Optimising Performance of Competing Search Engines in Heterogeneous Web Environments

An architecture for SCS: A specialized web crawler on the topic of security

Contact Info

Product

Resources

About