A smart itsy bitsy spider for the Web

Chen, Hsinchun; Chung, Yi-Ming; Ramsey, Marshall; Yang, Christopher C.

doi:10.1002/(sici)1097-4571(1998)49:7<604::aid-asi3>3.3.co;2-x

Cited by 39 publications

(16 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some researchers have studied how to apply agent technology [7,22,31] to collect and retrieve textual and numerical information. These agents save time for investors and brokers in collecting the information.…”

Section: Improving Market Transparency and Efficiency By Providing Efmentioning

confidence: 99%

An Integrated Trading Environment: To Improve Market Transparency and Efficiency

Lau

2002

Rev. Pac. Basin Finan. Mark. Pol.

View full text Add to dashboard Cite

During the 1997 financial turmoil, the overall boom and slump was mainly due to the collapse of ill-informed speculation and a non-regulated stock market system. This collapse has probably created mistrust among the public and greatly impaired confidence in securities as an investment. From this painful experience, the government should control share prices and prevent extreme fluctuations by improving the transparency and efficiency in trading information transmission, market monitoring and document disclosure.Therefore, online trading system, cross-market monitoring system and electronic filing system will be recommended in order to improve the low transparency and efficiency of financial information transmission. More importantly, all the information in these systems is inter-related for market monitoring or financial analysis. Thus, an integrated trading environment results in order to reduce redundancy work, error prone and information inefficiency. Keywords: Market transparency and efficiency; Trading environment. Rev. Pac. Basin Finan. Mark. Pol. 2002.05:533-549. Downloaded from www.worldscientific.com by UNIVERSITY OF CALIFORNIA @ SAN DIEGO on 06/02/15. For personal use only.

show abstract

Section: Improving Market Transparency and Efficiency By Providing Efmentioning

confidence: 99%

An Integrated Trading Environment: To Improve Market Transparency and Efficiency

Lau

2002

Rev. Pac. Basin Finan. Mark. Pol.

View full text Add to dashboard Cite

show abstract

“…Co-citation is particularly helpful in finding relevant pages in some domains where pages with similar contents avoid linking to each other (e.g., commercial domains where providers of similar online contents are competitors). The most popular link-based Web analysis algorithms include PageRank [4] and HITS [12].…”

Section: Web Analysis Algorithmsmentioning

confidence: 99%

“…Among them, Breadth-first Search and Best-first Search are the two most popular ones. Some other more advanced search algorithms, such as Spreading Activation [11] and Genetic Algorithm [12], have also been proposed in Web searching.…”

Section: Web Search Algorithmsmentioning

confidence: 99%

“…With these abilities, GA seems to be a good choice to replace traditional local search algorithms. Chen et al [12] experimented with using Genetic Algorithm to build a personal search agent. Their results showed that Genetic Algorithm can effectively prevent the search agent from being trapped with local optimal and significantly improve the quality of the search results.…”

Section: Figure 1: Relevant Pages With Co-citation Relationships Missmentioning

confidence: 99%

“…The process terminates when the fitness improvement between generations is smaller than a threshold value. As it is hard to represent Web pages in bit strings and conventional genetic operators cannot directly be applied in the Web context, we designed our crawler based on the design of Chen et al [12] and the general idea of Genetic Algorithm. A sketch of the Genetic Algorithm adopted for focused crawling is presented below: 1.…”

Section: Proposed Approachmentioning

confidence: 99%

See 2 more Smart Citations

Using Genetic Algorithm in Building Domain-Specific Collections: An Experiment in the Nanotechnology Domain

Qin

Chen

Proceedings of the 38th Annual Hawaii International Conference on System Sciences

View full text Add to dashboard Cite

As the key technique to build domain-specific search engines, focused crawling has drawn a lot of attention from researchers in the past decade. However, as Web structure analysis techniques advance, several problems in traditional focused crawler design were revealed and they could result in domain-specific collections with low quality. In this work, we studied the problems of focused crawling that are caused by using local search algorithms. We also proposed to use a global search algorithm, the Genetic Algorithm, in focused crawling to address the problems. We conducted evaluation experiments to examine the effectiveness of our approach. The results showed that our approach could build domain-specific collections with higher quality than traditional focused crawling techniques. Furthermore, we used the concept of Web communities to evaluate how comprehensively the focused crawlers could traverse the Web search space, which could be a good complement to the traditional focused crawler evaluation methods.

show abstract

What is information discovery about?

Proper¹,

Bruza

1999

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

The Internet has led to an increase in the quantity and diversity of information available for searching. Furthermore, users are bombarded by a constant barrage of electronic messages in the form of e-mail, faxes, etc. This has led to a plethora of search engines, "intelligent" agents, etc., that aim to help users in their quest for relevant information, or shield them against irrelevant information. All these systems aim to identify the potentially relevant information in among a large pool of available information. No unifying underlying theory for information discovery systems exists as yet. The aim of this article is to provide a logic-based framework for information discovery, and relate this to the traditional field of information retrieval. Furthermore, the often ignored user receives special emphasis. In information discovery, a good understanding of a user's (sometimes hidden) needs and beliefs is essential. We will develop a logic-based approach to express the mechanics of information discovery, while the pragmatics are based on an analysis of the underlying informational semantics of information carriers and information needs of users.

show abstract

A smart itsy bitsy spider for the Web

Cited by 39 publications

References 34 publications

An Integrated Trading Environment: To Improve Market Transparency and Efficiency

An Integrated Trading Environment: To Improve Market Transparency and Efficiency

Using Genetic Algorithm in Building Domain-Specific Collections: An Experiment in the Nanotechnology Domain

What is information discovery about?

Contact Info

Product

Resources

About