Information Extraction from Hypertext Mark-Up Language Web Pages

Abstract

Problems statement: Nowadays, many users use web search engines to find and gather information. User faces an increasing amount of various HTML information sources. The issue of correlating, integrating and presenting related information to users becomes important. When a user uses a search engine such as Yahoo and Google to seek specific information, the results are not only information about the availability of the desired information, but also information about other pages on which the desired information is mentioned. The number of selected pages is enormous. Therefore, the performance capabilities, the overlap among results for the same queries and limitations of web search engines are an important and large area of research. Extracting information from the web pages also becomes very important because the massive and increasing amount of diverse HTML information sources in the internet that are available to users and the variety of web pages making the process of information extraction from web a challenging problem. Approach: This study proposed an approach for extracting information from HTML web pages which was able to extract relevant information from different web pages based on standard classifications. Results: Proposed approach was evaluated by conducting experiments on a number of web pages from different domains and achieved increment in precision and F measure as well as decrement in recall. Conclusion: Experiments demonstrated that our approach extracted the attributes besides the sub attributes that described the extracted attributes and values of the sub attributes from various web pages. Proposed approach was able to extract the attributes that appear in different names in some of the web pages.

Performance of Using Tag-based Feature Sets in Web Page Classification

“…By this study, apart from the works done on web page classification [1,3,9,17,18,19,23], we have the chance to emphasize which tag gives better performance when used in a feature extraction method. Our results are compatible with the studies in which the HTML tags have been used and tried to show the impact of them [2, 4 -8, 10 -15, 24, 25, 28, 29].…”

“…In our experiments the F-measure, which is commonly used metric [1,2,6,38,39], is employed for performance evaluation. The F-measure is a harmonic mean of the precision and the recall of the test and it is defined as:…”

“…However, it is not easy to reach to a desired information by using the standard search engines. Possible reasons for this problem are [1];…”