The parallel path framework for entity discovery on the web

Weninger, Tim; Johnston, Thomas J.; Han, Jiawei

doi:10.1145/2516633.2516638

Cited by 8 publications

(3 citation statements)

References 36 publications

(46 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is the case of hyperlinks used to enforce the Web page authority in a link-based ranking scenario, short-cut hyperlinks, etc. The solution we propose, based on the usage of Web lists, has a twofold effect: on the one hand, it guarantees that only hyperlinks which may belong to potential navigation systems are considered; on the other hand, it allows the method to identify hyperlinks by implicitly taking into account the Web page structure codified in the Web lists available in the Web pages [5,22,37,42], even if the hyperlinks do not belong to the navigation system. The crawling algorithm is described in Algorithm 1.…”

Section: Website Crawlingmentioning

confidence: 99%

Closed sequential pattern mining for sitemap generation

Ceci

Lanotte

2020

World Wide Web

View full text Add to dashboard Cite

A sitemap represents an explicit specification of the design concept and knowledge organization of a website and is therefore considered as the website’s basic ontology. It not only presents the main usage flows for users, but also hierarchically organizes concepts of the website. Typically, sitemaps are defined by webmasters in the very early stages of the website design. However, during their life websites significantly change their structure, their content and their possible navigation paths. Even if this is not the case, webmasters can fail to either define sitemaps that reflect the actual website content or, vice versa, to define the actual organization of pages and links which do not reflect the intended organization of the content coded in the sitemaps. In this paper we propose an approach which automatically generates sitemaps. Contrary to other approaches proposed in the literature, which mainly generate sitemaps from the textual content of the pages, in this work sitemaps are generated by analyzing the Web graph of a website. This allows us to: i) automatically generate a sitemap on the basis of possible navigation paths, ii) compare the generated sitemaps with either the sitemap provided by the Web designer or with the intended sitemap of the website and, consequently, iii) plan possible website re-organization. The solution we propose is based on closed frequent sequence extraction and only concentrates on hyperlinks organized in “Web lists”, which are logical lists embedded in the pages. These “Web lists” are typically used for supporting users in Web site navigation and they include menus, navbars and content tables. Experiments performed on three real datasets show that the extracted sitemaps are much more similar to those defined by website curators than those obtained by competitor algorithms.

show abstract

Section: Website Crawlingmentioning

confidence: 99%

Closed sequential pattern mining for sitemap generation

Ceci

Lanotte

2020

World Wide Web

View full text Add to dashboard Cite

show abstract

“…Also, there are solutions that attempt to induce ontologies from natural language text [20,37,49]. The examples of IE for semi-structured texts are described in [26,32,34,50,55,61,76]. In the case of databasesthis reason, the author assumes that it is important to formally define the term IS to better understand the rest of this article and its role in IES.…”

Section: State Of the Art And Related Workmentioning

confidence: 99%

The BigGrams: the semi-supervised information extraction system from HTML: an improvement in the wrapper induction

Mirończuk

2017

Knowl Inf Syst

View full text Add to dashboard Cite

The aim of this study is to propose an information extraction system, called BigGrams, which is able to retrieve relevant and structural information (relevant phrases, keywords) from semi-structural web pages, i.e. HTML documents. For this purpose, a novel semi-supervised wrappers induction algorithm has been developed and embedded in the BigGrams system. The wrappers induction algorithm utilizes a formal concept analysis to induce information extraction patterns. Also, in this article, the author (1) presents the impact of the configuration of the information extraction system components on information extraction results and (2) tests the boosting mode of this system. Based on empirical research, the author established that the proposed taxonomy of seeds and the HTML tags level analysis, with appropriate pre-processing, improve information extraction results. Also, the boosting mode works well when certain requirements are met, i.e. when well-diversified input data are ensured.

show abstract

“…Hyperlinks are typically assumed to be intentional and reflective of some organizational structure -a structure typically decided by the organization and implemented by a Web administrator (Weninger, Johnston, and Han 2013). But what happens when information structures and communities are defined by the users themselves?…”

Section: Introductionmentioning

confidence: 99%

Subreddit Links Drive Community Creation and User Engagement on Reddit

Krohn¹,

Weninger²

2022

ICWSM

View full text Add to dashboard Cite

On Reddit, individual subreddits are used to organize content and connect users. One mode of interaction is the subreddit link, which occurs when a user makes a direct reference to a subreddit in another community. Based on the ubiquity of these references, we have undertaken a study on subreddit links on Reddit, with the goal of understanding their impact on both the referenced subreddit, and on the subreddit landscape as a whole. By way of an extensive observational study along with several natural experiments using the entire history of Reddit, we were able to determine that (1) subreddit links are a significant driver of new subreddit creation; (2) subreddit links (2a) substantially drive activity in the referenced subreddit, and (2b) are frequently created in response to high levels of activity in the referenced subreddit; and (3) the graph of subreddit links has become less dense and more treelike over time. We conclude with a discussion of how these results confirm, add to, and in some cases conflict with existing theories on information-seeking behavior and self-organizing behavior in online social systems.

show abstract

The parallel path framework for entity discovery on the web

Cited by 8 publications

References 36 publications

Closed sequential pattern mining for sitemap generation

Closed sequential pattern mining for sitemap generation

The BigGrams: the semi-supervised information extraction system from HTML: an improvement in the wrapper induction

Subreddit Links Drive Community Creation and User Engagement on Reddit

Contact Info

Product

Resources

About