An approach to identify duplicated web pages

Detecting Clones in Business Applications

“…Levenshtein is a common technique used in [25,26,30] to detect cloned web pages. In [26] a web page is considered to be a set of predefined features (e.g., sequence of tags or ASP features). The work in [27] applies similarity comparison using Levenshtein distance in content and scripting code levels.…”

Integrating Static and Dynamic Analysis to improve the Comprehension of Existing Web Applications

“…To this aim, Di Lucca et al [9] proposed an approach and a tool, named WARE, to recover WA's documentation represented by UML diagrams (see Section 3.1). In particular, Di Lucca et al [6] [7] applied the tool to abstract use case diagrams, sequence diagrams and business object models from WAs. The proposed approach relies on static information, which may not suffice for an effective and complete abstraction of UML diagrams, due to the dynamic nature of some WA components.…”

“…A client page, and thus a BCP, can be considered as composed by two main components [7]: a control component, i.e., the set of items -such as the HTML code and scripts -determining the page layout, business rule processing, and event management; and a data component, i.e., the set of items -such as text, images, multimedia objects -determining the information to be read/displayed from/to a user.…”

“…The testing effort is reduced as well: indeed it is sufficient to cover at least a BCP for each equivalent class. The identification of clusters of equivalent BCPs can be obtained by exploiting the clone detection techniques proposed in the paper [7]. That approach identifies as clones the groups of similar pages according to a Levenshtein distance over structural information.…”

Evaluating the effect of code duplications on software maintainability

“…There exist an abundance of clone detection algorithms ranging from lexical (tokenbased) [34,48,54], through AST-based [15,61,97] to metric-based [60,65,66,72] approaches. These methods act on one particular version of the software and then a detailed list of copied code segments is provided that may eventually contain several thousand items in the case of a real-size software package.…”