A quality aware service-oriented web warehouse platform

Abstract

In order to be a useful tool, a Web Warehouse (WW) should take into account the quality of the data it manages and the quality of the services that provide the source data. It should also have enough flexibility to endure the high volatility of web sources. In this work we propose a WW platform that satisfies these two conditions. It manages data and services quality, measuring quality at the different stages of the system life-cycle and at the same time, using these measures as input for information processing. Additionally, the platform achieves flexibility and configurability because it is strongly based on informationprocessing services.

WSEM QT : a novel approach for quality‐based evaluation of web data sources for a data warehouse

“…For the purpose of determining coverage , they use the criteria of scope and variety . For quality‐aware WDS selection and extraction, Marotta et al [30] proposed service‐related factors to be organised in the six quality dimensions of service level , interoperability , security , business value , usability and stability ; and data‐related factors to be organised in the six quality dimensions of accuracy , completeness , freshness , uniqueness , consistency and reliability . For the same purpose, Zhu and Buchman [23] proposed the WebQM quality model with three classes of quality factors – the quality factors of availability , accessibility , durability and refresh rate for the class of web source stability; the quality factors of origin , correctness , completeness , objectivity and metadata for the class of web data/information quality; and the quality factors of relevance , presentation and timeliness for the class of web application‐specific quality.…”

“…These four perspectives are: (i) a set of quality factors from the standards for DQ [26, 36, 37, 39] (ii) the quality factors from the works specific to the context of the web source [25, 27, 29, 40, 29] (iii) the quality factors, which are evaluated by the website quality testing tools [41–46] used across the internet (iv) the quality factors from the already proposed works with the same intended use of web data as EDS to the DW [3, 23, 30–33, 47, 48]. However, the works similar to our problem area [3, 23, 30–33, 47, 48], does not focus specifically on the segregation of the quality factors based on the expertise required to judge them. Also, the reduction of the workload of the experts (to evaluate the vast number of sources in the web domain on the basis of a huge number of quality factors), has also been ignored in the literature related to this problem area, to the best of our knowledge.…”

“…Hence, it is most crucial to evaluate the identified set of web data sources based on certain criteria of information quality [25–29] and then select high quality, credible, compatible sources from amongst them. Only after this quality‐aware selection of web sources [23, 30, 31], the integration of web data into the DW will be able to provide appropriate decision support for the organisations. The objectives of this work are, therefore, to evaluate the quality of web sources for DW and to select high‐quality web sources to be used as EDSs for incorporation in the DW.…”

Configurable Web Warehouses construction through BPM Systems

“…In the configuration phase different activities are applied in order to configure each WW component. The main configuration activities for the Extraction component are: (1) selecting domain and web sources, (2) defining the sources schemas, (3) defining data mappings, and (4) selecting data services for sources data extraction. For the Integration component, they are: (1) integrated schema definition, (2) schema mappings specifications, and (3) selecting integration services.…”

“…This WW is implemented through a general platform that is configured for each domain, or particular case it will be used. The general platform is built according to an architecture that is suitable for different WWs [2]. Although the process of building DW is well known with well defined stages, it is still mostly carried out manually by IT people in conjunction with business people.…”