Performance Tunning Mechanisms for Data Warehouse: Query cache

Abstract

ABSTRACT:Data warehousing encompasses architectures, algorithms, and tools for bringing together selected data from multiple databases or other information sources into a single repository, called a data warehouse suitable for direct querying or analysis. In recent years data warehousing has become a prominent buzzword in the database industry, but attention from the database research community has been limited. At the warehouse, queries can be answered and data analysis can be performed quickly and efficiently since the information is directly available, with model and semantic differences already resolved. The primary goal of data warehouse is to free the information locked up in the operational database so that decision makers and business analyst can make queries, analysis and planning regardless of the data changes in operational database. As the number of queries is large, therefore, in certain cases there is reasonable probability that same query submitted by the one or multiple users at different times. Each time when query is executed, all the data of warehouse is analyzed to generate the result of that query.In this paper we will try to find the common problems faced. These kinds of problems are faced by Data Warehouse administrators which are minimizes response time and improves the efficiency of data warehouse overall, particularly when data warehouse is updated at regular interval. The overall performance of the system and provide good strategies that make superior Data Warehouse.

An Overview of ETL Techniques, Tools, Processes and Evaluations in Data Warehousing

“…It is a fundamental ETL concept that involves applying a sequence of functions on extracted data. Data that does not require transformation is known as direct move or pass through data [12].…”

“…The final step in the ETL process involves transferring data into the main data warehouse database. Due to the large amount of data that needs to be processed in a limited amount of time, typically overnight, it is crucial that the data loading process is optimized for efficiency and speed [12].…”

Building and Implementation of a Big Data Mining Model for Businesses

“…This ensures a one-door access mechanism for management to obtain information and analyse it for decision-making. The data warehouse has several characteristics [12,13]: subject-orientated, integrated data, non-volatile, and variable in time.…”

“…The fact table shows what is supported by the data warehouse for decision analysis. The dimension table contains attributes that describe the entered data in the fact table [4,13].…”

Klasifikasi Kategori Hasil Perhitungan Indeks Standar Pencemaran Udara dengan Gausian Naïve Bayes (Studi Kasus: ISPU DKI Jakarta 2020)

“…Proses ini juga disebut proses Extract, Transform, Load atau ETL yang juga dilakukan pada Data Warehouse. Fungsi utama dari ETL ini adalah mengurangi waktu reposn dan meningkatkan performa [9]. Tujuan akhir dari datawarehouse adalah menyiapkan sebuah data yang siap diproses.…”