Research on Real Time Data Warehouse Architecture

Abstract

Abstract. Real time data warehouse is the research hotspots of data warehouse. It expands the application scope of data warehouse and provides real-time decision-making system for business users. This paper describes the concepts of real time data warehouse and proposes a real time data warehouse architecture which is based on real-time cache storage. The architecture consists of three main components: real-time data capture and integration, business event management component and view materialization decision. There are two key technologies: real-time data extraction and materialized view decision-making. This paper describes existing solutions and their shortcomings, then proposes feasible technical solutions: real-time data extraction based on transaction log analysis and materialized view estimation model with time factor.

An Innovative Method to Extract Data in a Real-time Data Warehousing Environment

“…Regarding to meeting real-time data warehousing requirement, Bruckner et al [26], Naeem et al [27], Javed, M. and Nawaz, A. [28], YiChuan and Yao [29], MadeSukarsa et al [30], Jain et al [13], Jia et al [31], Obali et al [32], Mao et al [33], Li and Mao [20] and Muddasir and Raghuveer [9] deals with low latency. Further, just Bruckner et al [26] and Viana et al [34] deal with availability requirements.…”