Efficient data access and performance improvement model for virtual data warehouse

Khan, Fakhri Alam; Ahmad, Awais; Imran, Muhammad; Alharbi, Mafawez; Mujeeb-ur-rehman,; Jan, Bilal

doi:10.1016/j.scs.2017.08.003

Cited by 15 publications

(8 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The data coalition rule was used to identify errors, inappropriate data and defects. The purpose of this method ISSN: 2252-8938 Ì 767 is to store queries and the outputs related to them [11].…”

Section: Related Workmentioning

confidence: 99%

Design and implementation of the web (extract, transform, load) process in data warehouse application

Al-Rahman

Hasan²,

Sagheer³

2023

IJ-AI

View full text Add to dashboard Cite

<p>Recently, due to an increase size and complexity of data in addition to the management issues, data storage is required a great deal of attention to employ it in realistic applications, so the requirement for designing and implementing a data warehouse system has become an urgent necessity, ETL represents a vital side of data warehouse architecture. This paper, designed data warehouse application contains a web ETL process that divides its work between the input device and server. This system proposed to solve the problem lack of partition of the work between the input device and server. The proposed and designed system can be used and applied in many branches and disciplines for its high performance in adding data, analyzing data using a web server and building queries. The analysis of the results has been proven that a faster time is achieved in cleaning data and transferring it between the remote parts of the system connected to the Internet. Where ETL without Missing for any data took 0.00582 seconds.</p>

show abstract

Section: Related Workmentioning

confidence: 99%

Design and implementation of the web (extract, transform, load) process in data warehouse application

Al-Rahman

Hasan²,

Sagheer³

2023

IJ-AI

View full text Add to dashboard Cite

show abstract

“…Based on the waste battery and waste oil recovery reuse control system design, the virtual warehouse of power grid hazardous waste was constructed, and the business demand module of the virtual warehouse was defined [8]. A detailed technical implementation plan of hazardous waste management system information platform was designed including research entity entry and exit process, transaction declaration and approval process, waste material operation process, process management, and monitoring process.…”

Section: Intelligent Control and Full Chain Of Iotmentioning

confidence: 99%

Research on the Informatization Management System of Hazardous Waste in Power Grid Based on the Virtual Warehouse

Wang¹,

Li²,

Zhang³

et al. 2022

AEMR

View full text Add to dashboard Cite

As the environmental protection policies become increasingly strict, hazardous waste disposal is a noteworthy issue for power grid companies to achieve clean production. Based on the radio frequency identification devices (RFID) and internet of things (IoT) technology, a virtual warehouse theory, and informatization management system was introduced in this article, which consists of waste identification and tracking, full-chain of IoT, trade matching, production forecast, and visual display. This study offers a new thought for grid companies to develop other management methods to promote environmental protection and management works.

show abstract

“…The results show that the longitudinal HBase model is more efficient in data query than MongoDB-oriented document model. 10 Lucas C. et al put forward three partitioning strategies for column family: (1) the SameCF policy that puts all dimension information into the same column cluster, (2) the CNSSB policy that divides each individual column into column clusters, and (3) the FactDate policy that classifies frequently used dimensions into fact tables. In addition, Lucas and his teammates designed a three-tier data warehouse framework based on star data model, and developed the data query function of data warehouse using MapReduce model.…”

Section: Of 11mentioning

confidence: 99%

“…With the rapid accumulation of data and the maturation of NoSQL technology, the traditional relation data warehouses are being replaced by NoSQL‐based data warehouses with OLAP query and analysis functions 1,2 . For the scalability and availability of services, the traditional data warehouses are often designed in a distributed manner on the principles of atomicity, consistency, isolation, and durability 3,4 .…”

Section: Literature Reviewmentioning

confidence: 99%

An improved join‐free snowflake schema for ETL and OLAP of data warehouse

Wang

Zhao

Fan

et al. 2019

Concurrency and Computation

View full text Add to dashboard Cite

The emergence of big data makes more and more enterprise change data management strategy, from simple data storage to OLAP query analysis; meanwhile, NoSQL-based data warehouse receive more increasing attention than traditional SQL-based database. By improving the JFSS model for ETL, this paper proposes the uniform distribution code (UDC), model identification code (MIC), standard dimension code (SDC), and attribute dimensional code (ADC); defines the data storage format of ; and identifies the extraction, transformation, and loading strategies of data warehouse. Several experiments are carried out to analyze single record and range record queries as typical OLAP based on Hadoop database (HBase). The results show the proposed scheme can provide lower overhead than the traditional SQL-based database while facilitating the scope and flexibility of data warehouse services.

show abstract

Efficient data access and performance improvement model for virtual data warehouse

Cited by 15 publications

References 5 publications

Design and implementation of the web (extract, transform, load) process in data warehouse application

Design and implementation of the web (extract, transform, load) process in data warehouse application

Research on the Informatization Management System of Hazardous Waste in Power Grid Based on the Virtual Warehouse

An improved join‐free snowflake schema for ETL and OLAP of data warehouse

Contact Info

Product

Resources

About