Performance analysis of extract, transform, load (ETL) in apache Hadoop atop NAS storage using ISCSI

Adnan,; Ilham, Amil Ahmad; Usman, Syahrul

doi:10.1109/caipt.2017.8320716

Cited by 10 publications

(3 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on literature review, the study of BI system in general has 2 main different aspects; technical approach and managerial approach. The technical approach focuses on techniques and tools to develop data-driven decision support system such as creating the set of tools to support data integration process or designing and developing the system with advanced technologies [21][22][23][24][25][26]. On the other hand, the managerial aspect concentrates on process to see how data is integrated and analyzed to generate the useful and valuable information to decision makers in order to guarantee the successful of system implementation [11][12][13][14][15][16][17][18][19][20][21].…”

Section: Business Intelligence (Bi)mentioning

confidence: 99%

“…The Quality Objective Matrix (QOX) is one of the quality measures of data and information that can be used to examine the performance of relevant data and information to ensure the effectiveness of ETL workflow [1,4,[7][8][24][25]. Previous studies identified four dimensions of QOX: accuracy, completenes, scalability, and efficiency [7][8][30][31][32][33] as presented in Table 1.…”

Section: Qualification Objective Matrix (Qox)mentioning

confidence: 99%

See 1 more Smart Citation

The Design and Implementation of Business Intelligence System for Lecturer Qualification Analysis based on ETL’s QOX Approach

Saebao¹,

Matayong²,

Trakulmaykee³

2021

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

The study aims to design and evaluate the Business Intelligence (BI) system for lecturer qualification analysis. The Quality Objective Matrix (QOX) was the tool to evaluate the proposed ETL's qualities. This research focused on four key performance indicators of QOX: accuracy, completeness, scalability, and efficiency. In implementation, the developed BI system was evaluated by satisfaction questionnaire which was designed based on the Technology Acceptance Model (TAM). The results showed the proposed ETLs were good qualities in terms of accuracy, completeness, scalability, and efficiency. For satisfaction evaluation, the results also showed the very good level in overall. It was indicated that the users were satisfied to use the proposed BI dashboard for lecturers' qualifications analysis which was developed based on the Standard Criteria for Graduate Studies Programs (SCGSP). They perceived that the Lecturer Qualification Analysis System (LQAS) was easy to use and can help them to reduce time in the data preparing process. Additionally, the results highlighted that the information quality of BI dashboard also was sufficient and accurate for lecturer qualification analysis.

show abstract

Section: Business Intelligence (Bi)mentioning

confidence: 99%

Section: Qualification Objective Matrix (Qox)mentioning

confidence: 99%

The Design and Implementation of Business Intelligence System for Lecturer Qualification Analysis based on ETL’s QOX Approach

Saebao¹,

Matayong²,

Trakulmaykee³

2021

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

show abstract

“…The architecture design in this study has a high availability mechanism, so there will be two DBMS servers, and the servers are connected to the storage via the ISCSI (Internet Small Computer System Interface) [4] [5] protocol. All data is uniformly stored in the storage unit to maintain data consistency.…”

Section: Introductionmentioning

confidence: 99%

Implementation and verification of high data availability on database

Chen¹,

Tsai

2019

TNC

View full text Add to dashboard Cite

This study provides a low-cost and high-availability database management system architecture for general Small/Medium Enterprises (SMEs) to backup database data access. To prove that the proposed architecture can support the high availability of the database, and can effectively avoid data loss in memory caused by failovers, this study applies the main test method of powering off the virtual machine and verified three cases on two commonly used databases MySQL and PostgreSQL: Case 1 proves that this study combines the database native disaster recovery mechanism to effectively achieve high availability of the database. Case 2 proves that it effectively controls the WAL (Write Ahead Log) of the PostgreSQL database and Redo log mechanism of the MySQL database, so that data correctness is maintained during failovers. Case 3 proves that it can analyze and control the timing of the database in writing data in the cache memory to the hard disk. This study also designed a failover process to avoid data loss during failovers due to no enough time to write the data in the cache memory back to the hard disk; and finally to realize the high-availability of the database management system architecture in a practical way. Keywords: Database, DBMS, High Availability, Failover, DRBD

show abstract

Cloud Based Heterogeneous Big Data Integration and Data Analysis for Business Intelligence

Jayaraj

Samath²

2020

Proceeding of the International Conference on Computer Networks, Big Data and IoT (ICCBI - 2019)

View full text Add to dashboard Cite

Performance analysis of extract, transform, load (ETL) in apache Hadoop atop NAS storage using ISCSI

Cited by 10 publications

References 1 publication

The Design and Implementation of Business Intelligence System for Lecturer Qualification Analysis based on ETL’s QOX Approach

The Design and Implementation of Business Intelligence System for Lecturer Qualification Analysis based on ETL’s QOX Approach

Implementation and verification of high data availability on database

Cloud Based Heterogeneous Big Data Integration and Data Analysis for Business Intelligence

Contact Info

Product

Resources

About