Data discovery method for Extract- Transform-Load

Madhikerrni, Manik; Främling, Kary

doi:10.1109/icmimt.2019.8712027

Cited by 3 publications

(2 citation statements)

References 56 publications

(65 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [11], the author said, some of the benefits provided by the data warehouse directly, that is users can perform extensive data analysis in various ways, consolidated data presentation, timely and better information, improved system performance results, and simplified data access. Extract, transform, loading (ETL) is a data integration framework that involves extracting data from data management systems and then cleaning it, transforming it according to business needs, and finally loading it into a database [12].…”

Section: Related Workmentioning

confidence: 99%

Business Intelligence Budget Implementation in Ministry of Finance (As Chief Operating Officer)

Hasanuddin¹,

Isa²

2021

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

The Ministry of Finance is the state ministry in charge of state financial affairs which has two functions, namely the Chief Financial Officer (CFO) as the State General Treasurer and the Chief Operating Officer (COO) as a Budget User. As COO, the Ministry of Finance is expected to be able to provide information related to budget implementation to leaders quickly and accurately. The problem that occurs is the implementation information is still done manually, so it takes time to process. In addition, there is no information regarding budget predictions for the next semester or year. This study uses Business Intelligence (BI) as a technique in the process of building budget execution information. The Business Intelligence Roadmap is a methodology used to produce budget implementation information in the form of a dashboard. To see the prediction of the realization of the budget for the next semester or year using the forecasting method with the neural network model. the Results is budget implementation information can be accessed easily and has accurate data and can provide information to the leaders as supporting material in making decisions at the Ministry of Finance.

show abstract

Section: Related Workmentioning

confidence: 99%

Business Intelligence Budget Implementation in Ministry of Finance (As Chief Operating Officer)

Hasanuddin¹,

Isa²

2021

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

show abstract

“…Some companies may utilize commercial database management systems like Microsoft SQL Server [7], IBM DB2, or Oracle DBMS. Meanwhile, free, open-source alternatives are provided, including PostgreSQL, MongoDB, MySQL, and MariaDB [8].…”

Section: Introductionmentioning

confidence: 99%

Enhancing Data Management Strategies with a Hybrid Layering Framework in Assessing Data Validation and High Availability Sustainability

Netinant,

Saengsuwan,

Rukhiran

et al. 2023

Sustainability

View full text Add to dashboard Cite

Individuals and digital organizations deal with a substantial amount of collected data required for performing various data management strategies, such as replacing, upgrading, and migrating existing data from one system to another, while supporting the data’s complexity, authenticity, quality, and precision. Failures in data migration can result in data and service interruptions, financial losses, and reputational harm. This research aims to identify the specific challenges of a data management strategy, develop a comprehensive framework of data migration practices, and assess the efficacy of data validation and high availability for optimizing complex data and reducing the need to minimize errors during data migration. Combining trickle and zero-downtime migration techniques with a layering approach, a hybrid-layering framework was designed to encompass the entire spectrum of data migration techniques, beginning with system requirements and data transformation, rigorous functions, and evaluation metrics for sustainable data validation. The evaluation metric criteria are defined to evaluate data migration based on data consistency, integrity, quality, accuracy, and recall. The experiment demonstrated a real-world scenario involving a logistics company with 222 tables and 4.65 GB of data. The research compared various data migration strategies. The outcomes of the hybrid-layering framework’s examination of the final system’s functionality are satisfactory, emphasizing the critical importance of data migration sustainability to ensure data validity and high availability. This study is useful for individuals and organizations seeking to sustainably improve their data management strategies to minimize disruptions while preserving data integrity.

show abstract

Extract-Load-Transform (ELT) Process Runtime Analysis and Optimization

Zvonarev

Gudilin

Lychagin

et al. 2023

2023 5th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)

View full text Add to dashboard Cite

Data discovery method for Extract- Transform-Load

Abstract: Preface also want to thank my beloved furry friend Bantu, who has passed away, for wonderful memories.

Cited by 3 publications

References 56 publications

Business Intelligence Budget Implementation in Ministry of Finance (As Chief Operating Officer)

Business Intelligence Budget Implementation in Ministry of Finance (As Chief Operating Officer)

Enhancing Data Management Strategies with a Hybrid Layering Framework in Assessing Data Validation and High Availability Sustainability

Extract-Load-Transform (ELT) Process Runtime Analysis and Optimization

Contact Info

Product

Resources

About