Comparação de práticas e ferramentas de integração de dados utilizando o banco de dados amostral adventureworks

Abstract

In the “Information Era”, companies deal with vast volumes of data. Information overload hampers decision-making. Digital transformation is pivotal, involving data integration through data pipelines. These processes convert raw data into actionable insights for business analysis. This study aims to compare the performance of different pipelines, ETL and ELT, analyzing data transformation time to ensure availability and decision-making efficiency. The comparison between ELT and ETL shows the significance of each method's specific application. In this study using AdventureWorks, ETL outperformed by transforming data before loading, unlike ELT. The difference between code usage and tools like Pentaho highlights a trade-off between performance and accessibility. Choosing between ELT and ETL should account for project needs, while future studies may deepen the understanding of these processes.