Data quality in ETL process: A preliminary study

Manel Souibgui · Faten Atigui · Saloua Zammali · Samira Si-Saïd Cherfi · Sadok Ben Yahia

92 citations0/0 files storedProcedia Computer Science

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Data Quality and Management Big Data and Business Intelligence Web Data Mining and Analysis

Abstract

The accuracy and relevance of Business Intelligence & Analytics (BI&A) rely on the ability to bring high data quality to the data warehouse from both internal and external sources using the ETL process. The latter is complex and time-consuming as it manages data with heterogeneous content and diverse quality problems. Ensuring data quality requires tracking quality defects along the ETL process. In this paper, we present the main ETL quality characteristics. We provide an overview of the existing ETL process data quality approaches. We also present a comparative study of some commercial ETL tools to show how much these tools consider data quality dimensions. To illustrate our study, we carry out experiments using an ETL dedicated solution (Talend Data Integration) and a data quality dedicated solution (Talend Data Quality). Based on our study, we identify and discuss quality challenges to be addressed in our future research.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 92 citations exist upstream.

References

2012Business Intelligence and Analytics: From Big Data to Big Impact 1996Beyond Accuracy: What Data Quality Means to Data Consumers 2008Building a Data Warehouse 2000Data Cleaning: Problems and Current Approaches.2009Methodologies for data quality assessment and improvement 1998The impact of poor data quality on the typical enterprise 2008Swoosh: a generic approach to entity resolution 2009A Survey of Extract–Transform–Load Technology

Cited by

2021Investigating occupational and operational industrial safety data through Business Intelligence and Machine Learning 2024An Overview of ETL Techniques, Tools, Processes and Evaluations in Data Warehousing 2021La inteligencia de negocios y la analítica de datos en los procesos empresariales 2022Data Model Design to Support Data-Driven IT Governance Implementation 2021Machine Learning Mini Batch K-means and Business Intelligence Utilization for Credit Card Customer Segmentation

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.