Title: Experimental results on change data capture methods implementation in different data structures to support real-time data warehouse

Authors: Harry Chandra

Addresses: School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, Indonesia

Abstract: The need for rapid decision making in the organisation, causing the importance of developing a real-time data warehouse system. In addition, what also needs to be considered is how to make the extract, transform, load (ETL) processes carried out, would not interfere the performance of the operational database being used. One of the methods that can be used is change data capture. Nowadays, the data sources that companies used for many operations are usually coming from different sources. The proposed research will identified which one is the best change data capture method from three types of methods in three database application for each type of data structure to be tested, that supports the RTDW system making process. From the results of research conducted it is proved that the best change data capture method is different for each type of data source tested in the same environment.

Keywords: real-time data warehouse; RTDW; extract; transform; load; ETL; change data capture; data structures model; log-based; timestamp on file; timestamp on rows; trigger; replication.

DOI: 10.1504/IJBIS.2020.108651

International Journal of Business Information Systems, 2020 Vol.34 No.3, pp.373 - 402

Received: 26 Nov 2018
Accepted: 27 Feb 2019
Published online: 24 Jul 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article