Title: Delta extraction in a limited collaborative environment

Authors: Zheng Lu; Haijun Liu; Jun Yan

Addresses: School of Computing and Information Technology, University of Wollongong, NSW, Australia ' Department of Mathematics, Zhengzhou University, Zhengzhou, China ' School of Computing and Information Technology, University of Wollongong, NSW, Australia

Abstract: This work considers extracting delta in a distributed environment where the collaboration from highly autonomous operational database management systems is limited to granting read only access on a set of selected relational tables. In addition, due to possibly large volumes of remote source data involved, and consequently enormous overhead associated with data transfer, efficiency issues must been taken into consideration. This research is based on the observation that usually, there is a large amount of static data in relational tables. It is proposed to use some statistical techniques in data warehouse system to help us understand the essential characteristics of remote data. Based on the characteristics of remote data, some optimisation techniques are presented.

Keywords: delta extraction; data integration; data synchronisation; snapshot differential algorithms; limited collaboration; collaborative environments; database management systems; DBMS; relational tables; data warehouses; remote data; optimisation.

DOI: 10.1504/IJIIDS.2015.070828

International Journal of Intelligent Information and Database Systems, 2015 Vol.9 No.1, pp.54 - 78

Received: 11 Mar 2014
Accepted: 14 Apr 2015
Published online: 28 Jul 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article