Title: Data-driven journey: a data management paradigm-centric review and data mesh capabilities

Authors: Kamel Abdellaoui; Mohamed Ali Hadj Taieb; Rafik Mahjoubi; Mohamed Ben Aouicha

Addresses: Data Engineering and Semantics Research Unit, Faculty of Sciences of Sfax, University of Sfax, Sfax, Tunisia ' Data Engineering and Semantics Research Unit, Faculty of Sciences of Sfax, University of Sfax, Sfax, Tunisia ' Data Innovation Lab, African Development Bank, Abidjan, Côte d'Ivoire ' Data Engineering and Semantics Research Unit, Faculty of Sciences of Sfax, University of Sfax, Sfax, Tunisia

Abstract: Becoming data driven is one of the top strategic objectives of data-rich organisations. Africa must join the wave to capture and unlock the highest value from data. Therefore, this survey analyses the drivers, challenges, and evolution, of existing data management paradigms including data warehouse, data lake and data lakehouse. It reveals the limitations of monolithic approaches to address data at scale and how they led to a paradigm shift toward a more distributed and decentralised data mesh. The paper discusses data mesh capabilities to address the challenges of data availability and accessibility at scale in Africa to enable leapfrog development in its journey to being data driven.

Keywords: data-driven; data management paradigms; data mesh; analytics; developing countries.

DOI: 10.1504/IJDMMM.2024.138865

International Journal of Data Mining, Modelling and Management, 2024 Vol.16 No.2, pp.209 - 243

Received: 07 Jan 2023
Accepted: 04 Aug 2023
Published online: 31 May 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article