Title: Diastema: data-driven stack for big data applications management and deployment

Authors: Athanasios Kiourtis; Yannis Poulakis; Panagiotis Karamolegkos; Andreas Karabetian; Konstantinos Voulgaris; Argyro Mavrogiorgou; Dimosthenis Kyriazis

Addresses: Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece ' Department of Digital Systems, University of Piraeus, 80, M. Karaoli & A. Dimitriou St., 18534, Piraeus, Greece

Abstract: Most techniques for data processing run on standard infrastructure management systems, while large datasets is being increasingly generated. The main challenge refers to using technology to gather efficient and faster insights from a dataset, considering not asking what data is easily obtainable and which tools are amenable to working with that dataset, but rather what question the analysis is trying to answer. This creates a landscape with data-intensive projects that prioritise technical prowess of execution over the robustness of analytical findings. Hence, a data-driven stack for big data applications' management and deployment is being described, diastema, bringing efficient data-as-a-service data management through distributed storage and analytics, aiming at high performance and utilisation of heterogeneous resources, including abstraction, gateways, and small-footprint virtual machines. Diastema is evaluated through training a customer forecasting model for indicating customers' behaviour, turning limited-value raw data to timely, relevant data, targeting at business agility and competitiveness.

Keywords: dynamic orchestration; infrastructure management; resources allocation; data-as-a-service.

DOI: 10.1504/IJBDM.2023.133428

International Journal of Big Data Management, 2023 Vol.3 No.1, pp.1 - 27

Received: 14 Nov 2021
Accepted: 18 May 2022
Published online: 15 Sep 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article