Title: Big data (lost) in the cloud

Authors: Beniamino Di Martino; Rocco Aversa; Giuseppina Cretella; Antonio Esposito; Joanna Kołodziej

Addresses: Department of Industrial and Information Engineering, Second University of Naples, Real Casa dell'Annunziata via Roma, 29, 81031 Aversa (CE), Italy ' Department of Industrial and Information Engineering, Second University of Naples, Real Casa dell'Annunziata via Roma, 29, 81031 Aversa (CE), Italy ' Department of Industrial and Information Engineering, Second University of Naples, Real Casa dell'Annunziata via Roma, 29, 81031 Aversa (CE), Italy ' Department of Industrial and Information Engineering, Second University of Naples, Real Casa dell'Annunziata via Roma, 29, 81031 Aversa (CE), Italy ' Institute of Computer Science, Cracow University of Technology, ul. Warszawska 24, 31-155 Cracow, Poland

Abstract: The big data era poses a critically difficult challenge and striking development opportunities to high performance computing (HPC). The major problem is an efficient transformation of the massive data of various types into valuable information and meaningful knowledge. Computationally-effective HPC is required in a fast-increasing number of data-intensive domains. With its special features of self-service and pay-as-you-use, cloud computing (CC) offers suitable abstractions to manage the complexity of the analysis of large data in various scientific and engineering domains. This paper surveys briefly the most recent developments on CC support for solving the big data problems. It presents a comprehensive critical analysis of the existing solutions and shows the further possible directions of the research in this domain including new generation multi-datacentre cloud architectures for the storage and management of the huge big data streams.

Keywords: distributed data centres; resource provisioning; big data workflow; cloud computing; high performance computing; MapReduce; Hadoop; data analysis; data curation; data storage; data management.

DOI: 10.1504/IJBDI.2014.063840

International Journal of Big Data Intelligence, 2014 Vol.1 No.1/2, pp.3 - 17

Received: 28 Dec 2013
Accepted: 25 Feb 2014
Published online: 30 Sep 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article