Title: Dynamic MPI parallel task scheduling based on a master-worker pattern in cloud computing

Authors: Fan Ding; Sandra Wienke; Ruisheng Zhang

Addresses: College of Computer and Communication Engineering, Lanzhou University of Technology, Lanzhou, China ' IT Center, RWTH Aachen University, Aachen, Germany ' School of Information Science and Engineering, Lanzhou University, Lanzhou, China

Abstract: Load imbalance issues have become one of the main challenges in efficient task scheduling. On-demand computing resources that can be provided by the cloud infrastructure enable cost-efficiency for numerous application cases compared to on-premise resources that an organisation purchases and that might idle for non-peak situations. However, scheduling a large amount of tasks in parallel on the cloud nodes cannot always maintain the promised cost-efficiency due to the different workloads arising on these cloud nodes, caused by single point of failure, low bandwidth, and other unforeseen situations. Generated overhead and load imbalances between nodes lead to numerous paid resources lay idle. In our work, we propose a dynamic parallel task scheduling method by employing a master-worker model on a real-world engineering application executed on the Azure cloud. The main idea of our work is that we schedule tasks on cloud compute resources depending on the actual workload of each process instead of static-scheduled load.

Keywords: cloud computing; cost efficiency; TCO; total cost of ownership; dynamic MPI; message passing interface; parallel task scheduling; master-worker patterns; load imbalance.

DOI: 10.1504/IJAACS.2015.073191

International Journal of Autonomous and Adaptive Communications Systems, 2015 Vol.8 No.4, pp.424 - 438

Received: 26 Aug 2013
Accepted: 07 Apr 2014
Published online: 27 Nov 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article