Pipel: exploiting resource reorganisation to optimise performance of pipeline-structured applications in the cloud
by Vinicius Meyer; Vinicius Facco Rodrigues; Rodrigo Da Rosa Righi; Cristiano André Da Costa; Guilherme Galante; Cristiano Bonato Both
International Journal of Computational Systems Engineering (IJCSYSE), Vol. 5, No. 1, 2019

Abstract: Workflow has become a standard for many scientific applications that are characterized by a collection of processing elements. Particularly, a pipeline application is a type of workflow that receives a set of tasks, which must pass through all processing elements in a linear fashion. However, the strategy of using a fixed number of resources can cause under- or over-provisioning situations, besides not fitting irregular demands. In this context, our idea is to deploy the pipeline application in the cloud, so executing it with a feature that differentiates cloud from other distributed systems: resource elasticity. Thus, we propose Pipel: a reactive elasticity model that uses lower and upper load thresholds and the CPU metric to on-the-fly select the most appropriated number of compute nodes for each stage along the pipeline execution. The results were promising, presenting an average gain of 38% in the application time when comparing non-elastic and elastic executions.

Online publication date: Fri, 22-Mar-2019

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computational Systems Engineering (IJCSYSE):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com