Title: QoS-aware online mechanism for dynamic VM provisioning in cloud market using Q-learning

Authors: Ayoub Alsarhan

Addresses: Department of Computer Information System, Hashemite University, P.O. Box 150459, Zarqa 13115, Jordan

Abstract: Cloud provider (CP) leases various resources such as CPUs, memory and storage in the form of virtual machine (VM) instances to clients over internet. This paper tackles the issue of quality of service (QoS) provisioning in cloud environment. We examine using Q-learning for provisioning VMs in the cloud market. The extracted decision function should decide when rejecting new request for VMs that violate QoS guarantee. This problem requires the reward for CP be maximised while simultaneously meeting a quality of service (QoS) constraints. These complex contradicting objectives are embedded in our Q-learning model that is developed and implemented as shown in this paper. Numerical analysis shows the ability of our solution to earn significantly higher revenue than alternatives.

Keywords: quality of service; QoS; cloud computing; resource management; Q-learning; cloud service trading.

DOI: 10.1504/IJAIP.2020.105823

International Journal of Advanced Intelligence Paradigms, 2020 Vol.15 No.3, pp.287 - 299

Received: 18 Jul 2016
Accepted: 22 Mar 2017
Published online: 16 Mar 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article