Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow

Abstract : Dynamic and appropriate resource dimensioning isa crucial issue in cloud computing. As applications go more andmore 24/7, online policies must be sought to balance performancewith the cost of allocated virtual machines. Most industrialapproaches to date use ad hoc manual policies, such as thresholdbasedones. Providing good thresholds proved to be tricky andhard to automatize to fit every application requirement. Researchis being done to apply automatic decision-making approaches,such as reinforcement learning. Yet, they face a lot of problemsto go to the field: having good policies in the early phasesof learning, time for the learning to converge to an optimalpolicy and coping with changes in the application performancebehavior over time. In this paper, we propose to deal with theseproblems using appropriate initialization for the early stages aswell as convergence speedups applied throughout the learningphases and we present our first experimental results for these.We also introduce a performance model change detection onwhich we are currently working to complete the learning processmanagement. Even though some of these proposals were knownin the reinforcement learning field, the key contribution of thispaper is to integrate them in a real cloud controller and toprogram them as an automated workflow.
Keywords : -
Type de document :
Communication dans un congrès
7th International Conference on Autonomic and Autonomous Systems (ICAS’2011), May 2011, Venice, Italy. pp.67-74
Liste complète des métadonnées

https://hal-univ-paris8.archives-ouvertes.fr/hal-01122123
Contributeur : Haki Shtalbi <>
Soumis le : mardi 3 mars 2015 - 12:57:25
Dernière modification le : vendredi 31 août 2018 - 09:25:57

Identifiants

  • HAL Id : hal-01122123, version 1

Collections

Citation

Xavier Dutreilh, Sergey Kirgizov, Olga Melekhova, Jacques Malenfant, Nicolas Rivierre, et al.. Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow. 7th International Conference on Autonomic and Autonomous Systems (ICAS’2011), May 2011, Venice, Italy. pp.67-74. 〈hal-01122123〉

Partager

Métriques

Consultations de la notice

464