Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow

Xavier Dutreilh; Sergey Kirgizov; Olga Melekhova; Jacques Malenfant; Nicolas Rivierre; Isis Truck

Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow

Xavier Dutreilh ^{1, 2} Sergey Kirgizov ² Olga Melekhova ² Jacques Malenfant ² Nicolas Rivierre ¹ Isis Truck ^{3, 4}

1 Orange Labs [Issy les Moulineaux]

2 MoVe - Modélisation et Vérification

LIP6 - Laboratoire d'Informatique de Paris 6

3 CHART - Cognitions Humaine et ARTificielle

4 LIASD - Laboratoire d'Informatique Avancée de Saint-Denis

Abstract : Dynamic and appropriate resource dimensioning isa crucial issue in cloud computing. As applications go more andmore 24/7, online policies must be sought to balance performancewith the cost of allocated virtual machines. Most industrialapproaches to date use ad hoc manual policies, such as thresholdbasedones. Providing good thresholds proved to be tricky andhard to automatize to fit every application requirement. Researchis being done to apply automatic decision-making approaches,such as reinforcement learning. Yet, they face a lot of problemsto go to the field: having good policies in the early phasesof learning, time for the learning to converge to an optimalpolicy and coping with changes in the application performancebehavior over time. In this paper, we propose to deal with theseproblems using appropriate initialization for the early stages aswell as convergence speedups applied throughout the learningphases and we present our first experimental results for these.We also introduce a performance model change detection onwhich we are currently working to complete the learning processmanagement. Even though some of these proposals were knownin the reinforcement learning field, the key contribution of thispaper is to integrate them in a real cloud controller and toprogram them as an automated workflow.

Keywords : -

Type de document :

Communication dans un congrès

7th International Conference on Autonomic and Autonomous Systems (ICAS’2011), May 2011, Venice, Italy. pp.67-74

Domaine :

Sciences de l'Homme et Société

Liste complète des métadonnées

https://hal-univ-paris8.archives-ouvertes.fr/hal-01122123
Contributeur : Haki Shtalbi <>
Soumis le : mardi 3 mars 2015 - 12:57:25
Dernière modification le : jeudi 22 novembre 2018 - 14:39:35

Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow

Identifiants

Collections

Citation

Exporter

Métriques

531

Contact

Using Reinforcement Learning for Autonomic Resource Allocation in Clouds: towards a fully automated workflow

Identifiants

Collections

Citation

Exporter

Partager

Métriques

531

Contact