A deep reinforcement learning approach for early classification of time series - AGPIG Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

A deep reinforcement learning approach for early classification of time series

Résumé

—In many real-world applications, ranging from pre-dictive maintenance to personalized medicine, early classification of time series data is of paramount importance for supporting decision makers. In this article, we address this challenging task with a novel approach based on reinforcement learning. We introduce an early classifier agent, an end-to-end reinforcement learning agent (deep Q-network, DQN) [1] able to perform early classification in an efficient way. We formulate the early classification problem in a reinforcement learning framework: we introduce a suitable set of states and actions but we also define a specific reward function which aims at finding a compromise between earliness and classification accuracy. While most of the existing solutions do not explicitly take time into account in the final decision, this solution allows the user to set this trade-off in a more flexible way. In particular, we show experimentally on datasets from the UCR time series archive [2] that this agent is able to continually adapt its behavior without human intervention and progressively learn to compromise between accurate and fast predictions.
Fichier principal
Vignette du fichier
PID5426633.pdf (256.07 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01825472 , version 1 (28-06-2018)

Identifiants

Citer

Coralie Martinez, Guillaume Perrin, E Ramasso, Michèle Rombaut. A deep reinforcement learning approach for early classification of time series. EUSIPCO 2018 - 26th European Signal Processing Conference, Sep 2018, Rome, Italy. ⟨10.23919/EUSIPCO.2018.8553544⟩. ⟨hal-01825472⟩
606 Consultations
3550 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More