Negative Sampling Strategies for Contrastive Self-Supervised Learning of Graph Representations - Département Communications et Electronique Accéder directement au contenu
Article Dans Une Revue Signal Processing Année : 2022

Negative Sampling Strategies for Contrastive Self-Supervised Learning of Graph Representations

Résumé

Contrastive learning has become a successful approach for learning powerful text and image representations in a self-supervised manner. Contrastive frameworks learn to distinguish between representations coming from augmentations of the same data point (positive pairs) and those of other (negative) examples. Recent studies aim at extending methods from contrastive learning to graph data. In this work, we propose a general framework for learning node representations in a self supervised manner called Graph Constrastive Learning (GraphCL). It learns node embeddings by maximizing the similarity between the nodes representations of two randomly perturbed versions of the same graph. We use graph neural networks to produce two representations of the same node and leverage a contrastive learning loss to maximize agreement between them. We investigate different standard and new negative sampling strategies as well as a comparison without negative sampling approach. We demonstrate that our approach significantly outperforms the state-of-the-art in unsupervised learning on a number of node classification benchmarks in both transductive and inductive learning setups.
Fichier principal
Vignette du fichier
sigpro2021_R2.pdf (640.23 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03575619 , version 1 (15-02-2022)

Identifiants

  • HAL Id : hal-03575619 , version 1

Citer

Hakim Hafidi, Mounir Ghogho, Philippe Ciblat, Ananthram Swami. Negative Sampling Strategies for Contrastive Self-Supervised Learning of Graph Representations. Signal Processing, 2022, 190 (4). ⟨hal-03575619⟩
151 Consultations
305 Téléchargements

Partager

Gmail Facebook X LinkedIn More