Toward an Adaptive Skip-Gram Model for Network Representation Learning

I. Chung Hsieh, Cheng Te Li

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

The random walk process on network data is a widely-used approach for network representation learning. However, we argue that the sampling of node sequences and the subsampling for the Skip-gram's contexts have two drawbacks. One is less possible to precisely find the most correlated context nodes for every central node with only uniform graph search. The other is not easily controlled due to the expensive cost of hyperparameter tuning. Such two drawbacks lead to higher training cost and lower accuracy due to abundant and irrelevant samples. To solve these problems, we compute the adaptive probability of random walk based on Personalized PageRank (PPR), and propose an Adaptive SKip-gram (ASK) model without using complicated sampling process and negative sampling. We utilize k-most important neighbors for positive samples selection, and attach their corresponding PPR probability into the objective function. Based on benchmark datasets with three citation networks and three social networks, we demonstrate the improvement of our ASK model for network representation learning in tasks of link prediction, node classification, and embedding visualization. The results achieve more effective performance and efficient learning time.

Original languageEnglish
Pages (from-to)37506-37514
Number of pages9
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - 2022

All Science Journal Classification (ASJC) codes

  • General Computer Science
  • General Materials Science
  • General Engineering

Fingerprint

Dive into the research topics of 'Toward an Adaptive Skip-Gram Model for Network Representation Learning'. Together they form a unique fingerprint.

Cite this