TY - GEN
T1 - When Contrastive Learning Meets Graph Unlearning
T2 - 2023 IEEE International Conference on Big Data, BigData 2023
AU - Yang, Tzu Hsuan
AU - Li, Cheng Te
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - In today's data-rich era, large models continuously consume vast troves of personal data, raising pertinent questions about user consent and its implications in training machine learning frameworks. With mounting calls for enhanced user privacy, the 'right to be forgotten' is gaining traction in contemporary research. Parallelly, the ubiquity of graph neural networks underscores its ever-growing imprint on artificial intelligence communities, resonating in almost every facet of various applications. This study delves into enhancing the effectiveness of graph unlearning through the incorporation of graph contrastive learning. To adeptly erase edge information without compromising the performance of the subsequent link prediction task. We present a novel graph unlearning framework, Graph Contrastive Unlearning (GCU). Infusing the principles of contrastive learning into conventional graph unlearning paradigms, the GCU stands out, ensuring the absolute erasure of deleted edge data. The genius of graph contrastive unlearning lies in its dual capability: facilitating the model in discerning the deleted edges from their original counterparts while seamlessly aligning the neighbors of these edges with the original graph's node features. Crafted meticulously, the GCU extirpates the influence of the removed elements from model parameters and neighboring representations. Yet, it ensures the sanctity and retention of the residual model knowledge post-deletion. Empirical tests underscore the GCU's promising edge unlearning ability, revealing marked improvements in link prediction across diverse graph datasets. This not only fortifies user privacy but also streamlines the unlearning process, eliminating the cumbersome need for full model retraining even in scenarios of mass edge deletions.
AB - In today's data-rich era, large models continuously consume vast troves of personal data, raising pertinent questions about user consent and its implications in training machine learning frameworks. With mounting calls for enhanced user privacy, the 'right to be forgotten' is gaining traction in contemporary research. Parallelly, the ubiquity of graph neural networks underscores its ever-growing imprint on artificial intelligence communities, resonating in almost every facet of various applications. This study delves into enhancing the effectiveness of graph unlearning through the incorporation of graph contrastive learning. To adeptly erase edge information without compromising the performance of the subsequent link prediction task. We present a novel graph unlearning framework, Graph Contrastive Unlearning (GCU). Infusing the principles of contrastive learning into conventional graph unlearning paradigms, the GCU stands out, ensuring the absolute erasure of deleted edge data. The genius of graph contrastive unlearning lies in its dual capability: facilitating the model in discerning the deleted edges from their original counterparts while seamlessly aligning the neighbors of these edges with the original graph's node features. Crafted meticulously, the GCU extirpates the influence of the removed elements from model parameters and neighboring representations. Yet, it ensures the sanctity and retention of the residual model knowledge post-deletion. Empirical tests underscore the GCU's promising edge unlearning ability, revealing marked improvements in link prediction across diverse graph datasets. This not only fortifies user privacy but also streamlines the unlearning process, eliminating the cumbersome need for full model retraining even in scenarios of mass edge deletions.
UR - http://www.scopus.com/inward/record.url?scp=85184980704&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85184980704&partnerID=8YFLogxK
U2 - 10.1109/BigData59044.2023.10386624
DO - 10.1109/BigData59044.2023.10386624
M3 - Conference contribution
AN - SCOPUS:85184980704
T3 - Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023
SP - 6025
EP - 6032
BT - Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023
A2 - He, Jingrui
A2 - Palpanas, Themis
A2 - Hu, Xiaohua
A2 - Cuzzocrea, Alfredo
A2 - Dou, Dejing
A2 - Slezak, Dominik
A2 - Wang, Wei
A2 - Gruca, Aleksandra
A2 - Lin, Jerry Chun-Wei
A2 - Agrawal, Rakesh
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 December 2023 through 18 December 2023
ER -