Breaking the Communication-Privacy-Accuracy Tradeoff with f-Differential Privacy

Richeng Jin, Zhonggen Su, Caijun Zhong, Zhaoyang Zhang, Tony Q.S. Quek, Huaiyu Dai

研究成果: Conference article同行評審


We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce information loss into local data while improving communication efficiency, and it remains an open problem whether such discrete-valued mechanisms provide any privacy protection. In this paper, we study the local differential privacy guarantees of discrete-valued mechanisms with finite output space through the lens of f-differential privacy (DP). More specifically, we advance the existing literature by deriving tight f-DP guarantees for a variety of discrete-valued mechanisms, including the binomial noise and the binomial mechanisms that are proposed for privacy preservation, and the sign-based methods that are proposed for data compression, in closed-form expressions. We further investigate the amplification in privacy by sparsification and propose a ternary stochastic compressor. By leveraging compression for privacy amplification, we improve the existing methods by removing the dependency of accuracy (in terms of mean square error) on communication cost in the popular use case of distributed mean estimation, therefore breaking the three-way tradeoff between privacy, communication, and accuracy.

期刊Advances in Neural Information Processing Systems
出版狀態Published - 2023
事件37th Conference on Neural Information Processing Systems, NeurIPS 2023 - New Orleans, United States
持續時間: 2023 12月 102023 12月 16

All Science Journal Classification (ASJC) codes

  • 電腦網路與通信
  • 資訊系統
  • 訊號處理


深入研究「Breaking the Communication-Privacy-Accuracy Tradeoff with f-Differential Privacy」主題。共同形成了獨特的指紋。