Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation

4 September 2024

Shiming Ge

Bochao Liu

Pengju Wang

Yong Li

Dan Zeng

FedML

ArXiv (abs)PDF HTML

Papers citing "Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation"

49 / 49 papers shown

Title
Streamlined Federated Unlearning: Unite as One to Be Highly Efficient Lei Zhou Youwen Zhu Qiao Xue Ji Zhang Pengfei Zhang MU 184 1 0 28 Nov 2024
Efficient Low-Resolution Face Recognition via Bridge Distillation Shiming Ge Shengwei Zhao Chenyu Li Yu Zhang Jia Li CVBM 88 59 0 18 Sep 2024
SEDML: Securely and Efficiently Harnessing Distributed Knowledge in Machine Learning Yansong Gao Qun Li Yifeng Zheng Guohong Wang Jiannan Wei Mang Su 64 3 0 26 Oct 2021
Double Similarity Distillation for Semantic Image Segmentation Yingchao Feng Xian Sun Wenhui Diao Jihao Li Xin Gao 40 62 0 19 Jul 2021
Large Scale Private Learning via Low-rank Reparametrization Da Yu Huishuai Zhang Wei Chen Jian Yin Tie-Yan Liu 58 104 0 17 Jun 2021
DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregation Wei Ping Fan Wu Yunhui Long Luka Rimanic Ce Zhang Yue Liu FedML 98 64 0 20 Mar 2021
Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learning Da Yu Huishuai Zhang Wei Chen Tie-Yan Liu FedML SILM 132 115 0 25 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 667 41,369 0 22 Oct 2020
Chasing Your Long Tails: Differentially Private Prediction in Health Care Settings Vinith Suriyakumar Nicolas Papernot Anna Goldenberg Marzyeh Ghassemi OOD 72 67 0 13 Oct 2020
Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition Yang Liu Keze Wang Guanbin Li Liang Lin 81 89 0 01 Sep 2020
Stochastic Adaptive Line Search for Differentially Private Optimization Chen Chen Jaewoo Lee 53 14 0 18 Aug 2020
Tempered Sigmoid Activations for Deep Learning with Differential Privacy Nicolas Papernot Abhradeep Thakurta Shuang Song Steve Chien Ulfar Erlingsson AAML 193 179 0 28 Jul 2020
Improving Deep Learning with Differential Privacy using Gradient Encoding and Denoising Milad Nasr Reza Shokri Amir Houmansadr 44 42 0 22 Jul 2020
GS-WGAN: A Gradient-Sanitized Approach for Learning Differentially Private Generators Dingfan Chen Tribhuvanesh Orekondy Mario Fritz SyDa 56 185 0 15 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 110 2,976 0 09 Jun 2020
DP-MERF: Differentially Private Mean Embeddings with Random Features for Practical Privacy-Preserving Data Generation Frederik Harder Kamil Adamczewski Mijung Park SyDa 127 101 0 26 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 461 10,591 0 17 Feb 2020
DP-CGAN: Differentially Private Synthetic Data and Label Generation Reihaneh Torkzadehmahani Peter Kairouz B. Paten SyDa 69 237 0 27 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 259 6,276 0 10 Dec 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 151 1,052 0 23 Oct 2019
G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators Yunhui Long Wei Ping Zhuolin Yang B. Kailkhura Aston Zhang C.A. Gunter Yue Liu 110 74 0 21 Jun 2019
Relational Knowledge Distillation Wonpyo Park Dongju Kim Yan Lu Minsu Cho 68 1,420 0 10 Apr 2019
Rain Oér Me: Synthesizing real rain to derain with data distillation Huangxing Lin Yanlong Li Xinghao Ding Xueyang Fu Yue Huang John Paisley DD 45 25 0 09 Apr 2019
Differentially Private Model Publishing for Deep Learning Lei Yu Ling Liu C. Pu Mehmet Emre Gursoy Stacey Truex FedML 71 265 0 03 Apr 2019
Data-Free Learning of Student Networks Hanting Chen Yunhe Wang Chang Xu Zhaohui Yang Chuanjian Liu Boxin Shi Chunjing Xu Chao Xu Qi Tian FedML 53 372 0 02 Apr 2019
MEAL: Multi-Model Ensemble via Adversarial Learning Zhiqiang Shen Zhankui He Xiangyang Xue AAML FedML 65 146 0 06 Dec 2018
Tangent-Normal Adversarial Regularization for Semi-supervised Learning Ting Yu Jingfeng Wu Jinwen Ma Zhanxing Zhu 48 35 0 18 Aug 2018
Scalable Private Learning with PATE Nicolas Papernot Shuang Song Ilya Mironov A. Raghunathan Kunal Talwar Ulfar Erlingsson 109 618 0 24 Feb 2018
Differentially Private Generative Adversarial Network Liyang Xie Kaixiang Lin Shu Wang Fei Wang Jiayu Zhou SyDa 90 501 0 19 Feb 2018
Differentially Private Releasing via Deep Generative Model (Technical Report) Xinyang Zhang S. Ji Ting Wang SyDa 43 71 0 05 Jan 2018
Global versus Localized Generative Adversarial Nets Guo-Jun Qi Liheng Zhang Hao Hu Marzieh Edraki Jingdong Wang Xian-Sheng Hua GAN 56 80 0 16 Nov 2017
Smooth Neighbors on Teacher Graphs for Semi-supervised Learning Yucen Luo Jun Zhu Mengxi Li Yong Ren Bo Zhang 63 242 0 01 Nov 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 283 8,904 0 25 Aug 2017
Good Semi-supervised Learning that Requires a Bad GAN Zihang Dai Zhilin Yang Fan Yang William W. Cohen Ruslan Salakhutdinov GAN 67 483 0 27 May 2017
Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning Takeru Miyato S. Maeda Masanori Koyama S. Ishii GAN 148 2,738 0 13 Apr 2017
Improved Training of Wasserstein GANs Ishaan Gulrajani Faruk Ahmed Martín Arjovsky Vincent Dumoulin Aaron Courville GAN 227 9,558 0 31 Mar 2017
Conditional Image Synthesis With Auxiliary Classifier GANs Augustus Odena C. Olah Jonathon Shlens GAN 436 3,215 0 30 Oct 2016
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data Nicolas Papernot Martín Abadi Ulfar Erlingsson Ian Goodfellow Kunal Talwar 77 1,019 0 18 Oct 2016
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 216 6,155 0 01 Jul 2016
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets Xi Chen Yan Duan Rein Houthooft John Schulman Ilya Sutskever Pieter Abbeel GAN 159 4,237 0 12 Jun 2016
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 486 9,062 0 10 Jun 2016
Semi-Supervised Learning with Generative Adversarial Networks Augustus Odena GAN 70 683 0 05 Jun 2016
Adversarially Learned Inference Vincent Dumoulin Ishmael Belghazi Ben Poole Olivier Mastropietro Alex Lamb Martín Arjovsky Aaron Courville GAN 81 1,314 0 02 Jun 2016
Learning Privately from Multiparty Data Jihun Hamm Yingjun Cao M. Belkin FedML 51 165 0 10 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,322 0 10 Dec 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 362 19,723 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 311 3,893 0 19 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,479 0 04 Sep 2014
RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response Ulfar Erlingsson Vasyl Pihur Aleksandra Korolova 96 1,995 0 25 Jul 2014