New article accepted at Privacy in Machine Learning (NeurIPS 2021 Workshop)
(02.12.2012) The article "Architecture Matters: Investigating the Influence of Differential Privacy on Neural Network Design" by Felix Morsbach, Tobias Dehling und Ali Sunyaev has been accepted at Privacy in Machine Learning (NeurIPS 2021 Workshop) and will be presented by Felix Morsbach on 14.12.2021.
Abstract: One barrier to more widespread adoption of differentially private neural networks is the entailed accuracy loss. To address this issue, the relationship between neural network architectures and model accuracy under differential privacy constraints needs to be better understood. As a first step, we test whether extant knowledge on architecture design also holds in the differentially private setting. Our findings show that it does not; architectures that perform well without differential privacy, do not necessarily do so with differential privacy. Consequently, extant knowledge on neural network architecture design cannot be seamlessly translated into the differential privacy context. Future research is required to better understand the relationship between neural network architectures and model accuracy to enable better architecture design choices under differential privacy constraints.