Approximate and Weighted Data Reconstruction Attack in Federated Learning

Wang Z, Song Y, Zuazua Iriondo E (2024)

Publication Language: English

Publication Status: Submitted

Publication Type: Unpublished / Preprint

Future Publication Type: Journal article

Publication year: 2024

URI: https://arxiv.org/abs/2308.06822

Abstract

Federated Learning (FL) is a distributed learning paradigm that enables multiple clients to collaborate on building a machine learning model without sharing their private data. Although FL is considered privacy-preserved by design, recent data reconstruction attacks demonstrate that an attacker can recover clients' training data based on the parameters shared in FL. However, most existing methods fail to attack the most widely used horizontal Federated Averaging (FedAvg) scenario, where clients share model parameters after multiple local training steps. To tackle this issue, we propose an interpolation-based approximation method, which makes attacking FedAvg scenarios feasible by generating the intermediate model updates of the clients' local training processes. Then, we design a layer-wise weighted loss function to improve the data quality of reconstruction. We assign different weights to model updates in different layers concerning the neural network structure, with the weights tuned by Bayesian optimization. Finally, experimental results validate the superiority of our proposed approximate and weighted attack (AWA) method over the other state-of-the-art methods, as demonstrated by the substantial improvement in different evaluation metrics for image data reconstructions.

Authors with CRIS profile

Ziqi Wang Lehrstuhl für Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt-Professur) Yongcun Song Lehrstuhl für Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt-Professur) Enrique Zuazua Iriondo Lehrstuhl für Dynamics, Control, Machine Learning and Numerics (Alexander von Humboldt-Professur)

How to cite

APA:

Wang, Z., Song, Y., & Zuazua Iriondo, E. (2024). Approximate and Weighted Data Reconstruction Attack in Federated Learning. (Unpublished, Submitted).

MLA:

Wang, Ziqi, Yongcun Song, and Enrique Zuazua Iriondo. Approximate and Weighted Data Reconstruction Attack in Federated Learning. Unpublished, Submitted. 2024.

BibTeX: Download