Author: Huang, Yangsibo; Li, Xiaoxiao; Li, Kai
Title: EMA: Auditing Data Removal from Trained Models Cord-id: b5ebvyac Document date: 2021_9_8
ID: b5ebvyac
Snippet: Data auditing is a process to verify whether certain data have been removed from a trained model. A recently proposed method (Liu et al. 20) uses Kolmogorov-Smirnov (KS) distance for such data auditing. However, it fails under certain practical conditions. In this paper, we propose a new method called Ensembled Membership Auditing (EMA) for auditing data removal to overcome these limitations. We compare both methods using benchmark datasets (MNIST and SVHN) and Chest X-ray datasets with multi-la
Document: Data auditing is a process to verify whether certain data have been removed from a trained model. A recently proposed method (Liu et al. 20) uses Kolmogorov-Smirnov (KS) distance for such data auditing. However, it fails under certain practical conditions. In this paper, we propose a new method called Ensembled Membership Auditing (EMA) for auditing data removal to overcome these limitations. We compare both methods using benchmark datasets (MNIST and SVHN) and Chest X-ray datasets with multi-layer perceptrons (MLP) and convolutional neural networks (CNN). Our experiments show that EMA is robust under various conditions, including the failure cases of the previously proposed method. Our code is available at: https://github.com/Hazelsuko07/EMA.
Search related documents:
Co phrase search for related documents- low quality and machine learn: 1
- low quality and machine learning: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
- low quality and machine learning model: 1
Co phrase search for related documents, hyperlinks ordered by date