Security News > 2022 > April > Undetectable Backdoors in Machine-Learning Models

Undetectable Backdoors in Machine-Learning Models
2022-04-19 20:12

Abstract: Given the computational cost and technical expertise required to train machine learning models, users may delegate the task of learning to a service provider.

We show how a malicious learner can plant an undetectable backdoor into a classifier.

We demonstrate two frameworks for planting undetectable backdoors, with incomparable guarantees.

Second, we demonstrate how to insert undetectable backdoors in models trained using the Random Fourier Features learning paradigm or in Random ReLU networks.

Our construction of undetectable backdoors also sheds light on the related issue of robustness to adversarial examples.

In particular, our construction can produce a classifier that is indistinguishable from an "Adversarially robust" classifier, but where every input has an adversarial example! In summary, the existence of undetectable backdoors represent a significant theoretical roadblock to certifying adversarial robustness.


News URL

https://www.schneier.com/blog/archives/2022/04/undetectable-backdoors-in-machine-learning-models.html