Title
SoK: Security and Privacy in Machine Learning
Abstract
Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive-new systems and models are being deployed in every domain imaginable, leading to widespread deployment of software based inference and decision making. There is growing recognition that ML exposes new vulnerabilities in software systems, yet the technical community's understanding of the nature and extent of these vulnerabilities remains limited. We systematize findings on ML security and privacy, focusing on attacks identified on these systems and defenses crafted to date.We articulate a comprehensive threat model for ML, and categorize attacks and defenses within an adversarial framework. Key insights resulting from works both in the ML and security communities are identified and the effectiveness of approaches are related to structural elements of ML algorithms and the data used to train them. In particular, it is apparent that constructing a theoretical understanding of the sensitivity of modern ML algorithms to the data they analyze, à la PAC theory, will foster a science of security and privacy in ML.
Year
DOI
Venue
2016
10.1109/EuroSP.2018.00035
2018 IEEE European Symposium on Security and Privacy (EuroS&P)
Keywords
Field
DocType
security,privacy,machine learning
Psychological resilience,Software deployment,Inference,Computer security,Threat model,Computer science,Software system,Autonomous system (Internet),Artificial intelligence,Machine learning,Adversarial system,Vulnerability
Journal
Volume
ISBN
Citations 
abs/1611.03814
978-1-5386-4229-0
18
PageRank 
References 
Authors
0.61
0
4
Name
Order
Citations
PageRank
Nicolas Papernot1193287.62
P. McDaniel27174494.57
Arunesh Sinha315021.67
Michael P. Wellman44715757.80