Title
A hybrid model-free approach for the near-optimal intrusion response control of non-stationary systems
Abstract
Given the always increasing size of computer systems, manually protecting them in case of attacks is unfeasible and error-prone. For this reason, until now, several model-based Intrusion Response Systems (IRSs) have been proposed with the purpose of limiting the amount of work of the system administrators. However, since the most advanced IRSs adopt a stateful approach, they are subject to what Richard Bellman defined as the curse of dimensionality. Furthermore, modern computer systems are non-stationary, that is, they are subject to frequent changes in their configuration and in their software base, which in turn could make a model-based approach ineffective due to deviations in system behavior with respect to the model. In this paper we propose, to the best of our knowledge, the first approach based on deep reinforcement learning for the implementation of a hybrid model-free IRS. Experimental results show that the proposed IRS is able to deal with non-stationary systems, while reducing the time needed for the computation of the defense policies by orders of magnitude with respect to model-based approaches, and being still able to provide near-optimal rewards.
Year
DOI
Venue
2020
10.1016/j.future.2020.03.018
Future Generation Computer Systems
Keywords
DocType
Volume
Intrusion response,Self-adaptation,Self-protection,Reinforcement Learning
Journal
109
ISSN
Citations 
PageRank 
0167-739X
1
0.38
References 
Authors
0
4
Name
Order
Citations
PageRank
Stefano Iannucci11339.26
Valeria Cardellini21514106.12
Ovidiu Daniel Barba310.38
Ioana Banicescu439539.18