Title
Optimization Of Molecules Via Deep Reinforcement Learning
Abstract
We present a framework, which we call Molecule Deep Q-Networks (MolDQN), for molecule optimization by combining domain knowledge of chemistry and state-of-the-art reinforcement learning techniques (double Q-learning and randomized value functions). We directly define modifications on molecules, thereby ensuring 100% chemical validity. Further, we operate without pre-training on any dataset to avoid possible bias from the choice of that set. MolDQN achieves comparable or better performance against several other recently published algorithms for benchmark molecular optimization tasks. However, we also argue that many of these tasks are not representative of real optimization problems in drug discovery. Inspired by problems faced during medicinal chemistry lead optimization, we extend our model with multi-objective reinforcement learning, which maximizes drug-likeness while maintaining similarity to the original molecule. We further show the path through chemical space to achieve optimization for a molecule to understand how the model works.
Year
DOI
Venue
2018
10.1038/s41598-019-47148-x
SCIENTIFIC REPORTS
Field
DocType
Volume
Domain knowledge,Molecule,Artificial intelligence,Chemical space,Machine learning,Mathematics,Reinforcement learning
Journal
9
Issue
ISSN
Citations 
1
2045-2322
11
PageRank 
References 
Authors
0.62
18
5
Name
Order
Citations
PageRank
Zhenpeng Zhou1110.62
Steven M. Kearnes21126.72
Li Li3110.62
Richard N. Zare4131.73
Patrick Riley51005.88