Title
Genetic-GNN: Evolutionary architecture search for Graph Neural Networks
Abstract
Neural architecture search (NAS) has seen significant attention throughout the computational intelligence research community and has pushed forward the state-of-the-art of many neural models to address grid-like data such as texts and images. However, little work has been done on Graph Neural Network (GNN) models dedicated to unstructured network data. Given the huge number of choices and combinations of components such as aggregators and activation functions, determining the suitable GNN model for a specific problem normally necessitates tremendous expert knowledge and laborious trials. In addition, the moderate change of hyperparameters such as the learning rate and dropout rate would dramatically impact the learning capacity of a GNN model. In this paper, we propose a novel framework through the evolution of individual models in a large GNN architecture searching space. Instead of simply optimizing the model structures, an alternating evolution process is performed between GNN model structures and hyperparameters to dynamically approach the optimal fit of each other. Experiments and validations demonstrate that evolutionary NAS is capable of matching existing state-of-the-art reinforcement learning methods for both transductive and inductive graph representation learning and node classification.
Year
DOI
Venue
2022
10.1016/j.knosys.2022.108752
Knowledge-Based Systems
Keywords
DocType
Volume
Graph Neural Networks,Neural Architecture Search,Evolutionary computation,Genetic model,Graph representation learning
Journal
247
ISSN
Citations 
PageRank 
0950-7051
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Min Shi1198.50
Yufei Tang220322.83
Xingquan Zhu33086181.95
Y. Huang453.41
David Wilson500.34
Yuan Zhuang600.34
Jianxun Liu764067.12