Title
A New Approach to Design Symmetry Invariant Neural Networks
Abstract
We investigate a new method to design G-invariant neural networks that approximate functions invariant to the action of a given permutation subgroup G of the symmetric group on input data. The key element of the new network architecture is a G-invariant transformation module, which produces a G-invariant latent representation of the input data. This latent representation is then processed with a multi-layer perceptron in the network. We prove the universality of the new architecture, discuss its properties and highlight its computational and memory efficiency. Theoretical considerations are supported by numerical experiments involving different network configurations, which demonstrate the efficiency and strong generalization properties of the new approach to design symmetry invariant neural networks, in comparison to other G-invariant neural architectures.
Year
DOI
Venue
2021
10.1109/IJCNN52387.2021.9533541
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN)
Keywords
DocType
ISSN
Machine learning, neural networks, group invariance, G-invariance, geometric deep learning
Conference
2161-4393
Citations 
PageRank 
References 
0
0.34
0
Authors
3
Name
Order
Citations
PageRank
Piotr Kicki182.20
Piotr Skrzypczynski214825.07
Mete Ozay310614.50