Title
Optimization Approaches for Nonlinear State Space Models
Abstract
The Local Model State Space Network (LMSSN) is a recently developed black box algorithm in nonlinear system identification. It has proven to be an appropriate tool on benchmark problems as well as for real-world processes. A severe shortcoming though is the long computation time that is necessary for model training. Therefore, a different optimization strategy, the adaptive moment estimation (ADAM) method with mini batches is used for the LMSSN and compared to the current Quasi-Newton (QN) optimization method. It is shown on a numerical Hammerstein example and on a well known Wiener-Hammerstein benchmark that the use of ADAM and mini batches does not limit the performance of the LMSSN algorithm and speeds up the nonlinear optimization per investigated split by more than 30 times. The price to be paid, however, is higher parameter variance (less interpretability) and more tedious hyperparameter tuning.
Year
DOI
Venue
2021
10.1109/LCSYS.2020.3037682
IEEE Control Systems Letters
Keywords
DocType
Volume
Machine learning,neural networks,nonlinear systems identification,optimization algorithms
Journal
5
Issue
ISSN
Citations 
4
2475-1456
0
PageRank 
References 
Authors
0.34
0
2
Name
Order
Citations
PageRank
Max Schussler100.34
Oliver Nelles29917.27