Title
Domain Adaptive Remaining Useful Life Prediction With Transformer
Abstract
Prognostic health management (PHM) has become a crucial part in building highly automated systems, whose primary task is to precisely predict the remaining useful life (RUL) of the system. Recently, deep models including convolutional neural network (CNN) and long short-term memory (LSTM) have been widely used to predict RUL. However, these models generally require sufficient labeled training data to guarantee fair performance, whereas a limited amount of labeled data overwhelmed by the abundance of unlabeled ones is the normality in industry, and the cost of full data annotation can be unaffordable. To attack this challenge, domain adaptation seeks to transfer the knowledge from a well-labeled source domain to another unlabeled target domain by mitigating their domain gap. In this article, we leverage domain adaptation for RUL prediction and propose a novel method by aligning distributions at both the feature level and the semantic level. The proposed method facilitates a large improvement of model performance and faster convergence. Besides, we propose to use the transformer as the backbone, which can capture long-term dependency more efficiently than the widely used recurrent neural network (RNN), and is thus critical for boosting the robustness of the model. We test our model on the commercial modular aero-propulsion system simulation (CMAPSS) dataset and its newly published variant new CMAPSS (N-CMAPSS) provided by National Aeronautics and Space Administration (NASA), achieving state-of-the-art results on both source-only RUL prediction and domain adaptive RUL prediction tasks.
Year
DOI
Venue
2022
10.1109/TIM.2022.3200667
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
Keywords
DocType
Volume
Feature extraction, Task analysis, Predictive models, Transformers, Semantics, Adaptation models, Data models, Domain adaptation, remaining useful life (RUL) prediction, transformer
Journal
71
ISSN
Citations 
PageRank 
0018-9456
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Xinyao Li100.34
Jingjing Li259744.26
Lin Zuo300.68
Lei Zhu485451.69
Heng Tao Shen500.34