Title | ||
---|---|---|
DeepTraLog: Trace-Log Combined Microservice Anomaly Detection through Graph-based Deep Learning |
Abstract | ||
---|---|---|
A microservice system in industry is usually a large-scale dis-tributed system consisting of dozens to thousands of services run-ning in different machines. An anomaly of the system often can be reflected in traces and logs, which record inter-service interactions and intra-service behaviors respectively. Existing trace anomaly detection approaches treat a trace as a sequence of service invocations. They ignore the complex structure of a trace brought by its invocation hierarchy and parallel/asynchronous invocations. On the other hand, existing log anomaly detection approaches treat a log as a sequence of events and cannot handle microservice logs that are distributed in a large number of services with complex interactions. In this paper, we propose DeepTraLog, a deep learning based microservice anomaly detection approach. DeepTraLog uses a unified graph representation to describe the complex structure of a trace together with log events embedded in the structure. Based on the graph representation, DeepTraLog trains a GGNNs based deep SVDD model by combing traces and logs and detects anom-alies in new traces and the corresponding logs. Evaluation on a microservice benchmark shows that DeepTraLog achieves a high precision (0.93) and recall (0.97), outperforming state-of-the-art trace/log anomaly detection approaches with an average increase of 0.37 in F1-score. It also validates the efficiency of DeepTraLog, the contribution of the unified graph representation, and the impact of the configurations of some key parameters. |
Year | DOI | Venue |
---|---|---|
2022 | 10.1145/3510003.3510180 | 2022 IEEE/ACM 44th International Conference on Software Engineering (ICSE) |
Keywords | DocType | ISSN |
Microservice,Anomaly Detection,Log Analysis,Tracing,Graph Neural Network,Deep Learning | Conference | 0270-5257 |
ISBN | Citations | PageRank |
978-1-6654-9589-9 | 0 | 0.34 |
References | Authors | |
13 | 8 |
Name | Order | Citations | PageRank |
---|---|---|---|
Chenxi Zhang | 1 | 0 | 0.34 |
Xin Peng | 2 | 599 | 67.59 |
ChaoFeng Sha | 3 | 129 | 19.03 |
Ke Zhang | 4 | 540 | 32.46 |
Zhenqing Fu | 5 | 0 | 0.34 |
Xiya Wu | 6 | 0 | 0.34 |
Qingwei Lin | 7 | 285 | 27.76 |
Dongmei Zhang | 8 | 1439 | 132.94 |