Paper Info
Title
Overload Control for Scaling WeChat Microservices.
Abstract
Effective overload control for large-scale online service system is crucial for protecting the system backend from overload. Conventionally the design of overload control is ad-hoc for individual service. However, service-specific overload control could be detrimental to the overall system due to intricate service dependencies or flawed implementation of service. Service developers usually have difficulty to accurately estimate the dynamics of actual workload during the development of service. Therefore, it is essential to decouple the overload control from service logic. In this paper, we propose DAGOR, an overload control scheme designed for the account-oriented microservice architecture. DAGOR is service agnostic and system-centric. It manages overload at the microservice granule such that each microservice monitors its load status in real time and triggers load shedding in a collaborative manner among its relevant services when overload is detected. DAGOR has been used in the WeChat backend for five years. Experimental results show that DAGOR can benefit high success rate of service even when the system is experiencing overload, while ensuring fairness in the overload control.
Year
DOI
Venue
2018
10.1145/3267809.3267823
SoCC '18: ACM Symposium on Cloud Computing Carlsbad CA USA October, 2018
Keywords
DocType
ISSN
overload control, service admission control, microservice architecture, WeChat
Conference
ACM SoCC (2018) 149-161
ISBN
Citations 
PageRank 
978-1-4503-6011-1
9
0.52
References 
Authors
25
9
Name
Order
Citations
PageRank
Hao Zhou190.52
Mi Chen292.55
Qian Lin39611.17
Yong Wang427592.19
Xiaobin She590.52
SiFan Liu6144.04
Rui Gu7536.14
Beng Chin Ooi878731076.70
Junfeng Yang9122669.60