Title
A Real-World Distributed Infrastructure for Processing Financial Data at Scale
Abstract
Financial markets are event- and data-driven to an extremely high degree. For making decisions and triggering actions stakeholders require notifications about significant events and reliable background information that meet their individual requirements in terms of timeliness, accuracy, and completeness. As one of Europe's leading providers of financial data and regulatory solutions vwd: processes an average of 18 billion event notifications from 500+ data sources for 30 million symbols per day. Our large-scale distributed event-based systems handle daily peak rates of 1+ million event notifications per second and additional load generated by singular pivotal events with global impact. In this poster we give practical insights into our IT systems. We outline the infrastructure we operate and the event-driven architecture we apply at vwd. In particular we showcase the (geo)distributed publish/subscribe broker network we operate across locations and countries to provide market data to our customers with varying quality of information (QoI) properties.
Year
DOI
Venue
2019
10.1145/3328905.3332513
Proceedings of the 13th ACM International Conference on Distributed and Event-based Systems
Keywords
Field
DocType
Event-processing, big data, broker network, financial data, infrastructure, publish/subscribe, quality of information, stream-processing
Computer science,Distributed computing
Conference
ISBN
Citations 
PageRank 
978-1-4503-6794-3
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Sebastian Frischbier100.68
Mario Paic200.34
Alexander Echler300.68
Christian Roth400.34