Title
F1: the fault-tolerant distributed RDBMS supporting google's ad business
Abstract
Many of the services that are critical to Google's ad business have historically been backed by MySQL. We have recently migrated several of these services to F1, a new RDBMS developed at Google. F1 implements rich relational database features, including a strictly enforced schema, a powerful parallel SQL query engine, general transactions, change tracking and notification, and indexing, and is built on top of a highly distributed storage system that scales on standard hardware in Google data centers. The store is dynamically sharded, supports transactionally-consistent replication across data centers, and is able to handle data center outages without data loss. The strong consistency properties of F1 and its storage system come at the cost of higher write latencies compared to MySQL. Having successfully migrated a rich customer-facing application suite at the heart of Google's ad business to F1, with no downtime, we will describe how we restructured schema and applications to largely hide this increased latency from external users. The distributed nature of F1 also allows it to scale easily and to support significantly higher throughput for batch workloads than a traditional RDBMS. With F1, we have built a novel hybrid system that combines the scalability, fault tolerance, transparent sharding, and cost benefits so far available only in "NoSQL" systems with the usability, familiarity, and transactional guarantees expected from an RDBMS.
Year
DOI
Venue
2012
10.1145/2213836.2213954
SIGMOD Conference
Keywords
Field
DocType
cost benefit,new rdbms,data center outages,google data center,data center,traditional rdbms,storage system,data loss,ad business,novel hybrid system,relational database,sql,strong consistency,fault tolerant,hybrid system,scalability
SQL,Data mining,Relational database,Computer science,Distributed data store,NoSQL,Fault tolerance,Relational database management system,Data center,Database,Scalability
Conference
Citations 
PageRank 
References 
13
0.94
0
Authors
12
Name
Order
Citations
PageRank
Jeff Shute11097.46
Mircea Oancea2652.88
Stephan Ellner3724.08
Ben Handy4663.58
Eric Rollins511410.64
Bart Samwel6896.72
Radek Vingralek7918144.54
Chad Whipkey8663.24
Xin Chen9130.94
Beat Jegerlehner10130.94
Kyle Littlefield11954.83
Phoenix Tong12130.94