Name
Abstract | ||
|---|---|---|
AbstractF1 Query is a stand-alone, federated query processing platform that executes SQL queries against data stored in different file-based formats as well as different storage systems at Google (e.g., Bigtable, Spanner, Google Spreadsheets, etc.). F1 Query eliminates the need to maintain the traditional distinction between different types of data processing workloads by simultaneously supporting: (i) OLTP-style point queries that affect only a few records; (ii) low-latency OLAP querying of large amounts of data; and (iii) large ETL pipelines. F1 Query has also significantly reduced the need for developing hard-coded data processing pipelines by enabling declarative queries integrated with custom business logic. F1 Query satisfies key requirements that are highly desirable within Google: (i) it provides a unified view over data that is fragmented and distributed over multiple data sources; (ii) it leverages datacenter resources for performant query processing with high throughput and low latency; (iii) it provides high scalability for large data sizes by increasing computational parallelism; and (iv) it is extensible and uses innovative approaches to integrate complex business logic in declarative query processing. This paper presents the end-to-end design of F1 Query. Evolved out of F1, the distributed database originally built to manage Google's advertising data, F1 Query has been in production for multiple years at Google and serves the querying needs of a large number of users and systems. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.14778/3229863.3229871 | Hosted Content |
Field | DocType | Volume |
SQL,Data processing,Computer science,Business logic,Data type,Distributed database,Online analytical processing,Spanner,Database,Scalability | Journal | 11 |
Issue | ISSN | Citations |
12 | 2150-8097 | 0 |
PageRank | References | Authors |
0.34 | 0 | 36 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Bart Samwel | 1 | 89 | 6.72 |
| John Cieslewicz | 2 | 335 | 19.95 |
| Ben Handy | 3 | 0 | 0.34 |
| Jason Govig | 4 | 33 | 2.43 |
| Petros Venetis | 5 | 0 | 0.34 |
| Chanjun Yang | 6 | 0 | 0.68 |
| Keith Peters | 7 | 0 | 0.68 |
| Jeff Shute | 8 | 109 | 7.46 |
| Daniel Tenedorio | 9 | 0 | 0.68 |
| Himani Apte | 10 | 53 | 3.32 |
| Felix Weigel | 11 | 0 | 0.34 |
| David Wilhite | 12 | 0 | 0.68 |
| Jiacheng Yang | 13 | 0 | 0.34 |
| Jun Xu | 14 | 16 | 1.24 |
| Jiexing Li | 15 | 211 | 10.36 |
| Zhan Yuan | 16 | 0 | 0.34 |
| Craig Chasseur | 17 | 0 | 0.34 |
| Zeng Qiang | 18 | 34 | 10.73 |
| Ian Rae | 19 | 86 | 3.56 |
| Anurag Biyani | 20 | 0 | 0.34 |
| Andrew Harn | 21 | 0 | 0.34 |
| Yang Xia | 22 | 0 | 0.34 |
| Andrey Gubichev | 23 | 0 | 0.34 |
| Amr El-Helw | 24 | 0 | 0.34 |
| Orri Erling | 25 | 489 | 32.75 |
| Zhepeng Yan | 26 | 0 | 0.68 |
| Mohan Yang | 27 | 71 | 6.86 |
| Yiqun Wei | 28 | 0 | 0.68 |
| Thanh Do | 29 | 0 | 0.68 |
| Colin Zheng | 30 | 0 | 0.34 |
| Goetz Graefe | 31 | 0 | 0.34 |
| Somayeh Sardashti | 32 | 0 | 0.34 |
| Ahmed M. Aly | 33 | 0 | 0.68 |
| Divy Agrawal | 34 | 0 | 0.68 |
| Ashish Gupta | 35 | 33 | 1.75 |
| Divyakant Agrawal | 36 | 8201 | 1674.75 |