Title
The Cancer Genomics Hub (CGHub): overcoming cancer through the power of torrential data.
Abstract
The Cancer Genomics Hub (CGHub) is the online repository of the sequencing programs of the National Cancer Institute (NCI), including The Cancer Genomics Atlas (TCGA), the Cancer Cell Line Encyclopedia (CCLE) and the Therapeutically Applicable Research to Generate Effective Treatments (TARGET) projects, with data from 25 different types of cancer. The CGHub currently contains > 1.4 PB of data, has grown at an average rate of 50 TB a month and serves > 100 TB per week. The architecture of CGHub is designed to support bulk searching and downloading through a Web-accessible application programming interface, enforce patient genome confidentiality in data storage and transmission and optimize for efficiency in access and transfer. In this article, we describe the design of these three components, present performance results for our transfer protocol, GeneTorrent, and finally report on the growth of the system in terms of data stored and transferred, including estimated limits on the current architecture. Our experienced-based estimates suggest that centralizing storage and computational resources is more efficient than wide distribution across many satellite labs.
Year
DOI
Venue
2014
10.1093/database/bau093
DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION
Field
DocType
Volume
Data mining,World Wide Web,Confidentiality,Public domain,Computer science,Upload,Genomics,Encyclopedia,Bioinformatics,Cancer,The Internet
Journal
2014
ISSN
Citations 
PageRank 
1758-0463
10
0.85
References 
Authors
4
26
Name
Order
Citations
PageRank
Christopher Wilks1100.85
Melissa S. Cline227143.65
Erich Weiler3100.85
M Diekhans41539234.55
Brian Craft5202.08
Christy Martin6100.85
Daniel Murphy7100.85
Howdy Pierce8100.85
John Black9100.85
Donavan Nelson10100.85
Brian Litzinger11100.85
Thomas Hatton12100.85
Lori Maltbie13100.85
Michael Ainsworth14100.85
Patrick Allen15100.85
Linda Rosewood16100.85
Elizabeth Mitchell17100.85
Bradley Smith18100.85
Jim Warner19100.85
John Groboske20100.85
Haifang Telc21100.85
Daniel Wilson22100.85
Brian Sanford23100.85
Hannes Schmidt24100.85
David Haussler2583273068.93
Daniel Maltbie26100.85