Title
A hybrid architecture for astronomical computing.
Abstract
With many large science equipment constructing and putting into use, astronomy has stepped into the big data era. The new method and infrastructure of big data processing has become a new requirement of many astronomers. Cloud computing, Map/Reduce, Hadoop, Spark, etc. many new technology has sprung up in recent years. Comparing to the high performance computing(HPC), Data is the center of these new technology. So, a new computing architecture infrastructure is necessary, which can be shared by both HPC and big data processing. Based on Astronomy Cloud project of Chinese Virtual Observatory (China-VO), we have made much efforts to optimize the designation of the hybrid computing platform. which include the hardware architecture, cluster management, Job and Resource scheduling.
Year
Venue
Field
2018
arXiv: Distributed, Parallel, and Cluster Computing
Architecture,Computer architecture,Spark (mathematics),Supercomputer,Computer science,Sextant (astronomical),Big data,Virtual observatory,Distributed computing,Cloud computing,Hardware architecture
DocType
Volume
Citations 
Journal
abs/1801.07548
0
PageRank 
References 
Authors
0.34
0
20
Name
Order
Citations
PageRank
Changhua Li111.72
Chenzhou Cui2155.24
Boliang He302.03
Dongwei Fan400.34
Linying Mi500.34
Shanshan Li629553.11
Sisi Yang700.68
Yunfei Xu852.78
Jun Han923930.45
Junyi Chen1000.68
Hailong Zhang1162.84
Ce Yu127515.15
Jian Xiao1337934.37
Chuanjun Wang1431.88
Zihuang Cao1500.34
Yufeng Fan1601.35
Liang Liu1716340.93
Xiao Chen184216.43
Wenming Song1901.01
Kangyu Du2000.34