Paper Info
Title
What Supercomputers Say: A Study of Five System Logs
Abstract
If we hope to automatically detect and diagnose failures in large-scale computer systems, we must study real deployed systems and the data they generate. Progress has been hampered by the inaccessibility of empirical data. This paper addresses that dearth by examining system logs from five supercomputers, with the aim of providing useful insight and direction for future research into the use of such logs. We present details about the systems, methods of log collection, and how alerts were identified; propose a simpler and more effective filtering algorithm; and define operational context to encompass the crucial information that we found to be currently missing from most logs. The machines we consider (and the number of processors) are: Blue Gene/L (131072), Red Storm (10880), Thunderbird (9024), Spirit (1028), and Liberty (512). This is the first study of raw system logs from multiple supercomputers.
Year
DOI
Venue
2007
10.1109/DSN.2007.103
Edinburgh
Keywords
Field
DocType
storms,pressing,computer science
Computer science,Blue gene,Filter (signal processing),Red Storm,Distributed computing
Conference
ISSN
ISBN
Citations 
1530-0889
0-7695-2855-4
167
PageRank 
References 
Authors
7.65
20
2
Search Limit
100167
Name
Order
Citations
PageRank
Adam J. Oliner171551.10
Jon Stearley265124.52