Title
On construction of a network log management system using ELK Stack with Ceph
Abstract
A log management system is essential for the networks administrator. With a log management tool, we can collect, store, analyze, archive, and finally dispose of the log information. In this paper, we propose the architecture model of a log management system using ELK Stack with Ceph to provide a safe network, good Wi-Fi signal strength, and adequate backup data mechanism. In this case, we use our campus data of Wi-Fi log and NetFlow log. First, we collect and store data of our Wi-Fi log using Filebeats tool, and then, we use Elasticsearch, Logstash, and Kibana Stack to visualize the Wi-Fi log data. Second, we collect and store our NetFlow log using NFDUMP, and then, we also use ELK Stack to visualize the NetFlow log data. Third, we integrate the Wi-Fi log and NetFlow log data in one architecture using a distributed storage Ceph file system (CephFS). Moreover, we also compare the performance of RADOS Gateway and CephFS for better storage mechanism.
Year
DOI
Venue
2020
10.1007/s11227-019-02853-2
The Journal of Supercomputing
Keywords
DocType
Volume
Log management system, ELK Stack, Ceph, Alluxio, Elasticsearch, Logstash, Kibana
Journal
76
Issue
ISSN
Citations 
8
0920-8542
3
PageRank 
References 
Authors
0.40
1
6
Name
Order
Citations
PageRank
Chao-Tung Yang11196139.50
Endah Kristiani2275.81
Yuan-Ting Wang330.40
Geyong Min42089224.70
Ching-Han Lai530.40
Wei-Je Jiang640.76