Title
Near Real-time Autonomous Quality Control for Streaming Environmental Sensor Data.
Abstract
In this paper, we present a novel and accessible approach to time-series data validation: the Near-Real Time Autonomous Quality Control (NRAQC) system. The design, implementation, and impacts of this software are explored in detail within this paper. This software system, created in close conference with environmental scientists, leverages microservice design patterns employed for high volume web applications to develop a contemporary solution to the problem of data quality control with streaming sensor data. Through a comparative analysis between NRAQC and the GCE Toolbox, we argue that the web based deployment of QC software enhances accessibility to crucial tools required to make a robust and useful data product from raw measurements. Additionally, a key innovation of the NRAQC platform is its positive impact on modern data management practices and quality data dissemination. (C) 2018 The Authors. Published by Elsevier Ltd.
Year
DOI
Venue
2018
10.1016/j.procs.2018.08.139
Procedia Computer Science
Keywords
Field
DocType
Software Engineering,Data Management,Microservices,Quality Control,Web-based Systems,Information Quality
Data mining,Data validation,Software deployment,Data quality,Software engineering,Computer science,Software design pattern,Software system,Software,Web application,Data management
Conference
Volume
ISSN
Citations 
126
1877-0509
0
PageRank 
References 
Authors
0.34
2
6