Title
Data Quality Control for St. Petersburg Flood Warning System.
Abstract
This paper focuses on techniques for dealing with imperfect data in a frame of early warning system (EWS). Despite the fact that data may be technically damaged by presenting noise, outliers or missing values, met-ocean simulation systems have to deal with them to provide data transaction between models, real time data assimilation, calibration, etc. In this context data quality-control becomes one of the most important parts of EWS. St. Petersburg FWS was considered as an example of EWS. Quality control in St. Petersburg FWS contains blocks of technical control, human mistakes control, statistical control of simulated fields, statistical control and restoration of measurements and control using alternative models. Domain specific quality control was presented as two types of procedures based on theoretically proved methods were applied. The first procedure is based on probabilistic model of dynamical system, where processes are spatially interrelated and could be implemented in a form of multivariate regression (MRM). The second procedure is based on principal component analysis extended for taking into account temporal relations in data set (ePCA).
Year
DOI
Venue
2016
10.1016/j.procs.2016.05.532
ICCS
Keywords
Field
DocType
outliers, quality-control, principal components, gap filling
Flood warning,Data mining,Data quality,Real-time data,Computer science,Outlier,Statistical model,Statistical process control,Artificial intelligence,Missing data,Early warning system,Machine learning
Conference
Volume
Issue
ISSN
80
C
1877-0509
Citations 
PageRank 
References 
0
0.34
5
Authors
5