Title
Benchmark Test Distributions for Expanded Uncertainty Evaluation Algorithms.
Abstract
Expanded uncertainty estimation is normally required for mission-critical applications, e.g., those involving health and safety. It helps to get a distribution range of the required confidence level for the uncertainty evaluation of a system. There are a number of available techniques to estimate the expanded uncertainty. However, there is currently no commonly accepted benchmark test distribution set adopted to compare the performances of different techniques when they are used to estimate the expanded uncertainty. Without such a common benchmarking platform, the relative reliability of a particular technique in comparison to other techniques can be untrustworthy. To address the shortcoming, this paper proposes a set of analytically derived benchmark test distributions. It goes on to show the benefits of using them by comparing the performance of existing distribution fitting techniques when applied to the moment-based expanded uncertainty evaluation. The most commonly used moment-based distribution fitting techniques, such as Pearson, Tukey’s gh , Cornish–Fisher expansion, and extended generalized lambda distributions, are employed as test cases in this paper. The test distribution set proposed in this paper provides a common benchmarking platform for metrologists intending to assess the performance of different expanded uncertainty estimation techniques. Results from the performance comparison would help practitioners to make a better choice of a distribution fitting technique that would best suit their respective systems.
Year
DOI
Venue
2016
10.1109/TIM.2015.2507418
IEEE Trans. Instrumentation and Measurement
Keywords
Field
DocType
Monte Carlo methods,benchmark testing,measurement uncertainty,Cornish-Fisher expansion,Monte Carlo methods,Pearson distribution fitting technique,Tukey's gh distribution fitting technique,benchmark test distributions,extended generalized lambda distributions,moment-based distribution fitting techniques,moment-based expanded uncertainty evaluation,Benchmark distributions,Cornish-Fisher (CF),Cornish???Fisher (CF),Monte Carlo (MC),Pearson,Tukey's gh.,Tukey???s gh,expanded uncertainty,extended generalized lambda distributions (EGLD),guide to the expression of uncertainty in measurement (GUM)
Mathematical optimization,Measurement uncertainty,Uncertainty analysis,Distribution fitting,Uncertainty estimation,Test case,Confidence interval,Benchmarking,Benchmark (computing),Mathematics
Journal
Volume
Issue
ISSN
65
5
0018-9456
Citations 
PageRank 
References 
2
0.44
13
Authors
4
Name
Order
Citations
PageRank
Arvind Rajan164.06
Ye Chow Kuang27219.81
Melanie Po-Leen Ooi37018.35
Serge N. Demidenko48419.38