Abstract

This paper discusses the application of the area metric to the quantification of modeling errors. The focus of the discussion is the effect of the shape of the two distributions on the result produced by the Area Metric. Two different examples that assume negligible experimental and numerical errors are presented: the first case has experimental and simulated quantities of interest defined by normal distributions that require the definition of a mean value and a standard deviation; the second example is taken from the V&V10.1 ASME standard that applies the Area Metric to quantify the modeling error of the tip deflection of a loaded hollow tapered cantilever beam simulated with the static Bernoulli–Euler beam theory. The first example shows that relatively small differences between the mean values are sufficient for the area metric to be insensitive to the standard deviation. Furthermore, the example of the V&V10.1 ASME standard produces an Area Metric equal to the difference between the mean values of experiments and simulations. Therefore, the error quantification is reduced to a single number that is obtained from a simple difference of two mean values. This means that the area metric fails to reflect a dependence on the difference in the shape of the distributions representing variability. The paper also presents an alternative version of the Area Metric that avoids this filtering effect of the shape of the distributions by utilizing a reference simulation that has the same mean value as the experiments. This means that the quantification of the modeling error will have contributions from the difference in mean values and the shape of the distributions.

References

1.
Roache
,
P. J.
,
2009
,
Fundamentals of Verification and Validation
,
Hermosa Publishers
,
Albuquerque, NM
.
2.
Oberkampf
,
W. L.
, and
Roy
,
C. J.
,
2010
,
Verification and Validation in Scientific Computing
,
Cambridge University Press
,
Cambridge, UK
.
3.
ASME V&V 10-2019
,
2020
, Standard for Verification & Validation in Computational Solid Mechanics, the American Society of Mechanical Engineers (ASME),
New York
, Standard No. V&V10-2020.
4.
ASME V&V 20-2009 (R2016)
,
2009
, Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer, American Society of Mechanical Engineers (ASME),
New York
, Standard No. V&V20-2009.
5.
Coleman
,
H. W.
, and
Steele
,
W. G.
, July
2009
,
Experimentation, Validation, and Uncertainty Analysis for Engineers
,
Wiley
, Hoboken, NJ.
6.
He
,
Q.
, May
2019
, “
Model Validation Based on Probability Boxes Under Mixed Uncertainties
,”
Adv. Mech. Eng.
,
11
(
5
), epub.10.1177/1687814019847411
7.
Ferson
,
S.
,
Oberkampf
,
W. L.
, and
Ginzburg
,
L.
,
2008
, “
Model Validation and Predictive Capability for the Thermal Challenge Problem
,”
Comput. Methods Appl. Mech. Eng.
,
197
(
29–32
), pp.
2408
2430
.10.1016/j.cma.2007.07.030
8.
Eça
,
L.
,
Dowding
,
K.
, and
Moorcroft
,
D.
,
2021
, “
Comparison of the V&V10.1 and V&V20 Validation Procedures for the V&V10.1 Example
,”
ASME
Paper No. VVS2021-73011.10.1115/VVS2021-73011
9.
ASME V&V 10.1-2012
,
2012
, An Illustration of the Concepts of Verification and Validation in Computational Solid Mechanics, American Society of Mechanical Engineers (ASME),
New York
, Standard No. V&V10.1-2012.
You do not currently have access to this content.