Computational modeling and simulation are paramount to modern science. Computational models often replace physical experiments that are prohibitively expensive, dangerous, or occur at extreme scales. Thus, it is critical that these models accurately represent and can be used as replacements for reality. This paper provides an analysis of metrics that may be used to determine the validity of a computational model. While some metrics have a direct physical meaning and a long history of use, others, especially those that compare probabilistic data, are more difficult to interpret. Furthermore, the process of model validation is often application-specific, making the procedure itself challenging and the results difficult to defend. We therefore provide guidance and recommendations as to which validation metric to use, as well as how to use and decipher the results. An example is included that compares interpretations of various metrics and demonstrates the impact of model and experimental uncertainty on validation processes.
Validation Metrics for Deterministic and Probabilistic Data
Manuscript received June 21, 2018; final manuscript received November 2, 2018; published online January 22, 2019. Assoc. Editor: David Moorcroft.
- Views Icon Views
- Share Icon Share
- Cite Icon Cite
- Search Site
Maupin, K. A., Swiler, L. P., and Porter, N. W. (January 22, 2019). "Validation Metrics for Deterministic and Probabilistic Data." ASME. J. Verif. Valid. Uncert. September 2018; 3(3): 031002. https://doi.org/10.1115/1.4042443
Download citation file:
- Ris (Zotero)
- Reference Manager