This paper presents a novel approach for simulation validation by combining systematic, National Institute of Standards and Technology-guideline-based uncertainty assessment with the gamma dose distribution comparison method, and applies the approach to simulated and measured complicated pressure distributions in the field of focused ultrasound. Simulations require verification and validation to demonstrate that they correctly implement the underlying model and sufficiently capture the real-world behavior of the system of interest within the context-of-use. Uncertainty assessment is necessary to determine the quality (strength, success, and range) of the validation. The combined approach of systematic uncertainty evaluation and the gamma-method presented herein permits thorough validation with meaningful and reasonable tolerances (expanded uncertainty: 1.04 dB = 12.7%, 1.88 wavelengths), whereas point-wise comparison would have resulted in an unacceptably large uncertainty (>10 dB) due to the impact of distortion. The approach presented also provides a scalar agreement metric and a natural means of visualizing areas of disagreement. Verification is achieved by identifying the critical physical and numerical phenomena and ascertaining correct handling by means of analytical and numerical benchmarks. The generality of the verification and validation approach presented makes it applicable to a wide range of computational models, beyond the highlighted acoustic simulations.

References

References
1.
ASME
,
2009
, “
American Society of Mechanical Engineering Verification and Validation Standard
,” American Society of Mechanical Engineering, New York, Standard No. ASME V&V 20-2009.
2.
ASME
,
2012
, “
American Society of Mechanical Engineering Verification and Validation Guide
,” American Society of Mechanical Engineering, New York, Standard No. ASME V&V 10-1-2012.
3.
FDA
,
2014
, “
Reporting of Computational Modeling Studies in Medical Device Submissions—Draft Guidance for Industry and Food and Drug Administration Staff
,” U.S. Food and Drug Administration, Silver Spring, MD.
4.
IEC/IEEE
,
2012
, “
Recommended Practice for Determining the Spatial-Peak Specific Absorption Rate (SAR) in the Human Body Due to Wireless Communication Devices, 30 MHz – 6 GHz
,” International Electrotechnical Commission Technical Committee 106, Geneva Switzerland, Standard No. IEC/IEEE 62704.
5.
Roache
,
P. J.
,
2002
, “
Code Verification by the Method of Manufactured Solutions
,”
ASME J. Fluids Eng.
,
124
(
1
), pp.
4
10
.
6.
GUM: BIPM, IEC, IFCC, ILAC, IUPAC, IUPAP, ISO, OIML
,
2008
, “
Evaluation of Measurement Data—Guide for the Expression of Uncertainty in Measurement
,” Joint Committee for Guides in Metrology, JCGM 100:2008.
7.
Taylor
,
B.
, and
Kuyatt
,
C.
,
1994
, “
Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurements Results
,” National Institute of Standards and Technology, Washington, DC, USA, Technical Note 1279.
8.
Kuster
,
N.
, and
Schoenborn
,
F.
,
2000
, “
Recommended Minimal Requirements and Development Guidelines for Exposure Setups of Bio-Experiments Addressing the Health Risk Concern of Wireless Communications
,”
Bioelectromagnetics
,
21
(
7
), pp.
508
514
.
9.
Kuster
,
N.
,
Torres
, V
. B.
,
Nikoloski
,
N.
,
Frauscher
,
M.
, and
Kainz
,
W.
,
2006
, “
Methodology of Detailed Dosimetry and Treatment of Uncertainty and Variations for In Vivo Studies
,”
Bioelectromagnetics
,
27
(
5
), pp.
378
391
.
10.
Neufeld
,
E.
,
Kuehn
,
S.
,
Szekely
,
G.
, and
Kuster
,
N.
,
2009
, “
Measurement, Simulation and Uncertainty Assessment of Implant Heating During MRI
,”
Phys. Med. Biol.
,
54
(
13
), pp.
4151
4169
.
11.
Murbach
,
M.
,
Neufeld
,
E.
,
Capstick
,
M.
,
Kainz
,
W.
,
Brunner
,
D. O.
,
Samaras
,
T.
,
Pruessmann
,
K. P.
, and
Kuster
,
N.
,
2014
, “
Thermal Tissue Damage Model Analyzed for Different Whole-Body SAR and Scan Durations for Standard MR Body Coils
,”
Magn. Reson. Med.
,
71
(
1
), pp.
421
431
.
12.
Murbach
,
M.
,
Neufeld
,
E.
,
Kainz
,
W.
,
Pruessmann
,
K. P.
, and
Kuster
,
N.
,
2014
, “
Whole-Body and Local RF Absorption in Human Models as a Function of Anatomy and Position Within 1.5 T MR Body Coil
,”
Magn. Reson. Med.
,
71
(
2
), pp.
839
845
.
13.
Neufeld
,
E.
,
Murbach
,
M.
,
Kyriakou
,
A.
,
Kainz
,
W.
, and
Kuster
,
N.
,
2014
, “
Uncertainty Assessment and Validation of Multi-Physics In Vivo Simulations: Example EM Exposure Induced Heating and Nerve Stimulation
,” Proceedings of the ASME 2014 Verification and Validation Symposium, Las Vegas, NV, May 7–9.
14.
Low
,
A.
,
Harms
,
W. B.
,
Mutic
,
S.
, and
Purdy
,
J. A.
,
1998
, “
A Technique for the Quantitative Evaluation of Dose Distributions
,”
Med. Phys.
,
25
(
5
), pp.
656
661
.
15.
Low
,
D. A.
, and
Low
,
J. F.
,
2003
, “
Evaluation of the Gamma Dose Distribution Comparison Method
,”
Med. Phys.
,
30
(
9
), pp.
2455
2464
.
16.
Kyriakou
,
A.
,
2015
, “
Multi-Physics Computational Modeling of Focused Ultrasound Therapies
,” Ph.D. thesis, Swiss Federal Institute of Technology, Zurich, Switzerland.
17.
Zhou
,
D.
,
Huang
,
W. P.
,
Xu
,
C. L.
,
Fang
,
D. G.
, and
Chen
,
B.
,
2001
, “
The Perfectly Matched Layer Boundary Condition for Scalar Finite-Difference Time-Domain Method
,”
IEEE Photon. Technol. Lett.
,
13
(
5
), pp.
454
456
.
18.
Chew
,
W. C.
, and
Weedon
,
W. H.
,
1994
, “
A 3D Perfectly Matched Medium From Modified Maxwell's Equations With Stretched Coordinates
,”
Microwave Opt. Tech. Lett.
,
7
(
3
), pp.
599
604
.
19.
McGough
,
R. J.
,
2013
, “
FOCUS: Fast Object-oriented C++ Ultrasound Simulator
,” Michigan State University, East Lansing, MI, (last accessed Aug. 4, 2016), http://www.egr.msu.edu/∼fultras-web/
20.
Kyriakou
,
A.
,
Neufeld
,
E.
,
Werner
,
B.
,
Szekely
,
G.
, and
Kuster
,
N.
,
2015
, “
Full-Wave Acoustic and Thermal Modeling of Transcranial Ultrasound Propagation and Investigation of Skull-Induced Aberration Correction Techniques: A Feasibility Study
,”
J. Ther. Ultrasound
,
3
(
1
), pp.
1
18
.
21.
Roache
,
P. J.
,
1998
,
Verification and Validation in Computational Science and Engineering
,
Hermosa Publisher
,
Socorro, NM
.
You do not currently have access to this content.