Diagnosis of complex engineering systems requires the use of multiple sensor sources to acquire information. In this paper we present a survey of multimodal data acquisition systems for nondestructive testing (NDT) and engineering analysis. We begin with a summary of the relative strengths and weaknesses of individual NDT modalities. Thereafter we present existing multimodal inspection hardware systems that use complementary NDT sensors. The advantages of such multimodal data acquisition over conventional single modality sensors in inspection and analysis are highlighted. Possible approaches to fuse complementary multimodal sensor data are discussed. We conclude with possible directions for the future development of multimodal inspection systems.

1.
Davis
,
J.
,
et al.
, 1989,
ASM Handbook, Non-Destructive Evaluation and Quality Control
.
ASM International
, Materials Park, OH.
2.
Horn
,
D.
, and
Mayo
,
W.
, 2000, “
NDE Reliability Gains from Combining Eddy-Current and Ultrasonic Testing
,”
NDT & E Int.
0963-8695,
33
, pp.
351
362
.
3.
Shen
,
T.
,
Huang
,
J.
, and
Menq
,
C.
, 2000, “
Multiple-Sensor Integration for Rapid and High-Precision Coordinate Metrology
,”
IEEE/ASME Trans. Mechatron.
1083-4435,
5
, pp.
110
121
.
4.
Shen
,
T.
,
Huang
,
J.
, and
Menq
,
C.
, 2001, “
Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology
,”
J. Comput. Inf. Sci. Eng.
1530-9827,
1
, pp.
167
179
.
5.
Gautier
,
S.
,
Idier
,
J.
,
Djafari
,
A.
, and
Lavayssiere
,
B.
, 1998, “
X-Ray and Ultrasound Data Fusion
,”
Proceedings International Conference on Image Processing
.
6.
Gros
,
X.
,
Strachan
,
P.
, and
Lowden
,
D.
, 1995, “
Fusion of Multiprobe NDT Data for ROV Inspection
,” MTS∕IEEE OCEANS, San Diego, CA, Oct. 9–12.
7.
Optical Gauging Products, Inc., 2006, “
Smartscope Quest Systems
,” http://www.ogpnet.comhttp://www.ogpnet.com.
8.
Werth Messtechnik, 2005, “
Multisensor Coordinate Measurement Machines
,” http://www.werthmesstechnik.de/http://www.werthmesstechnik.de/.
9.
Fries Research and Technology, 2006, “
Microglider
,” http://www.frtofamerica.comhttp://www.frtofamerica.com.
10.
Hall
,
D.
, and
Llinas
,
J.
, 1997, “
An Introduction to Multisensor Data Fusion
,”
Proc. IEEE
0018-9219,
85
, pp.
6
23
.
11.
Varshney
,
P.
, 1997, “
Multisensor Data Fusion
,”
Electronics & Communication Engineering Journal
,
9
, pp.
245
253
.
12.
Dasarathy
,
B.
, 2000, “
Industrial Applications of Multi-Sensor Multi-Source Information Fusion
,”
Proceedings of IEEE International Conference on Industrial Technology
, January 19–22.
13.
Dromigny Badin
,
A.
,
Rossato
,
S.
, and
Zhu
,
Y.
, 1997, “
Radioscopic and Ultrasonic Data Fusion via the Evidence Theory
,”
Trait. Signal
0765-0019,
14
, pp.
499
510
.
14.
Gros
,
X.
,
Bousigue
,
J.
, and
Takahashi
,
K.
, 1999, “
NDT Data Fusion at the Pixel Level
,”
NDT & E Int.
0963-8695,
32
, pp.
283
292
.
15.
Xiang
,
Y.
, and
Shi
,
X.
, 1999, “
Application of Information Fusion on Flaw Detection of Concrete Structures
,”
Proceedings 2nd International Conference on Information Fusion
, Sunnyvale, CA, July.
16.
Miracle
,
D.
, and
Donaldson
,
S.
, 2001,
ASM Handbook, Composites
,
ASM International
, Materials Park, OH.
17.
Gros
,
X.
, 1997,
NDT Data Fusion
,
Elsevier
,
New York
.
18.
Gros
,
X.
, 2001,
Applications of NDT Data Fusion
,
Kluwer Academic
,
Dordrech, Netherlands
.
19.
Gunatilake
,
P.
,
Siegel
,
P.
,
Jordan
,
A.
, and
Podnar
,
G.
, 1997, “
Image Understanding Algorithms for Remote Visual Inspection of Aircraft Surfaces
,”
Proceedings SPIE Machine Vision Applications in Industrial Inspection
, San Jose, CA, February, pp.
2
13
.
20.
Zitová
,
B.
, and
Flusser
,
J.
, 2003, “
Image Registration Methods: A Survey
,”
Image Vis. Comput.
0262-8856,
21
, pp.
977
1000
.
21.
McNamara
,
J.
,
Lanza di Scalea
,
F.
, and
Fateh
,
M.
, 2004, “
Automatic Defect Classification in Long-Range Ultrasonic Rail Inspection Using a Support Vector Machine-Based Smart System
,”
Insight
1060-135X,
46
(
6
), pp.
47
55
.
22.
Lee
,
K.
, and
Estivill-Castro
,
V.
, 2003, “
Classification of Ultrasonic Shaft Inspection Data Using Discrete Wavelet Transform
,”
Proceedings 3rd International Conference on Artifical Intelligence and Applications
, Benalmadena, Spain, September 8–10, pp.
673
678
.
23.
Lingvall
,
F.
, and
Stepinski
,
T.
, 2000, “
Automatic Detecting and Classifying Defects During Eddy Current Inspection of Riveted Lap-Joints
,”
NDT & E Int.
0963-8695,
33
(
1
), pp.
47
55
.
24.
Joubert
,
P.
,
Le Bihan
,
Y.
, and
Placko
,
D.
, 2002, “
Localization of Defects in Steam Generator Tubes Using a Multi-Coil Eddy Current Probe Dedicated to High Speed Inspection
,”
NDT & E Int.
0963-8695,
35
(
1
), pp.
53
59
.
25.
Horn
,
B.
, 1984, “
Extended Gaussian Images
,”
Proc. IEEE
0018-9219,
72
, pp.
1671
1686
.
26.
Ritter
,
G.
, and
Wilson
,
J.
, 2001,
Handbook of Computer Vision Algorithms in Image Algebra
,
CRC
,
Boca Raton, FL
.
27.
Wolfson
,
H.
, and
Rigoutsos
,
I.
, 1997, “
Geometric Hashing: An Overview
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
14
, pp.
125
145
.
28.
Besl
,
P.
, and
McKay
,
H.
, 1992, “
A Method for Registration of 3-D Shapes
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
14
, pp.
239
256
.
29.
Zhang
,
Z.
, 1994, “
Iterative Point Matching for Registration of Free-Form Curves and Surfaces
,”
Int. J. Comput. Vis.
0920-5691,
13
, pp.
119
152
.
30.
Rusinkiewicz
,
R.
, and
Levoy
,
M.
, 2001, “
Efficient Variants of the ICP Algorithm
,”
Proceedings 3rd International Conference on 3D Digital Imaging and Modeling (3DIM)
.
31.
Krishnamurthy
,
V.
, and
Levoy
,
M.
, 1996, “
Fitting Smooth Surfaces to Dense Polygon Meshes
,”
Proceedings of ACM Siggraph
, New Orleans, Louisiana, August 4–9.
32.
Geomagic, 2006, “
Geomagic Studio
,” http://www.geomagic.comhttp://www.geomagic.com.
33.
Polyworks, 2006, “
Polyworks/Modeler
,” http://www.innovmetric.comhttp://www.innovmetric.com.
34.
Eck
,
M.
, and
Hoppe
,
H.
, 1996, “
Automatic Reconstruction of B-Spline Surfaces of Arbitrary Topological Type
,” Proceedings of ACM Siggraph, New Orleans, Louisiana, August 4–9.
35.
Marsan
,
A.
, and
Dutta
,
D.
, 1997, “
Survey of Process Planning Techniques for Layered Manufacturing
,”
Proceedings of the the 1997 ASME Design Engineering Technical Conferences
, Sacramento, CA, September 14–17.
You do not currently have access to this content.