System complexity is considered a key driver of the inability of current system design practices to at times not recognize performance, cost, and schedule risks as they emerge. We present here a definition of system complexity and a quantitative metric for measuring that complexity based on information theory. We also derive sensitivity indices that indicate the fraction of complexity that can be reduced if more about certain factors of a system can become known. This information can be used as part of a resource allocation procedure aimed at reducing system complexity. Our methods incorporate Gaussian process emulators of expensive computer simulation models and account for both model inadequacy and code uncertainty. We demonstrate our methodology on a candidate design of an infantry fighting vehicle.

References

References
1.
Allen
,
L.
,
Angel
,
R.
,
Mangus
,
J. D.
,
Rodney
,
G. A.
,
Shannon
,
R. R.
, and
Spoelhof
,
C. P.
, 1990, “
The Hubble Space Telescope Optical Systems Failure Report
,” Technical Report No. NASA-TM-103443, National Aeronautics and Space Administration.
2.
Bolkcom
,
C.
, 2005, “
V-22 Osprey Tilt-Rotor Aircraft: Congressional Research Service Report for Congress
,” Technical Report, Congressional Research Service. Available at http://www.history.navy.mil/library/online/v-22%20osprey.htm
3.
Hiltzik
,
M.
, 2011,
787 Dreamliner Teaches Boeing Costly Lesson on Outsourcing
,
Los Angeles Times
,
Los Angeles, CA
.
4.
Brown
,
O.
, and
Eremenko
,
P.
, 2006, “
The Value Proposition for Fractionated Space Architectures
,” AIAA Space 2006, San Jose, CA, Paper No. AIAA-2006-7506.
5.
Campbell
,
L.
, 1966, “
Exponential Entropy as a Measure of Extent of a Distribution
,”
Z. Wahrscheinlichkeitstheorie verw. Geb.
,
5
, pp.
217
225
.
6.
Takeda
,
H.
,
Veerkamp
,
P.
,
Tomiyama
,
T.
, and
Yoshikawa
,
H.
, 1990, “
Modeling Design Processes
,”
AI Mag.
,
11
(
4
), pp.
37
48
.
7.
Weaver
,
W.
, 1948, “
Science and Complexity
,”
Am. Sci.
,
36
, pp.
536
544
.
8.
Huberman
,
B. A.
, and
Hogg
,
T.
, 1987, “
Phase Transitions in Artificial Intelligence Systems
,”
Artif. Intell.
,
33
, pp.
155
171
.
9.
Johnson
,
G.
, 1997, “
Researchers on Complexity Ponder What It’s All About
,” The New York Times: Technology, May 6, 1997.
10.
Balestrini-Robinson
,
S.
, 2009, “
A Modeling Process to Understand Complex System Architectures
,” Ph.D. thesis, Georgia Institute of Technology, Atlanta, GA.
11.
von Bertalanffy
,
L.
, 1950, “
An Outline of General System Theory
,”
Br. J. Philos. Sci.
,
1
(
2
), pp.
134
165
.
12.
Eriksson
,
D.
, 1997, “
A Principal Exposition of Jean-Louis Le Moigne’s Systemic Theory
,”
Cybern. Human Knowing
,
4
(
2
).
13.
Corning
,
P. A.
, 1998, “
Complexity is Just a Word!
,”
Technol. Forecast. Soc. Change
,
59
, pp.
197
200
.
14.
Bankes
,
S. C.
, 2002, “
Tools and Techniques for Developing Policies for Complex and Uncertain Systems
,”
Proc. Natl. Acad. Sci. U.S.A.
,
99
, pp.
7263
7266
.
15.
Summers
,
J. D.
, and
Shah
,
J. J.
, 2010, “
Mechanical Engineering Design Complexity Metrics: Size, Coupling, and Solvability
,”
J. Mech. Des.
,
132
(
2
), p.
021004
.
16.
Braha
,
D.
, and
Maimon
,
O.
, 1998, “
The Measurement of a Design Structural and Functional Complexity
,”
IEEE Trans. Syst. Man Cybern., Part A. Syst. Humans
,
28
(
4
), pp.
527
535
.
17.
Albrecht
,
A. J.
, and
Gaffney
,
J. E.
, Jr.
, 1983, “
Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation
,”
IEEE Trans. Softw. Eng.
,
SE-9
(
6
), pp.
639
648
.
18.
Murmann
,
P. A.
, 1994, “
Expected Development Time Reductions in the German Mechanical Engineering Industry
,”
J. Prod. Innov. Manage.
,
11
(
3
), pp.
236
252
.
19.
Griffin
,
A.
, 1997, “
The Effect of Project and Process Characteristics on Product Development Cycle Time
,”
J. Mark. Res.
,
34
(
1
), pp.
24
35
.
20.
Meyer
,
M. H.
, and
Utterback
,
J. M.
, 1995, “
Product Development Cycle Time and Commercial Success
,”
IEEE Trans. Eng. Manage.
,
42
(
4
), pp.
297
304
.
21.
Braha
,
D.
, and
Bar-Yam
,
Y.
, 2004, “
Topology of Large-Scale Engineering Problem-Solving Networks
,”
Phys. Rev.
,
69
(
1
), p.
016113
.
22.
Braha
,
D.
, and
Bar-Yam
,
Y.
, 2007, “
The Statistical Mechanics of Complex Product Development: Empirical and Analytical Results
,”
Manage. Sci.
,
53
(
7
), pp.
1127
1145
.
23.
McCabe
,
T. J.
, 1976, “
A Complexity Measure
,”
IEEE Trans. Softw. Eng.
,
2
(
4
), pp.
308
320
.
24.
Tatikonda
,
M. V.
, and
Rosenthal
,
S. R.
, 2000, “
Technology Novelty, Project Complexity, and Product Development Project Execution Success: A Deeper Look at Task Uncertainty in Product Innovation
,”
IEEE Trans. Eng. Manage.
,
47
(
1
), pp.
74
87
.
25.
Novak
,
S.
, and
Eppinger
,
S. D.
, 2004, “
Sourcing by Design: Product Complexity and the Supply Chain
,”
Manage. Sci.
,
47
(
1
), pp.
189
204
.
26.
Kim
,
J.
, and
Wilemon
,
D.
, 2009, “
An Empirical Investigation of Complexity and Its Management in New Product Development
,”
Technol. Anal. Strategic Manage.
,
21
(
4
), pp.
547
564
.
27.
Hölttä
,
K. M. M.
, and
Otto
,
K. N.
, 2005, “
Incorporating Design Effort Complexity Measures in Product Architectural Design and Assessment
,”
Des. Stud.
,
26
(
5
), pp.
463
485
.
28.
Kolmogorov
,
A. N.
, 1965, “
Three Approaches to the Quantitative Definition of Information
,”
Problems Inf. Transm.
,
1
(
1
), pp.
1
7
.
29.
Chaitin
,
G. J.
, 1969, “
On the Simplicity and Speed of Programs for Computing Infinite Sets of Natural Numbers
,”
J. ACM
,
16
(
3
), pp.
407
422
.
30.
Cover
,
T. M.
, and
Thomas
,
J. A.
, 1991,
Elements of Information Theory
,
John Wiley & Sons, Inc.
,
New York, NY
.
31.
Suh
,
N. P.
, 1990,
The Principles of Design
,
Oxford University Press
,
New York, NY
.
32.
Rodriguez-Toro
,
C. A.
,
Tate
,
S. J.
,
Jared
,
G. E. M.
, and
Swift
,
K. G.
, 2003, “
Complexity Metrics for Design (Simplicity + Simplicity = Complexity)
,”
Proc. Inst. Mech. Eng., Part B: J. Eng. Manuf.
,
217
, pp.
721
725
.
33.
Shannon
,
C. E.
, 1948, “
A Mathematical Theory of Communication
,”
Bell Syst. Tech. J.
,
27
, pp.
379
–423 and 623–
656
.
34.
Lloyd
,
S.
, and
Pagels
,
H.
, 1988, “
Complexity as Thermodynamic Depth
,”
Ann. Phys.
,
188
, pp.
186
213
.
35.
Coatanea
,
E.
, 2005, “
Conceptual Design of Life Cycle Design: A Modelling and Evaluation Method Based on Analogies and Dimensionless Numbers
,” Doctoral Dissertation, Helsinki University of Technology, Helsinki, Finland.
36.
Krus
,
P.
, and
Andersson
,
J.
, 2004, “
An Information Theoretical Perspective on Design Optimization
,” Proceedings of DETC’04,
ASME
.
37.
Dannon
,
H. V.
, 2008, “
Power Means Calculus, Product Calculus, Harmonic Mean Calculus, and Quadratic Mean Calculus
,”
Gauge Inst. J.
,
4
(
4
).
38.
Hardy
,
G. H.
,
Littlewood
,
J. E.
, and
Pólya
,
G.
, 1934,
Inequalities
,
Cambridge University Press
,
Cambridge, UK
.
39.
Kennedy
,
M.
, and
O’Hagan
,
A.
, 2001, “
Bayesian Calibration of Computer Models.
J. R. Stat. Soc. B
,
63
(
3
), pp.
425
464
.
40.
O’Hagan
,
A.
, 1978, “
Curve Fitting and Optimal Design for Prediction
,”
J. R. Stat. Soc. B (Methodol.)
,
40
, pp.
1
42
.
41.
O’Hagan
,
A.
, 2006, “
Bayesian Analysis of Computer Code Outputs: A Tutorial
,”
Reliab. Eng. Syst. Saf.
,
91
, pp.
1290
1300
.
42.
Rasmussen
,
C.
, and
Williams
,
K.
, 2006,
Gaussian Processes for Machine Learning
,
MIT Press
,
Cambridge, Massachusetts
.
43.
Sacks
,
J.
,
Welch
,
W.
,
Mitchell
,
T.
, and
Wynn
,
H.
, 1989, “
Design and Analysis of Computer Experiments
,”
Stat. Sci.
,
4
(
4
), pp.
409
435
.
44.
Homma
,
T.
, and
Saltelli
,
A.
, 1996, “
Importance Measures in Global Sensitivity Analysis of Nonlinear Models
,”
Reliab. Eng. Syst. Saf.
,
52
, pp.
1
17
.
45.
Liu
,
H.
,
Chen
,
W.
, and
Sudjianto
,
A.
, 2006, “
Relative Entropy Based Method for Global and Regional Sensitivity Analysis in Probabilistic Design
,”
ASME J. Mech. Des.
,
128
(
2
), pp.
1
11
.
46.
Borgonovo
,
E.
, 2006, “
Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches
,”
Risk Anal.
,
26
(
5
), pp.
1349
1361
.
47.
Broenink
,
J.
, 1999, “
Introduction to Physical Systems Modeling With Bond Graphs
,” The SiE Whitebook on Simulation Methodologies, available at http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.124.3518http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.124.3518
48.
Borutzky
,
W.
, 2006, “
Bond Graph Modelling and Simulation of Mechatronic Systems An Introduction into the Methodology
,” 20th European Conference on Modeling and Simulation.
49.
Das
,
S.
, 2009,
Mechatronic Modeling and Simulation Using Bond Graphs
,
Taylor & Francis Group, LLC
,
Boca Raton, Florida
.
50.
Paynter
,
H.
, 1961,
Analysis and Design of Engineering Systems
,
MIT Press
,
Cambridge, Massachusetts
.
51.
Belfiore
,
M.
, 2012, “
Adaptive Vehicle Make: DARPA’s Plan to Revolutionize Auto Manufacturing
,” Popular Mechanics, January.
52.
Oakley
,
J.
, and
O’Hagan
,
A.
, 2007, “
Uncertainty in Prior Elicitations: A Nonparametric Approach
,”
Biometrika
,
94
, pp.
427
441
.
53.
Saltelli
,
A.
,
Ratto
,
M.
,
Andres
,
T.
,
Campolongo
,
F.
,
Cariboni
,
J.
,
Gatelli
,
D.
,
Saisana
,
M.
, and
Tarantola
,
S.
, 2008,
Global Sensitivity Analysis: The Primer
,
John Wiley & Sons, Ltd.
,
West Sussex, England
.
You do not currently have access to this content.