This paper presents a five-phase taxonomy of systematic procedures to enable flexibility in the design and management of engineering systems operating under uncertainty. The taxonomy integrates contributions from surveys, individual articles, and books from the literature on engineering design, manufacturing, product development, and real options analysis obtained from professional e-index search engines. Thirty design procedures were classified based on the kind of early conceptual activities they support: baseline design, uncertainty recognition, concept generation, design space exploration, and process management. Each procedure is evaluated based on ease of use to enable flexibility analysis, whether it can be used directly in collaborative design activities, and has a proven applicability record in industry and research. The organizing principles integrate the procedures into a cohesive and systematic design framework. Demonstration applications on engineering systems case studies show that it helps designers select relevant procedures in different phases of the design process, depending on the context, available analytical resources, and objectives. In turn, the case studies show that the design framework helps generate concepts with improved lifecycle performance compared to baseline concepts. The taxonomy provides guidance to organize ongoing research efforts, and highlights potential contribution areas in this field of engineering design research.

References

References
1.
ESD
,
2011
, “
Engineering Systems Division Strategic Report
,” Massachusetts Institute of Technology, Cambridge, MA.
2.
Braha
,
D.
,
Minai
,
A. A.
, and
Bar-Yam
,
Y.
,
2006
,
Complex Engineered Systems: Science Meets Technology
,
Springer
,
Netherlands
.
3.
Fricke
,
E.
, and
Schulz
,
A. P.
,
2005
, “
Design for Changeability (DFC): Principles to Enable Changes in Systems Throughout Their Entire Lifecycle
,”
J. Syst. Eng.
,
8
(
4
), pp.
342
359
.
4.
de Neufville
,
R.
, and
Scholtes
,
S.
,
2011
,
Flexibility in Engineering Design
,
MIT Press
,
Cambridge, MA
.
5.
Trigeorgis
,
L.
,
1996
,
Real Options
,
MIT Press
,
Cambridge, MA
.
6.
Jugulum
,
R.
, and
Frey
,
D. D.
,
2007
, “
Toward a Taxonomy of Concept Designs for Improved Robustness
,”
J. Eng. Design
,
18
(
2
), pp.
139
156
.10.1080/09544820600731496
7.
Wang
,
T.
, and
de Neufville
,
R.
,
2005
, “
Real Options “In” Projects
,”
Real Options Conference
,
Paris, France
.
8.
Mikaelian
,
T.
,
Nightingale
,
D. J.
,
Rhodes
,
D. H.
, and
Hastings
,
D. E.
,
2011
, “
Real Options in Enterprise Architecture: A Holistic Mapping of Mechanisms and Types for Uncertainty Management
,”
IEEE Trans. Eng. Manage.
,
54
(
3
), pp.
457
470
.10.1109/TEM.2010.2093146
9.
Guma
,
A.
,
Pearson
,
J.
,
Wittels
,
K.
,
de Neufville
,
R.
, and
Geltner
,
D.
,
2009
, “
Vertical Phasing as a Corporate Real Estate Strategy and Development Option
,”
J. Corporate Real Estate
,
11
(
3
), pp.
144
157
.10.1108/14630010910985904
10.
Saleh
,
J. H.
, and
Hastings
,
D. E.
,
2000
, “
On Flexibility in Design: Analyzing Flexibility of Space Systems
,”
AIAA Space 2000 Conference and Exposition
,
Long Beach, CA
.
11.
Montulli
,
L. T.
,
1986
, “
Lessons Learned From the B-52 Program Evolution: Past, Present, and Future
,”
Dayton, OH
.
12.
Nembhard
,
H. B.
, and
Aktan
,
M.
,
2010
,
Real Options in Engineering Design, Operations, and Management
,
Taylor and Francis
,
CRC Press, Boca Raton, FL
.
13.
MacCormack
,
A.
, and
Herman
,
K.
,
2001
,
The Rise and Fall of Iridium
,
Harvard Business School
,
Cambridge, MA
.
14.
Hesseldahl
,
A.
,
2001
, “
The Return of Iridium
,” http://www.forbes.com/2001/11/30/1130tentech.html
15.
de Weck
,
O. L.
,
de Neufville
,
R.
, and
Chaize
,
M.
,
2004
, “
Staged Deployment of Communications Satellite Constellations in Low Earth Orbit
,”
J. Aerosp. Comput., Inf., Commun.
,
1
, pp.
119
136
.10.2514/1.6346
16.
Tomiyama
,
T.
,
Gu
,
P.
,
Jin
,
Y.
,
Lutters
,
D.
,
Kind
,
C.
, and
Kimura
,
F.
,
2009
, “
Design Methodologies: Industrial and Educational Applications
,”
CIRP Ann.
,
58
, pp.
543
565
.10.1016/j.cirp.2009.09.003
17.
Ferguson
,
S.
,
Siddiqi
,
A.
,
Lewis
,
K.
, and
de Weck
,
O. L.
,
2007
, “
Flexible and Reconfigurable Systems: Nomenclature and Review
,”
ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
IDETC/CIE
,
Las Vegas, NV
.
18.
Sethi
,
A. K.
, and
Sethi
,
S. P.
,
1990
, “
Flexibility in Manufacturing: A Survey
,”
Int. J. Flexible Manuf. Syst.
,
2
, pp.
289
328
.10.1007/BF00186471
19.
Saleh
,
J. H.
,
Mark
,
G.
, and
Jordan
,
N. C.
,
2008
, “
Flexibility: A Multi-Disciplinary Literature Review and a Research Agenda for Designing Flexible Engineering Systems
,”
J. Eng. Des.
,
1
, pp.
1
17
.10.1080/09544820701870813
20.
DeLaurentis
,
D. A.
, and
Crossley
,
W. A.
,
2005
, “
A Taxonomy-Based Perspective for Systems of Systems Design Methods
,”
IEEE System, Man, and Cybernetics Conference
,
Hawaii, HI
.
21.
Eckert
,
C. M.
,
de Weck
,
O. L.
,
Keller
,
R.
, and
Clarkson
,
P. J.
,
2009
, “
Engineering Change: Drivers, Sources and Approaches in Industry
,”
17th International Conference on Engineering Design
,
Stanford, CA
, pp.
47
58
.
22.
Nilchiani
,
R.
, and
Hastings
,
D. E.
,
2007
, “
Measuring the Value of Flexibility in Space Systems: A Six-Element Framework
,”
Syst. Eng.
,
10
(
1
), pp.
26
44
.10.1002/sys.20062
23.
Rajan
,
P. K.
,
Wie
,
M. V.
,
Campbell
,
M. I.
,
Wood
,
K. L.
, and
Otto
,
K. N.
,
2005
, “
An Empirical Foundation for Product Flexibility
,”
Des. Stud.
,
26
(
4
), pp.
405
438
.10.1016/j.destud.2004.09.007
24.
Mun
,
J.
,
2006
,
Real Options Analysis: Tools and Techniques for Valuing Strategic Investments and Decisions
,
John Wiley and Sons
,
Hoboken, NJ
.
25.
Dixit
,
A. K.
, and
Pindyck
,
R. S.
,
1994
,
Investment Under Uncertainty
,
Princeton University
,
NJ
.
26.
Cardin
,
M.-A.
,
Nuttall
,
W. J.
,
de Neufville
,
R.
, and
Dahlgren
,
J.
,
2007
, “
Extracting Value From Uncertainty: A Methodology for Engineering Systems Design
,”
17th Symposium of the International Council on Systems Engineering
,
San Diego, CA
.
27.
Silver
,
M. R.
, and
de Weck
,
O. L.
,
2007
, “
Time-Expanded Decision Networks: A Framework for Designing Evolvable Complex Systems
,”
Syst. Eng.
,
10
(
2
), pp.
167
186
.10.1002/sys.20069
28.
Suh
,
E. S.
,
de Weck
,
O. L.
, and
Chang
,
D.
,
2007
, “
Flexible Product Platforms: Framework and Case Study
,”
Res. Eng. Des.
,
18
, pp.
67
89
.10.1007/s00163-007-0032-z
29.
Warr
,
A.
, and
O'Neill
,
E.
,
2005
, “
Understanding Design as a Social Creative Process
,”
Proceedings of the 5th Conference on Creativity and Cognition
,
London, United Kingdom
, pp.
118
127
.
30.
Minai
,
A. A.
,
Braha
,
D.
, and
Bar-Yam
,
Y.
,
2006
, “
Complex Engineered Systems: A New Paradigm
,”
Complex Engineered Systems: Science Meets Technology
,
A. A.
Minai
,
D.
Braha
, and
Y.
Bar-Yam
, eds.,
Springer
,
Netherlands
.
31.
Pahl
,
G.
,
Beitz
,
W.
,
Feldhusen
,
J.
, and
Grote
,
K.-H.
,
2007
,
Engineering Design: A Systematic Approach
,
Springer-Verlag
,
London, United Kingdom
.
32.
Suh
,
N. P.
,
1990
,
The Principles of Design
,
Oxford University
,
United Kingdom
.
33.
Womack
,
J. P.
,
Jones
,
D. T.
, and
Roos
,
D.
,
1991
,
The Machine that Changed the World: The Story of Lean Production
,
Free Press
,
New York, NY
.
34.
Hatchuel
,
A.
, and
Weil
,
B.
,
2009
, “
C-K Design Theory: An Advanced Formulation
,”
Res. Eng. Des.
,
19
(
4
), pp.
181
192
.10.1007/s00163-008-0043-4
35.
Kurtoglu
,
T.
,
Tumer
,
I. Y.
, and
Jensen
,
D. C.
,
2010
, “
A Functional Failure Reasoning Methodology for Evaluation of Conceptual System Architectures
,”
Res. Eng. Des.
,
21
, pp.
209
234
.10.1007/s00163-010-0086-1
36.
Coatanéa
,
E.
,
Nonsiri
,
S.
,
Ritola
,
T.
,
Tumer
,
I. Y.
, and
Jensen
,
D. C.
,
2011
, “
A Framework for Building Dimensionless Behavioral Models to Aid in Function-Based Failure Propagation Analysis
,”
J. Mech. Des.
,
133
, pp.
1
13
.
37.
Moullec
,
M.-L.
,
Bouissou
,
M.
,
Jankovic
,
M.
,
Bocquet
,
J.-C.
,
Réquillard
,
F.
,
Maas
,
O.
, and
Forgeot
,
O.
,
2013
, “
Towards System Architecture Generation and Performances Assessment Under Uncertainty Using Bayesian Networks
,”
ASME J. Mech. Des.
,
135
(
4
), pp.
1
13
.10.1115/1.4023514
38.
Moullec
,
M.-L.
,
Jankovic
,
M.
,
Bouissou
,
M.
, and
Bocquet
,
J.-C.
,
2012
, “
Product Architectures Generation Under Uncertainty: Comparison Between Two Methods
,”
Proceedings of ASME 2012 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE)
.
39.
de Weck
,
O. L.
, and
Eckert
,
C.
,
2007
, “
A Classification of Uncertainty for Early Product and System Design
,” Massachusetts Institute of Technology, Cambridge, MA.
40.
Halpern
,
J. Y.
,
2003
,
Reasoning About Uncertainty
,
MIT Press
,
Cambridge, MA
.
41.
Shafer
,
G.
,
1976
,
A Mathematical Theory of Evidence
,
Princeton University
,
NJ
.
42.
Dempster
,
A. P.
,
1967
, “
Upper and Lower Probabilities Induced by a Multivalued Mapping
,”
Ann. Math. Stat.
,
38
(
2
), pp.
325
339
.10.1214/aoms/1177698950
43.
Zadeh
,
L.
,
1978
, “
Fuzzy Sets as the Basis for a Theory of Possibility
,”
Fuzzy Sets Syst.
,
1
, pp.
3
28
.10.1016/0165-0114(78)90029-5
44.
Cox
,
J. C.
,
Ross
,
S. A.
, and
Rubinstein
,
M.
,
1979
, “
Options Pricing: A Simplified Approach
,”
J. Financ. Econ.
,
7
(
3
), pp.
229
263
.10.1016/0304-405X(79)90015-1
45.
Helmer-Hirschberg
,
O.
,
1967
, “
Analysis of the Future: The Delphi Method
,” RAND Corporation.
46.
Morgan
,
M. G.
, and
Henrion
,
M.
,
1990
,
Uncertainty: A Guide to Dealing With Uncertainty in Quantitative Risk and Policy Analysis
,
Cambridge University
,
United Kingdom
.
47.
Clemen
,
R. T.
, and
Winkler
,
R. L.
,
1999
, “
Combining Probability Distributions From Experts in Risk Analysis
,”
Risk Anal.
,
19
(
2
), pp.
187
203
.
48.
Copeland
,
T.
, and
Antikarov
,
V.
,
2003
,
Real Options: A Practitioner's Guide
,
Thomson Texere
,
New York, NY
.
49.
Cardin
,
M.-A.
, and
de Neufville
,
R.
,
2009
, “
A Direct Interaction Approach to Identify Real Options ‘In’ Large-Scale Infrastructure Systems
,”
Real Options Conference
,
Braga (Portugal), Santiago (Spain)
.
50.
Engel
,
A.
, and
Browning
,
T. R.
,
2008
, “
Designing Systems for Adaptability by Means of Architecture Options
,”
Syst. Eng.
,
11
, pp.
125
146
.10.1002/sys.20090
51.
Cardin
,
M.-A.
,
Kolfschoten
,
G. L.
,
Frey
,
D. D.
,
Neufville
,
R.
,
Weck
,
O. L.
, and
Geltner
,
D. M.
,
2013
, “
Empirical Evaluation of Procedures to Generate Flexibility in Engineering Systems and Improve Lifecycle Performance
,”
Res. Eng. Des.
,
24
(
3
), pp.
277
295
.10.1007/s00163-012-0145-x
52.
Nunamaker
,
J. F.
,
Briggs
,
R. O.
,
Mittleman
,
D. D.
,
Vogel
,
D. R.
, and
Balthazard
,
P. A.
,
1997
, “
Lessons From a Dozen Years of Group Support Systems Research: A Discussion of Lab and Field Findings
,”
J. Manage. Inf. Syst.
,
13
(
3
), pp.
163
207
.
53.
Gil
,
N.
,
2007
, “
On the Value of Project Safeguards: Embedding Real Options in Complex Products and Systems
,”
Res. Policy
,
36
, pp.
980
999
.10.1016/j.respol.2007.03.004
54.
Keese
,
D.
,
Seepersad
,
C. C.
, and
Wood
,
K. L.
,
2009
, “
Product Flexibility Measurement With Enhanced Change Modes and Effects Analysis (CMEA)
,”
Int. J. Mass Customisation
,
3
(
2
), pp.
115
145
.10.1504/IJMASSC.2009.023379
55.
Oureshi
,
A.
,
Murphy
,
J. T.
,
Kuchinsky
,
B.
,
Seepersad
,
C. C.
,
Wood
,
K. L.
, and
Jensen
,
D. D.
, “
Principles of Product Flexibility
,”
Proceedings of ASME IDETC/CIE Advances in Design Automation Conference
.
56.
Steward
,
D. V.
,
1981
, “
The Design Structure System: A Method for Managing the Design of Complex Systems
,”
IEEE Trans. Eng. Manage.
,
28
, pp.
71
74
.10.1109/TEM.1981.6448589
57.
Browning
,
T. R.
,
2001
, “
Applying the Design Structure Matrix to System Decomposition and Integration Problems: A Review and New Directions
,”
IEEE Trans. Eng. Manage.
,
48
(
3
), pp.
292
306
.10.1109/17.946528
58.
Giffin
,
M.
,
de Weck
,
O. L.
,
Bounova
,
G.
,
Keller
,
R.
,
Eckert
,
C.
, and
Clarkson
,
J.
,
2009
, “
Change Propagation Analysis in Complex Technical Systems
,”
ASME J. Mech. Des.
,
131
(
8
), pp.
1
14
.10.1115/1.3149847
59.
Hu
,
J.
,
2013
, “
Flexible Engineering System Design with Multiple Exogenous Uncertainties and Change Propagation
,” Doctoral Dissertation in Industrial and Systems Engineering,
National University of Singapore
.
60.
Koh
,
E. C. Y.
,
Caldwell
,
N. H. M.
, and
Clarkson
,
P. J.
,
2013
, “
A Technique to Assess the Changeability of Complex Engineering Systems
,”
J. Eng. Design
,
24
(
7
), pp.
477
498
.10.1080/09544828.2013.769207
61.
Kalligeros
,
K.
,
2006
, “
Platforms and Real Options in Large-Scale Engineering Systems
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
62.
Bartolomei
,
J. E.
,
Hastings
,
D. E.
,
de Neufville
,
R.
, and
Rhodes
,
D. H.
,
2012
, “
Engineering Systems Multiple-Domain Matrix: An Organizing Framework for Modeling Large-Scale Complex Systems
,”
Syst. Eng.
,
15
(
1
), pp.
41
61
.10.1002/sys.20193
63.
Wilds
,
J.
,
2008
, “
A Methodology for Identifying Flexible Design Opportunities
,” M.S. thesis in Technology and Policy,
Massachusetts Institute of Technology
,
Cambridge, MA
.
64.
Mikaelian
,
T.
,
Rhodes
,
D. H.
,
Nightingale
,
D. J.
, and
Hastings
,
D. E.
,
2012
, “
A Logical Approach to Real Options Identification With Application to UAV Systems
,”
IEEE Trans. Syst. Man Cybern.
,
42
(
1
), pp.
32
47
.10.1109/TSMCA.2011.2157133
65.
Wang
,
T.
,
2005
, “
Real Options in Projects and Systems Design—Identification of Options and Solutions for Path Dependency
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
66.
Gil
,
N.
, and
Tether
,
B. S.
,
2011
, “
Project Risk Management and Design Flexibility: Analysing a Case and Conditions of Complementarity
,”
Res. Policy
,
40
(
3
), pp.
415
428
.10.1016/j.respol.2010.10.011
67.
Tilstra
,
A. H.
,
Seepersad
,
C. C.
, and
Wood
,
K. L.
, “
Analysis of Product Flexibility for Future Evolution Based on Design Guidelines and a High-Definition Design Structure Matrix
,”
Proceedings of the ASME 2009 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2009, August 30 – September 2, 2009, San Diego, CA
.
68.
Tilstra
,
A. H.
,
Backlund
,
P. B.
,
Seepersad
,
C. C.
, and
Wood
,
K. L.
,
2008
, “
Industrial Case Studies in Product Flexibility for Future Evolution: An Application and Evaluation of Design Guidelines
,”
Proceedings of IDETC/CIE 2008 ASME 2008 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, DETC2008/49370, August 3–6, 2008, New York
.
69.
Keese
,
D. A.
,
Tilstra
,
A. H.
,
Seepersad
,
C. C.
, and
Wood
,
K. L.
,
2007
, “
Empirically-Derived Principles for Designing Products with Flexibility for Future Evolution
,”
Proceedings of IDETC/CIE 2007 ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, DETC2007-35695, September 4–7, 2007, Las Vegas, NV
.
70.
Bellman
,
R.
,
1952
, “
On the Theory of Dynamic Programming
,”
Proceedings of the National Academy of Sciences of the United States of America
,
Santa Monica, CA
pp.
716
719
.
71.
Babajide
,
A.
,
de Neufville
,
R.
, and
Cardin
,
M.-A.
,
2009
, “
Integrated Method for Designing Valuable Flexibility in Oil Development Projects
,”
SPE Proj., Facil., Constr.
,
4
, pp.
3
12
.
72.
Cardin
,
M.-A.
,
Steer
,
S. J.
,
Nuttall
,
W. J.
,
Parks
,
G. T.
,
Gonçalves
,
L. V. N.
, and
de Neufville
,
R.
,
2012
, “
Minimizing the Economic Cost and Risk to Accelerator-Driven Subcritical Reactor Technology: The Case of Designing for Flexibility: Part 2
,”
Nucl. Eng. Des.
,
243
, pp.
120
134
.10.1016/j.nucengdes.2011.11.026
73.
Black
,
F.
, and
Scholes
,
M.
,
1973
, “
The Pricing of Options and Corporate Liabilities
,”
J. Polit. Econ.
,
81
(
3
), pp.
637
654
.10.1086/260062
74.
de Neufville
,
R.
,
2008
, “
Lecture Notes and Exercises in ESD.71: Engineering Systems Analysis for Design
,” Massachusetts Institute of Technology, Cambridge, MA.
75.
Simon
,
H. A.
,
1960
,
The New Science of Management Decision
,
Harper and Row
,
New York, NY
.
76.
Hazelrigg
,
G. A.
,
1998
, “
A Framework for Decision-Based Engineering Design
,”
ASME J. Mech. Des.
,
120
, pp.
653
658
.10.1115/1.2829328
77.
Olewnik
,
A.
,
Brauen
,
T.
,
Ferguson
,
S.
, and
Lewis
,
K.
,
2001
, “
A Framework for Flexible Systems and Its Implementation in Multi-Attribute Decision-Making
,”
ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Pittsburgh, PA
.
78.
Olewnik
,
A.
, and
Lewis
,
K.
,
2006
, “
A Decision Support Framework for Flexible System Design
,”
J. Eng. Design
,
17
(
1
), pp.
75
97
.10.1080/09544820500274019
79.
Ross
,
A.
,
2006
, “
Managing Unarticulated Value: Changeability in Multi-Attribute Tradespace Exploration
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
80.
Hu
,
J.
, and
Poh
,
K. L.
,
2010
, “
Pareto Set-Based Concept Modeling and Selection for Large-Scale Systems
,”
4th Asia-Pacific Conference on Systems Engineering
,
Keelung, Taiwan
.
81.
Richards
,
M. G.
,
Ross
,
A. M.
,
Shah
,
N. B.
, and
Hastings
,
D. E.
,
2008
, “
Metrics for Evaluating Survivability in Dynamic Multi-Attribute Tradespace Exploration
,”
J. Spacecr. Rockets
,
46
(
5
), pp.
1049
1064
.10.2514/1.41433
82.
Ross
,
A.
,
Hastings
,
D. E.
, and
Warmkessel
,
J. M.
,
2004
, “
Multi-Attribute Tradespace Exploration as Front End for Effective Space System Design
,”
J. Spacecr. Rockets
,
41
(
1
), pp.
20
28
.10.2514/1.9204
83.
Jacoby
,
H.
, and
Loucks
,
D.
,
1972
, “
The Combined Use of Optimization and Simulation Models in River Basin Planning
,”
Water Resour. Res.
,
8
(
6
), pp.
1401
1414
.10.1029/WR008i006p01401
84.
Lin
,
J.
,
2009
, “
Exploring Flexible Strategies in Engineering Systems Using Screening Models – Applications to Offshore Petroleum Projects
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
85.
i
Yang
,
Y.
,
2009
, “
A Screening Model to Explore Planning Decisions in Automotive Manufacturing Systems Under Demand Uncertainty
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
86.
Sterman
,
J. D.
,
2000
,
Business Dynamics: Systems Thinking and Modeling for a Complex World
,
McGraw-Hill/Irwin
,
Boston, MA
.
87.
Hassan
,
R.
, and
de Neufville
,
R.
,
2006
, “
Design of Engineering Systems Under Uncertainty Via Real Options and Heuristic Optimization
,”
Real Options Conference
,
New York, NY
.
88.
Buurman
,
J.
,
Zhang
,
S. X.
, and
Babovic
,
V.
,
2009
, “
Reducing Risk Through Real Options in Systems Design: The Case of Architecting a Maritime Domain Protection System
,”
Risk Anal.
,
29
(
3
), pp.
366
379
.10.1111/j.1539-6924.2008.01160.x
89.
Taneja
,
P.
,
Aartsen
,
M. E.
,
Annema
,
J. A.
, and
van Schuylenburg
,
M.
,
2010
, “
Real Options for Port Infrastructure Investments
,”
Third Conference on Infrastructure Systems and Services: Next Generation Infrastructure Systems for Eco-Cities
,
Shenzhen, China
, pp.
1
6
.
90.
Zhang
,
S. X.
, and
Babovic
,
V.
,
2012
, “
A Real Options Approach to the Design and Architecture of Water Supply Systems Using Innovative Water Technologies Under Uncertainty
,”
J. Hydrodyn.
,
14
(
1
), pp.
13
29
.
91.
Cardin
,
M.-A.
, and
de Neufville
,
R.
,
2013
, “
Design Catalogues: An Efficient Search Approach for Improved Flexibility in Engineering Systems Design
,” 23rd Symposium of the International Council on Systems Engineering, Phiadelphia, PA.
92.
Cardin
,
M.-A.
,
de Neufville
,
R.
, and
Kazakidis
,
V.
,
2008
, “
A Process to Improve Expected Value in Mining Operations
,”
Min. Technol.
,
117
(
2
), pp.
65
70
.10.1179/174328608X362631
93.
Frey
,
D. D.
, and
Wang
,
H.
,
2006
, “
Adaptive One-Factor-at-a-Time Experimentation and Expected Value of Improvement
,”
Technometrics
,
48
(
3
), pp.
418
431
.10.1198/004017006000000075
94.
Keeney
,
R. L.
,
2009
, “
The Foundations of Collaborative Group Decision
,”
Int. J. Collaborative Eng.
,
1
(
1–2
), pp.
4
18
.10.1504/IJCE.2009.027438
95.
Frey
,
D. D.
,
Herder
,
P. M.
,
Wijnia
,
Y.
,
Subrahmanian
,
E.
,
Katsikopoulos
,
K.
,
de Neufville
,
R.
,
Oye
,
K.
, and
Clausing
,
D. P.
,
2010
, “
Research in Engineering Design: The Role of Mathematical Theory and Empirical Evidence
,”
Res. Eng. Des.
,
21
, pp.
145
151
.10.1007/s00163-010-0085-2
96.
Murman
,
E. M.
,
Allen
,
T.
,
Bozdogan
,
K.
,
Cutcher-Gershenfeld
,
J.
,
McManus
,
H.
,
Nightingale
,
D. J.
,
Rebentisch
,
E.
,
Shields
,
T.
,
Stahl
,
F.
,
Walton
,
M.
,
Warmkessel
,
J.
,
Weiss
,
S.
, and
Widnall
,
S.
,
2002
,
Lean Enterprise Value: Insights from MIT's Lean Aerospace Initiative
,
Palgrave
,
New York, NY
.
97.
de Vreede
,
G.-J.
, and
Briggs
,
R. O.
,
2005
, “
Collaboration Engineering: Designing Repeatable Processes for High-Value Collaborative Tasks
,”
Proceedings of the 38th Annual Hawaii International Conference on System Sciences
,
IEEE Computer Society
,
Big Island, HI
.
98.
Mullen
,
B.
,
Johnson
,
C.
, and
Salas
,
E.
,
1991
, “
Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration
,”
Basic Appl. Soc. Psychol.
,
12
(
1
), pp.
3
23
.10.1207/s15324834basp1201_1
99.
de Vreede
,
G.-J.
,
Vogel
,
D.
,
Kolfschoten
,
G.
, and
Wien
,
J.
,
2003
, “
Fifteen Years of GSS in the Field: A Comparison Across Time and National Boundaries
,”
36th Annual Hawaii International Conference on System Sciences
,
IEEE Computer Society
,
Big Island, HI
, p.
9a
.
100.
Smit
,
H. T. J.
, and
Trigeorgis
,
L.
,
2009
, “
Valuing Infrastructure Investment: An Option Games Approach
,”
Calif. Manage. Rev.
,
51
(
2
), pp.
79
100
.10.2307/41166481
101.
Smit
,
H. T. J.
,
2001
, “
Acquisition Strategies as Option Games
,”
J. Appl. Corporate Finance
,
14
(
2
), pp.
79
89
.10.1111/j.1745-6622.2001.tb00332.x
102.
Ferreira
,
N.
,
Kar
,
J.
, and
Trigeorgis
,
L.
,
2009
,
Option Games: The Key to Competing in Capital-Intensive Industries
,”
Harv. Bus. Rev.
,
87
(3), pp.
101
107
.
103.
Ligtvoet
,
A.
, and
Herder
,
P. M.
,
2012
, “
Simulation and Gaming for Understanding the Complexity of Cooperation in Industrial Networks
,”
2nd International Conference on Complex Systems Design and Management
,
O.
Hammami
,
D.
Krob
,
J.-L.
Voirin
, eds.,
Springer-Verlag
,
Berlin, Heidelberg, Germany
.
104.
Mayer
, I
. S.
,
2009
, “
The Gaming of Policy and the Politics of Gaming: A Review
,”
Simul. Gaming
,
40
(
6
), pp.
825
862
.10.1177/1046878109346456
105.
Faria
,
A.
,
Hutchinson
,
D.
,
Wellington
,
W. J.
, and
Gold
,
S.
,
2009
, “
Developments in Business Gaming: A Review of the Past 40 Years
,”
Simul. Gaming
,
40
(
4
), pp.
464
487
.10.1177/1046878108327585
106.
Sterman
,
J. D.
,
1989
, “
Modeling Managerial Behavior: Misperceptions Of Feedback In a Dynamic Decision Making Experiment
,”
Manage. Sci.
,
35
(
3
), pp.
321
339
.10.1287/mnsc.35.3.321
107.
Cardin
,
M.-A.
,
Yue
,
H. K. H.
,
Fu
,
H.
,
Tang
,
L. C.
,
Jiang
,
Y.
,
Zhang
,
S.
, and
Huang
,
B.
,
2013
, “
Simulation Gaming to Study Design and Management Decision-Making in Flexible Engineering Systems
,”
IEEE International Conference on Systems, Man, and Cybernetics
,
Manchester, United Kingdom
.
108.
Frey
,
D. D.
, and
Dym
,
C. L.
,
2006
, “
Validation of Design Methods: Lessons From Medicine
,”
Res. Eng. Des.
,
17
, pp.
45
57
.10.1007/s00163-006-0016-4
109.
Shah
,
J. J.
,
Kulkarni
,
S. V.
, and
Vargas-Hernandez
,
N.
,
2000
, “
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,”
ASME J. Mech. Des.
,
122
, pp.
377
384
.10.1115/1.1315592
110.
Nelson
,
B. A.
,
Wilson
,
J. O.
, and
Rosen
,
D.
,
2009
, “
Refined Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
30
, pp.
737
743
.10.1016/j.destud.2009.07.002
111.
Pugh
,
S.
,
1991
,
Total Design: Integrated Methods for Successful Product Engineering
,
Prentice Hall
,
New York, NY
.
112.
Krige
,
D. G.
,
1951
, “
A Statistical Approach to Some Basic Mine Valuation Problems on the Witwatersrand
,”
J. Chem., Metall. Min. Soc.
,
52
, pp.
119
139
.
113.
McConnell
,
J.
,
2007
, “
A Life-Cycle Flexibility Framework for Designing, Evaluating and Managing “Complex” Real Options: Case Studies in Urban Transportation and Aircraft Systems
,” Doctoral Dissertation in Engineering Systems,
Massachusetts Institute of Technology
,
Cambridge, MA
.
114.
de Neufville
,
R.
,
Lee
,
Y. S.
, and
Scholtes
,
S.
,
2008
, “
Flexibility in Hospital Infrastructure Design
,”
IEEE Conference on Infrastructure Systems
,
Rotterdam, Netherlands
.
You do not currently have access to this content.