Abstract

This study offers insight into the processes of expert designers at the Jet Propulsion Laboratory (JPL) and how they use heuristics in the design process. A methodology for the extraction, classification, and characterization of heuristics is presented. Ten expert participants were interviewed to identify design heuristics used during early stage space mission design at JPL. In total, 101 heuristics were obtained, classified, and characterized. The use of interviews to extract heuristics allowed for researchers to confirm that those heuristics were indeed used by designers. Through the use of post-interview surveys, participants characterized heuristics based on attributes including source/origin, applicability based on concept maturity, frequency of use, reliability, and tendency to evolve. These findings are presented, and statistically significant correlations were found between the participant perceptions of frequency of use, reliability, and evolution of a heuristic. A positive correlation was found between frequency of use and reliability while negative correlations were found between frequency of use and evolution, and reliability and evolution. Survey results and analysis aim to identify valid attributes for assessing the applicability and value of multiple heuristics for design practice in early space mission formulation.

References

1.
Lewis
,
K. E.
,
Chen
,
W.
, and
Schmidt
,
L. C.
,
2006
,
Decision Making in Engineering Design
,
ASME
,
New York, NY
.
2.
von Neumann
,
J.
, and
Morgenstern
,
O.
,
2004
,
Theory of Games and Economic Behavior
, 60th ed. (Princeton Class Editions),
Princeton University Press
,
Princeton, NJ
.
3.
Lee
,
B. D.
, and
Paredis
,
C. J. J.
,
2014
, “
A Conceptual Framework for Value-Driven Design and Systems Engineering
,”
24th CIRP Design Conference: Mass Customization and Personalization
, Vol.
21
,
Milano, Italy
,
Apr. 14–16
, pp.
10
17
.
4.
Gigerenzer
,
G.
,
Todd
,
P. M.
, and
ABC Research Group
,
1999
,
Simple Heuristics That Make Us Smart
,
Oxford University Press
,
New York
.
5.
Simon
,
H. A.
,
1979
, “
Rational Decision Making in Business Organizations
,”
Am. Econ. Rev.
,
69
(
4
), pp.
493
515
.
6.
Tversky
,
A.
, and
Kahneman
,
D.
,
1974
, “
Judgement Under Uncertainty: Heuristics and Biases
,”
Science
,
185
(
4157
), pp.
1124
1131
. 10.1126/science.185.4157.1124
7.
Koen
,
B. V.
,
1985
,
Definition of the Engineering Method
,
American Society for Engineering Education
,
Washington, DC
.
8.
Binder
,
W. R.
, and
Paredis
,
C. J. J.
,
2017
, “
Optimization Under Uncertainty Versus Algebraic Heuristics: A Research Method for Comparing Computational Design Methods
,”
ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Cleveland, OH
,
Aug. 6–9
, pp.
1
10
.
9.
Collopy
,
P. D.
, and
Hollingsworth
,
P. M.
,
2011
, “
Value-Driven Design
,”
J. Aircr.
,
48
(
3
), pp.
749
759
. 10.2514/1.C000311
10.
Sage
,
A. P.
, and
Armstrong
,
J. E.
, Jr.
,
2000
,
Introduction to Systems Engineering (Wiley Series in Systems Engineering)
,
John Wiley & Sons, Inc.
,
New York
.
11.
Fu
,
K. K.
,
Yang
,
M. C.
, and
Wood
,
K. L.
,
2016
, “
Design Principles: Literature Review, Analysis, and Future Directions
,”
ASME J. Mech. Des.
,
138
(
10
), p.
101103
. doi:10.1115/1.4034105
12.
Daly
,
S. R.
,
Yilmaz
,
S.
,
Christian
,
J. L.
,
Seifert
,
C. M.
, and
Gonzalez
,
R.
,
2012
, “
Design Heuristics in Engineering Concept Generation
,”
J. Eng. Educ.
,
101
(
4
), pp.
601
629
. 10.1002/j.2168-9830.2012.tb01121.x
13.
Yilmaz
,
S.
,
Daly
,
S. R.
,
Seifert
,
C. M.
, and
Gonzalez
,
R.
,
2014
, “
How Do Designers Generate New Ideas? Design Heuristics Across Two Disciplines
,”
Des. Sci.
,
1
(
4
), pp.
1
29
.
14.
Daly
,
S.
,
Yilmaz
,
S.
,
Seifert
,
C.
, and
Gonzalez
,
R.
,
2010
, “
Cognitive Heuristic Use in Engineering Design Ideation
,”
2010 Annual Conference & Exposition
,
Louisville, KY
,
June 20
, ASEE Conferences, pp.
1
25
.
15.
Yilmaz
,
S.
,
Daly
,
S. R.
,
Seifert
,
C. M.
, and
Gonzalez
,
R.
,
2011
, “
A Comparison of Cognitive Heuristics Use Between Engineers and Industrial Designers
,”
4th International Conference on Design Computing and Cognition '10
,
Stuttgart, Germany
,
July 12–14
, pp.
3
22
.
16.
Yilmaz
,
S.
, and
Seifert
,
C. M.
,
2011
, “
Creativity Through Design Heuristics: A Case Study of Expert Product Design
,”
Des. Stud.
,
32
(
4
), pp.
384
415
. 10.1016/j.destud.2011.01.003
17.
Yilmaz
,
S.
,
Seifert
,
C.
,
Daly
,
S. R.
, and
Gonzalez
,
R.
,
2016
, “
Design Heuristics in Innovative Products
,”
ASME J. Mech. Des.
,
138
(
7
), p.
071102
. 10.1115/1.4032219
18.
Yilmaz
,
S.
, and
Daly
,
S. R.
,
2016
, “
Evidence-Based Design Heuristics for Idea Generation
,”
Des. Stud.
,
46
, pp.
95
124
. 10.1016/j.destud.2016.05.001
19.
Campbell
,
R. D.
,
Lewis
,
P. K.
, and
Mattson
,
C. A.
,
2011
, “
A Method for Identifying Design Principles For the Developing World
,”
ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Washington, DC
,
Aug. 28–31
, pp.
1
8
.
20.
Qureshi
,
A.
,
Murphy
,
J. T.
,
Kuchinsky
,
B.
,
Seepersad
,
C. C.
,
Wood
,
K. L.
, and
Jenson
,
D. D.
,
2006
, “
Principles of Product Flexibility
,”
ASME 2006 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Philadelphia, PA
,
Sept. 10–13
, pp.
1
31
.
21.
Keese
,
D. A.
,
Tilstra
,
A. H.
,
Seepersad
,
C. C.
, and
Wood
,
K. L.
,
2007
, “
Empirically-Derived Principles for Designing Products With Flexibility for Future Evolution
,”
ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Las Vegas, NV
,
Sept. 4–7
.
22.
Telenko
,
C.
, and
Seepersad
,
C. C.
,
2010
, “
A Methodology for Identifying Environmentally Conscious Guidelines for Product Design
,”
ASME J. Mech. Des.
,
132
(
9
), pp.
1
9
. 10.1115/1.4002145
23.
McComb
,
C.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2017
, “
Mining Process Heuristics From Designer Action Data Via Hidden Markov Models
,”
ASME J. Mech. Des.
,
139
(
11
), pp.
1
12
.
24.
Maccoby
,
E. E.
, and
Maccoby
,
N.
,
1954
, “The Interview: A Tool of Social Science,”
Handbook of Social Psychology
,
G.
Lindzey
, ed.,
Addison-Wesley
,
Cambridge, MA
, pp.
449
487
.
25.
Brinkmann
,
S.
,
2017
, “The Interview,”
The SAGE Handbook of Qualitative Research
, 5th ed.,
N. K.
Denzin
,
Y. S.
Lincoln
, eds.,
SAGE
,
Los Angeles, CA
, pp.
576
600
.
26.
Brinkmann
,
S.
, and
Kvale
,
S.
,
2015
,
InterViews: Learning the Craft of Qualitative Research Interviewing
, 3rd ed.,
Sage
,
Thousand Oaks, CA
.
27.
Gillham
,
B.
,
2000
,
Case Study Research Methods
, 1st ed. (
Continuum Research Methods Series
),
Bloomsbury Publishing PLC
,
London
.
28.
Saldana
,
J.
,
2011
,
Fundamentals of Qualitative Research
,
Oxford University Press, OSO
,
New York, NY
.
29.
Eckert
,
C.
, and
Summers
,
J.
,
2013
, “
Interviewing as a Method for Data Gathering in Engineering Design Research
.”
Clemson University
. https://cecas.clemson.edu/cedar/wp-content/uploads/2016/07/6-2013-06-14-Eckert-Summers-Interviewing-final.pdf
30.
Almefelt
,
L.
,
Berglund
,
F.
,
Nilsson
,
P.
, and
Malmqvist
,
J.
,
2006
, “
Requirements Management in Practice: Findings From an Empirical Study in the Automotive Industry
,”
Res. Eng. Des.
,
17
(
3
), pp.
113
134
. 10.1007/s00163-006-0023-5
31.
Achiche
,
S.
,
Appio
,
F. P.
,
McAloone
,
T. C.
, and
Minin
,
A. D.
,
2013
, “
Fuzzy Decision Support for Tools Selection in the Core Front End Activities of New Product Development
,”
Res. Eng. Des.
,
24
(
1
), pp.
1
18
. 10.1007/s00163-012-0130-4
32.
Creswell
,
J. W.
,
2012
,
Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research
, 4th ed.,
Pearson Education, Inc.
,
Boston, MA
.
33.
Krosnick
,
J. A.
, and
Presser
,
S.
,
2010
, “Question and Questionnaire Design,”
Handbook of Survey Research
, 2nd ed,
P. V.
Marsden
,
J. D.
Wright
, eds.,
Emerald Group Publishing Limited
,
Bingley, UK
, pp.
264
313
.
34.
Singh
,
V.
,
Skiles
,
S. M.
,
Krager
,
J. E.
, and
Wood
,
K. L.
,
2006
, “
Innovations in Design Through Transformations: A Fundamental Study of Transformation Principles
,”
ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Philadelphia, PA
,
Sept. 10–13
, pp.
1
14
.
35.
Moe
,
R. E.
,
Jenson
,
D. D.
, and
Wood
,
K. L.
,
2004
, “
Prototype Partitioning Based on Requirement Flexibility
,”
ASME 2004 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Salt Lake City, UT
,
Sept. 28–Oct. 2
, pp.
1
13
.
36.
Lee
,
B.
,
Fillingim
,
K. B.
,
Binder
,
W. R.
,
Fu
,
K.
, and
Paredis
,
C. J. J.
,
2017
, “
Design Heuristics: A Conceptual Framework and Preliminary Method for Extraction
,”
Paper Presented at the ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Cleveland, OH
,
Aug. 6–9
, pp.
1
10
.
37.
Pahl
,
G.
,
Beitz
,
W.
,
Feldhusen
,
J.
, and
Grote
,
K. H.
,
2007
,
Engineering Design: A Systematic Approach
, 3rd ed.,
Springer
,
New York
.
38.
Telenko
,
C.
,
O’Rourke
,
J. M.
,
Seepersad
,
C. C.
, and
Webber
,
M. E.
,
2016
, “
A Compilation of Design for Environment Guidelines
,”
ASME J. Mech. Des.
,
138
(
3
), pp.
1
11
. 10.1115/1.4032095
39.
Reap
,
J.
, and
Bras
,
B.
,
2014
, “
A Method of Finding Biologically Inspired Guidelines for Environmentally Benign Design and Manufacturing
,”
ASME J. Mech. Des.
,
136
(
11
), pp.
1
11
. 10.1115/1.4028303
40.
Goulding
,
C.
,
2002
,
Grounded Theory: A Practical Guide for Management, Business, and Market Researchers
, 1st ed.,
Sage Publications Inc.
,
Thousand Oaks, CA
.
41.
Sherwood
,
B.
, and
McCleese
,
D.
,
2013
, “
JPL Innovation Foundry
,”
Acta Astronaut.
,
89
, pp.
236
247
. 10.1016/j.actaastro.2013.04.020
42.
Leising
,
C. J.
,
Sherwood
,
B.
,
Adler
,
M.
,
Wessen
,
R. R.
, and
Naderi
,
F. M.
,
2010
, “
Recent Improvements in JPL’s Mission Formulation Process
,”
Paper Presented at the IEEE Aerospace Conference
,
Big Sky, MT
,
Mar. 6–13
, pp.
1
12
.
43.
Wessen
,
R. R.
,
Adler
,
M.
,
Leising
,
C. J.
, and
Sherwood
,
B.
,
2009
, “
Measuring the Maturity of Robotic Planetary Mission Concepts
,”
Paper Presented at the AIAA SPACE 2009 Conference & Exposition
,
Pasadena, CA
,
Sept. 14–17
, pp.
14
17
.
44.
Wessen
,
R. R.
,
Borden
,
C.
,
Ziemer
,
J.
, and
Kwok
,
J.
,
2013
, “
Space Mission Concept Development Using Concept Maturity Levels
,”
Paper Presented at the AIAA Space 2013 Conference and Exposition
,
San Diego, CA
,
Sept. 10–12
, pp.
1
18
.
45.
Ziemer
,
J. K.
,
Ervin
,
J.
, and
Lang
,
J.
,
2013
, “
Exploring Mission Concepts With the JPL Innovation Foundry A-Team
,”
Paper Presented at the AIAA SPACE 2013 Conference and Exposition
,
San Diego, CA
,
Sept. 10–12
, pp.
1
13
.
46.
Ziemer
,
J. K.
,
Wessen
,
R. R.
, and
Johnson
,
P. V.
,
2016
, “
Exploring the Science Trade Space With the JPL Innovation Foundry A-Team
,”
Paper Presented at the SESCA 2016
,
Madrid, Spain
,
Oct. 5–7
, pp.
1
9
.
47.
Linsey
,
J.
,
Wessen
,
R.
, and
Ziemer
,
J.
,
2016
, “
Observation of a Highly Innovative Group—Directions for Future Research
,”
The Fourth International Conference on Design Creativity
,
Atlanta, GA
,
Nov. 2–4
, pp.
1
9
.
48.
Mills
,
A. J.
,
Durepos
,
G.
, and
Wiebe
,
E.
,
2010
,
Encyclopedia of Case Study Research
,
SAGE Publications, Inc.
,
Thousand Oaks, CA
.
49.
Wertz
,
J. R.
, and
Larson
,
W. J.
,
1999
,
Space Mission Analysis and Design
, 3rd ed.,
Microcosm Press, Kluwer Academic Publishers
,
Dordrecht
.
50.
Fortescue
,
P.
,
Stark
,
J.
, and
Swinerd
,
G.
,
2003
,
Spacecraft Systems Engineering
,
John Wiley & Sons Ltd.
,
Chichester, West Sussex
.
51.
Hauke
,
J.
, and
Kossowski
,
T.
,
2011
, “
Comparison of Values of Pearson’s and Spearman’s Correlation Coefficients on the Same Sets of Data
,”
Quaestiones Geographicae
,
30
(
2
), pp.
87
93
. 10.2478/v10117-011-0021-1
You do not currently have access to this content.