Advances in innovation processes are critically important as economic and business landscapes evolve. There are many concept generation techniques that can assist a designer in the initial phases of design. Unfortunately, few studies have examined these techniques that can provide evidence to suggest which techniques should be preferred or how to implement them in an optimal way. This study systematically investigates the underlying factors of four common and well-documented techniques: brainsketching, gallery, 6-3-5, and C-sketch. These techniques are resolved into their key parameters, and a rigorous factorial experiment is performed to understand how the key parameters affect the outcomes of the techniques. The factors chosen for this study with undergraduate mechanical engineers include how concepts are displayed to participants (all are viewed at once or subsets are exchanged between participants, i.e., “rotational viewing”) and the mode used to communicate ideas (written words only, sketches only, or a combination of written words and sketches). Four metrics are used to evaluate the data: quantity, quality, novelty, and variety. The data suggest that rotational viewing of sets of concepts described using sketches combined with words produces more ideas than having all concepts displayed in a “gallery view” form, but a gallery view results in more high quality concepts. These results suggest that a hybrid of methods should be used to maximize the quality and number of ideas. The study also shows that individuals gain a significant number of ideas from their teammates. Ideas, when shared, can foster new idea tracks, more complete layouts, and a diverse synthesis. Finally, as teams develop more concepts, the quality of the concepts improves. This result is a consequence of the team-sharing environment and, in conjunction with the quantity of ideas, validates the effectiveness of group idea generation. This finding suggests a way to go beyond the observation that some forms of brainstorming can actually hurt productivity.

1.
Römer
,
A.
,
Weißhahn
,
G.
, and
Hacker
,
W.
, 2001, “
Effort-Saving Product Representations in Design—Results of a Questionnaire Survey
,”
Des. Stud.
0142-694X,
22
(
6
), pp.
473
490
.
2.
Adams
,
J. L.
, 1986,
Conceptual Blockbusting
,
Perseus Books
,
Cambridge, MA
.
3.
Vangundy
,
A. B.
, 1988,
Techniques of Structured Problem Solving
,
Van Nostrand Reinhold
,
New York
.
4.
Higgins
,
J. M.
, 1994,
101 Creative Problem Solving Techniques
,
The New Management
,
Winter Park, FL
.
5.
Osborn
,
A.
, 1957,
Applied Imagination
,
Scribner
,
New York
.
6.
Altshuller
,
G. S.
, 1984,
Creativity as an Exact Science
,
Gordon and Breach
,
Luxembourg
.
7.
Lewis
,
A. C.
,
Sadosky
,
T. L.
, and
Connolly
,
T.
, 1975, “
Effectiveness of Group Brainstorming in Engineering Problem Solving
,”
IEEE Trans. Eng. Manage.
0018-9391,
EM-22
(
3
), pp.
119
124
.
8.
Mullen
,
B.
,
Johnson
,
C.
, and
Salas
,
E.
, 1991, “
Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration
,”
Basic Appl. Soc. Psych.
,
12
(
1
), pp.
3
23
.
9.
Collins
,
A. M.
, and
Loftus
,
E. F.
, 1975, “
A Spreading-Activation Theory of Semantic Priming
,”
Psychol. Rev.
0033-295X,
82
, pp.
407
428
.
10.
Anderson
,
J. R.
, 1983, “
A Spreading Activation Theory of Memory
,”
J. Verbal Learn. Verbal Behav.
0022-5371,
22
, pp.
261
295
.
11.
Raaijmakers
,
J. G.
, and
Shiffrin
,
R. M.
, 1981, “
Search of Associative Memory
,”
Psychol. Rev.
0033-295X,
88
(
2
), pp.
93
134
.
12.
Perttula
,
M. K.
, and
Liikkanen
,
L. A.
, 2006, “
Structural Tendencies and Exposure Effects in Design Idea Generation
,”
Proceedings of the ASME Design Engineering Technical Conference
.
13.
Perttula
,
M.
,
Krause
,
C.
, and
Sipila
,
P.
, 2006, “
Does Idea Exchange Promote Productivity in Design Idea Generation?
CoDesign: International Journal of CoCreation in Design and the Arts
1745-3755,
2
(
3
), pp.
125
138
.
14.
Perttula
,
M.
, and
Sipila
,
P.
, 2007, “
The Idea Exposure Paradigm in Design Idea Generation
,”
J. Eng. Design
0954-4828,
18
(
1
), pp.
93
102
.
15.
Gryskiewicz
,
S. S.
, 1988, “
Trial by Fire in an Industrial Setting: A Practical Evaluation of Three Creative Problem-Solving Techniques
,”
Innovation: A Cross-Disciplinary Perspective
,
Norwegian University Press
,
Oslo, Norway
,.
16.
Paulus
,
P. B.
, and
Yang
,
H. C.
, 2000, “
Idea Generation in Groups: A Basis for Creativity in Organizations
,”
Org. Behav. Hum. Decis. Process
0749-5978,
82
(
1
), pp.
76
87
.
17.
Van Der Lugt
,
R.
, 2002, “
Brainsketching and How It Differs From Brainstorming
,”
Creat. Innov. Manag.
,
11
(
1
), pp.
43
54
.
18.
Shah
,
J. J.
, 1998, “
Experimental Investigation of Progressive Idea Generation Techniques in Engineering Design
,”
DETC ‘98, 1998 ASME Design Engineering Technical Conferences
.
19.
Shah
,
J. J.
,
Kulkarni
,
S. V.
, and
Vargas-Hernández
,
N.
, 2000, “
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,”
ASME J. Mech. Des.
0161-8458,
122
, pp.
377
384
.
20.
Shah
,
J. J.
,
Smith
,
S. M.
, and
Vargas-Hernandez
,
N.
, 2003, “
Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
0142-694X,
24
(
2
), pp.
111
134
.
21.
Vidal
,
R.
,
Mulet
,
E.
, and
Gómez-Senent
,
E.
, 2004, “
Effectiveness of the Means of Expression in Creative Problem-Solving in Design Groups
,”
J. Eng. Design
0954-4828,
15
(
3
), pp.
285
298
.
22.
Otto
,
K.
, and
Wood
,
K.
, 2001,
Product Design: Techniques in Reverse Engineering and New Product Development
,
Prentice-Hall
,
Upper Saddle River, NJ
.
23.
Shah
,
J. J.
,
Vargas-Hernández
,
N.
,
Summers
,
J. S.
, and
Kulkarni
,
S.
, 2001, “
Collaborative Sketching (C-Sketch)—An Idea Generation Technique for Engineering Design
,”
J. Creat. Behav.
0022-0175,
35
(
3
), pp.
168
198
.
24.
Pahl
,
G.
, and
Beitz
,
W.
, 1996,
Engineering Design—A Systematic Approach
,
Springer
,
New York
.
25.
Markman
,
A.
, 1999,
Knowledge Representation
,
Lawrence Erlbaum Associates
,
Mahwah, NJ
.
26.
Wilson
,
M.
, 2002, “
Six Views of Embodied Cognition
,”
Psychon. Bull. Rev.
1069-9384,
9
(
4
), pp.
625
636
.
27.
Goel
,
V.
, 1995,
Sketches of Thought
,
MIT
,
Cambridge, MA
.
28.
Greer
,
J. L.
,
Jensen
,
D. D.
, and
Wood
,
K. L.
, 2004, “
Effort Flow Analysis: A Methodology for Directed Product Evolution
,”
Des. Stud.
0142-694X,
25
(
2
), pp.
193
214
.
29.
Prinz
,
J. J.
, and
Barsolou
,
L. W.
, 2002, “
Acquisition and Productivity in Perceptual Symbol Systems: An Account of Mundane Creativity
,”
Creativity, Cognition, and Knowledge: An Interaction
,
Praeger
,
Westport, CT
.
30.
Suwa
,
M.
, and
Tversky
,
B.
, 1996, “
What Architects See in Their Sketches: Implications for Design Tools
,”
Human Factors in Computing Systems: Conference Companion
,
Association for Computing Machinery (ACM)
.
31.
Suwa
,
M.
, and
Tversky
,
B.
, 1997, “
What Do Architects and Students Perceive in Their Design Sketches? A Protocol Analysis
,”
Des. Stud.
0142-694X,
18
(
4
), pp.
385
403
.
32.
Goldschmidt
,
G.
, and
Smolkov
,
M.
, 2006, “
Variances in the Impact of Visual Stimuli on Design Problem Solving Performance
,”
Des. Stud.
0142-694X,
27
(
5
), pp.
549
569
.
33.
Paivio
,
A.
, 1986,
Mental Representations: A Dual Coding Approach
,
Oxford University Press
,
New York
.
34.
Mandler
,
G.
, 1980, “
Recognizing: The Judgment of Previous Occurrence
,”
Psychol. Rev.
0033-295X,
87
, pp.
252
271
.
35.
Loftus
,
G. R.
, and
Kallman
,
H. J.
, 1979, “
Encoding and Use of Detail Information in Picture Recognition
,”
J. Exp. Psychol. [Hum Learn]
,
5
, pp.
197
211
.
36.
Bartlett
,
J. C.
,
Till
,
R. E.
, and
Leavy
,
J. C.
, 1980, “
Retrieval Characteristics of Complex Pictures: Effects of Verbal Encoding
,”
J. Verbal Learn. Verbal Behav.
0022-5371,
19
, pp.
430
449
.
37.
Schooler
,
J. W.
,
Fiore
,
S. M.
, and
Brandimonte
,
M. A.
, 1997, “
At a Loss From Words: Verbal Overshadowing of Perceptual Memories
,”
The Psychology of Learning and Motivation
,
Academic
,
New York
.
38.
Aiken
,
M.
,
Vanjani
,
M.
, and
Paolillo
,
J.
, 1996, “
A Comparison of Two Electronic Idea Generation Techniques
,”
Inf. Manage.
0378-7206,
30
, pp.
91
99
.
39.
Jensen
,
D. D.
,
Murphy
,
M. D.
, and
Wood
,
K. L.
, 1998, “
Evaluation and Refinement of a Restructured Introduction to Engineering Design Course Using Student Surveys and MBTI Data
,”
ASEE Annual Conference
.
40.
Jensen
,
D.
, and
Bowe
,
M.
, 1999, “
Hands-on Experiences to Enhance Learning of Design: Effectiveness in a Reverse Engineering/Redesign Context When Correlated With MBTI and Vark Types
,”
ASEE Annual Conference
.
41.
Jensen
,
D.
,
Feland
,
J.
,
Bowe
,
M.
, and
Self
,
B.
, 2000, “
A 6-Hats Based Team Formation Strategy: Development and Comparison With an MBTI Based Approach
,”
ASEE Annual Conference
.
42.
Jensen
,
D.
, and
Wood
,
K.
, 2000, “
Incorporating Learning Styles to Enhance Mechanical Engineering Curricula by Restructuring Courses, Increasing Hands-on Activities, and Improving Team Dynamics
,”
ASME Annual Conference
.
43.
Wood
,
K.
,
Jensen
,
D.
,
Bezdek
,
J.
, and
Otto
,
K.
, 2001, “
Reverse Engineering and Redesign: Courses to Incrementally and Systematically Teach Design
,”
J. Eng. Educ.
1069-4730,
90
(
3
), pp.
363
374
.
45.
Diehl
,
M.
, and
Stroebe
,
W.
, 1987, “
Productivity Loss in Brainstorming Groups: Toward the Solution of a Riddle
,”
J. Pers. Soc. Psychol.
0022-3514,
53
(
3
), pp.
497
509
.
46.
Baxter
,
M.
, 1995,
Product Design: A Practical Guide to Systematic Methods of New Product Development
,
Chapman and Hall
,
London
.
47.
Bouchard
,
T. J.
, Jr.
, 1969, “
Personality, Problem-Solving Procedure, and Performance in Small Groups
,”
J. Appl. Psychol.
0021-9010,
53
(
1
), pp.
1
29
.
48.
Parnes
,
S. J.
, and
Meadow
,
A.
, 1959, “
Effects of ‘Brainstorming’ Instructions on Creative Problem Solving by Trained and Untrained Subjects
,”
J. Educ. Psychol.
0022-0663,
50
(
4
), pp.
171
176
.
49.
Delhagen
,
W.
,
Hussam
,
S.
,
Mohdramli
,
R.
, and
Yi
,
A.
, 2003, A Low-Cost Peanut Sheller for Use in Developing Nations: Final Application for Ideas, August 2006, http://web.mit.edu/ideas/www/past%20proposals/peanut.pdfhttp://web.mit.edu/ideas/www/past%20proposals/peanut.pdf
52.
Linsey
,
J.
,
Green
,
M. G.
,
Murphy
,
J. T.
,
Wood
,
K. L.
, and
Markman
,
A. B.
, 2005, “
Collaborating to Success: An Experimental Study of Group Idea Generation Techniques
,”
ASME Design Theory and Methodology Conference
.
53.
Hirtz
,
J.
,
Stone
,
R. B.
, and
Mcadams
,
D. A.
, 2002, “
A Functional Basis for Engineering Design: Reconciling and Evolving Previous Efforts
,”
Res. Eng. Des.
0934-9839,
13
, pp.
65
82
.
54.
Stone
,
R.
, and
Wood
,
K.
, 2000, “
Development of a Functional Basis for Design
,”
ASME J. Mech. Des.
0161-8458,
122
(
4
), pp.
359
370
.
55.
Clark-Carter
,
D.
, 1997,
Doing Quantitative Psychological Research: From Design to Report
, Psychology,
Taylor & Francis, Inc.
,
UK
.
56.
Jansson
,
D.
, and
Smith
,
S.
, 1991, “
Design Fixation
,”
Des. Stud.
0142-694X,
12
(
1
), pp.
3
11
.
57.
Kurtoglu
,
T.
,
Campbell
,
M.
, and
Linsey
,
J.
, 2009, “
An Experimental Study on the Effects of a Computational Design Tool on Concept Generation
,”
Des. Stud.
0142-694X,
30
(
6
), pp.
676
703
.
58.
Linsey
,
J.
,
Laux
,
J.
,
Clauss
,
E. F.
,
Wood
,
K.
, and
Markman
,
A.
, 2007, “
Increasing Innovation: A Trilogy of Experiments Towards a Design-by-Analogy Method
,”
ASME Design Theory and Methodology Conference
.
59.
Howell
,
D. C.
, 2002,
Statistical Methods for Psychology
,
Duxbury
,
Pacific Grove, CA
.
60.
Goldschmidt
,
G.
, and
Weil
,
M.
, 1998, “
Contents and Structure in Design Reasoning
,”
Design Issues
0747-9360,
14
(
3
), pp.
85
100
.
61.
Ulrich
,
K.
, and
Eppinger
,
S.
, 2004,
Product Design and Development
,
McGraw-Hill
,
New York
.
62.
Ullman
,
D.
, 1997,
The Mechanical Design Process
,
McGraw-Hill
,
New York
.
63.
Briggs
,
R. O.
,
Reinig
,
B. A.
,
Shepherd
,
M. M.
,
Yen
,
J.
, and
Nunameker
,
J. F.
, 1997, “
Quality as a Function of Quantity in Electronic Brainstorming
,”
30th Hawaii International Conference on System Sciences
.
64.
Ward
,
T. B.
, 1998, “
Analogical Distance and Purpose in Creative Thought: Mental Leaps Versus Mental Hops
,”
Advances in Analogy Research: Integration of Theory and Data From the Cognitive, Computational, and Neural Sciences
,
New Bulgarian University
,
Sofia, Bulgaria
.
65.
McKoy
,
F. L.
,
Vargas-Hernández
,
N.
,
Summers
,
J. D.
, and
Shah
,
J. J.
, 2001, “
Influence of Design Representation on Effectiveness of Idea Generation
,”
DETC ‘01, 2001 ASME Design Engineering Technical Conferences
.
66.
Christensen
,
B. T.
, and
Schunn
,
C.
, 2007, “
The Relationship of Analogical Distance to Analogical Function and Pre-Inventive Structures: The Case of Engineering Design
,”
Mem. Cognit.
0090-502X,
35
(
1
), pp.
29
38
.
67.
Gentner
,
D.
, and
Markman
,
A. B.
, 1997, “
Structure Mapping in Analogy and Similarity
,”
Am. Psychol.
0003-066X,
52
, pp.
45
56
.
68.
Casakin
,
H.
, and
Goldschmidt
,
G.
, 1999, “
Expertise and the Use of Visual Analogy: Implications for Design Education
,”
Des. Stud.
0142-694X,
20
(
2
), pp.
153
175
.
69.
Ball
,
L. J.
,
Ormerod
,
T. C.
, and
Morley
,
N. J.
, 2004, “
Spontaneous Analogising in Engineering Design: A Comparative Analysis of Experts and Novices
,”
Des. Stud.
0142-694X,
25
(
5
), pp.
495
508
.
70.
Linsey
,
J.
,
Murphy
,
J. T.
,
Wood
,
K. L.
,
Markman
,
A. B.
, and
Kurtoglu
,
T.
, 2006, “
Representing Analogies: Increasing the Probability of Success
,”
ASME Design Theory and Methodology Conference
.
71.
McAdams
,
D. A.
, and
Wood
,
K. L.
, 2002, “
A Quantitative Similarity Metric for Design-by-Analogy
,”
ASME J. Mech. Des.
0161-8458,
124
(
2
), pp.
173
182
.
72.
Linsey
,
J.
,
Tseng
,
I.
,
Fu
,
K.
,
Cagan
,
J.
,
Wood
,
K.
, and
Schunn
,
C.
, 2010, “
A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
,”
ASME J. Mech. Des.
0161-8458,
132
(
4
), p.
041003
.
You do not currently have access to this content.