This paper investigates relationships among the cognitive characteristics, interaction behaviors, and ideation outcomes of 14 engineering design teams engaged in concept generation. Cognitive characteristics were measured using the Kirton Adaption-Innovation Inventory (KAI), which assesses an individual’s cognitive preference for structure in generating and working with ideas in problem solving. Team interactions were assessed using the Interaction Dynamics Notation (IDN), which allows interaction behaviors to be quantitatively analyzed, while team outcomes were measured in terms of ideation utterances (ideas and unique ideas). Our analyses revealed that cognitive style (KAI) did not correlate significantly with interaction response behaviors (IDN) or with the quantity of ideas/unique ideas produced. However, the cognitive style diversity of the teams did influence the number of topics they discussed, as well as the interconnectedness of those topics. In addition, several specific interaction responses were associated with the occurrence of ideas/unique ideas, although the sequences associated with those responses varied widely; the more adaptive teams also had greater position specificity in these sequences than the more innovative teams. Our findings highlight the importance of forming cognitively diverse design teams and suggest that specific interaction behaviors should be encouraged or taught as a means to increase the occurrence of ideas and/or unique ideas during team concept generation.

References

References
1.
Duderstadt
,
J. J.
,
2005
,
Engineering Research and America’s Future: Meeting the Challenge of a Global Economy
,
National Academy of Engineering
,
Washington, DC
.
2.
Shah
,
J. J.
,
Kulkarni
,
S. V.
, and
Vargas-Hernandez
,
N.
,
2000
, “
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,”
ASME J. Mech. Des.
,
122
(
4
), pp.
377
384
.
3.
Minneman
,
S. L.
,
1991
, “
The Social Construction of a Technical Reality: Empirical Studies of Group Engineering Design Practice
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
4.
West
,
M. A.
,
2002
, “
Sparkling Fountains or Stagnant Ponds: An Integrative Model of Creativity and Innovation Implementation in Work Groups
,”
Appl. Psychol.
,
51
(
3
), pp.
355
387
.
5.
West
,
M. A.
,
Hirst
,
G.
,
Richter
,
A.
, and
Shipton
,
H.
,
2004
, “
Twelve Steps to Heaven: Successfully Managing Change Through Developing Innovative Teams
,”
Eur. J. Work Organ. Psychol.
,
13
(
2
), pp.
269
299
.
6.
West
,
M. A.
,
2012
, “
The Essence of High Performance Teams
,”
Ready for Change?
Palgrave Macmillan
,
London
, pp.
111
127
.
7.
Austin-Breneman
,
J.
,
Honda
,
T.
, and
Yang
,
M. C.
,
2012
, “
A Study of Student Design Team Behaviors in Complex System Design
,”
ASME J. Mech. Des.
,
134
(
12
), p.
124504
.
8.
Sosa
,
M. E.
, and
Marle
,
F.
,
2013
, “
Assembling Creative Teams in New Product Development Using Creative Team Familiarity
,”
ASME J. Mech. Des.
,
135
(
8
), p.
081009
.
9.
Fu
,
K.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2010
, “
Design Team Convergence: The Influence of Example Solution Quality
,”
ASME J. Mech. Des.
,
132
(
11
), p.
111005
.
10.
Dinar
,
M.
,
Shah
,
J.
,
Cagan
,
J.
,
Leifer
,
L. J.
,
Linsey
,
J. S.
,
Smith
,
S. M.
, and
Vargas-Hernandez
,
N.
,
2015
, “
Empirical Studies of Designer Thinking: Past, Present, and Future
,”
ASME J. Mech. Des.
,
137
(
2
), p.
021101
.
11.
Menold
,
J.
,
Jablokow
,
K.
, and
Simpson
,
T. W.
,
2018
, “
The Prototype for X Framework: Assessing Impact on Self-Reported Prototyping Behavior of Student Designers
,”
ASME J. Mech. Des.
,
141
(
4
), p.
042001
.
12.
Yilmaz
,
S.
,
Seifert
,
C.
,
Daly
,
S. R.
, and
Gonzalez
,
R.
,
2016
, “
Design Heuristics in Innovative Products
,”
ASME J. Mech. Des.
,
138
(
7
), p.
071102
.
13.
Zheng
,
X.
,
Ritter
,
S. C.
, and
Miller
,
S. R.
,
2018
, “
How Concept Selection Tools Impact the Development of Creative Ideas in Engineering Design Education
,”
ASME J. Mech. Des.
,
140
(
5
), p.
052002
.
14.
Tang
,
J. C.
,
1991
, “
Findings From Observational Studies of Collaborative Work
,”
Int. J. Man-Mach. Stud.
,
34
(
2
), pp.
143
160
.
15.
Daly
,
S. R.
,
Seifert
,
C. M.
,
Yilmaz
,
S.
, and
Gonzalez
,
R.
,
2016
, “
Comparing Ideation Techniques for Beginning Designers
,”
ASME J. Mech. Des.
,
138
(
10
), p.
101108
.
16.
Linsey
,
J. S.
,
Clauss
,
E. F.
,
Kurtoglu
,
T.
,
Murphy
,
J. T.
,
Wood
,
K. L.
, and
Markman
,
A. B.
,
2011
, “
An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing Methods
,”
ASME J. Mech. Des.
,
133
(
3
), p.
031008
.
17.
Jung
,
M.
,
2011
, “
Engineering Team Performance and Emotion: Affective Interaction Dynamics as Indicators of Design Team Performance
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
18.
Eris
,
O.
,
2002
, “
Perceiving, Comprehending, and Measuring Design Activity Through the Questions Asked While Designing
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
19.
Edelman
,
J.
,
2011
, “
Understanding Radical Breaks: Media and Behavior in Small Teams Engaged in Redesign Scenarios
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
20.
Cross
,
N.
,
Christiaans
,
H.
, and
Dorst
,
K.
,
1996
,
Analysing Design Activity
,
Wiley
,
London
.
21.
Adams
,
R.
, and
Siddiqui
,
J.
,
2015
,
Analyzing Design Review Conversations
,
Purdue University Press
,
West Lafayette, IN
.
22.
Wilde
,
D. J.
,
2008
,
Teamology: The Construction and Organization of Effective Teams
,
Springer Science and Business Media
,
New York, NY
.
23.
Kress
,
G.
, and
Schar
,
M.
,
2011
, “
Initial Conditions: The Structure and Composition of Effective Design Teams
,”
Proceedings of the 18th International Conference on Engineering Design
,
Copenhagen, Denmark
,
Aug. 15–18
.
24.
Kirton
,
M. J.
,
2003
,
Adaption-Innovation in the Context of Diversity and Change
,
Routledge
,
London
.
25.
Schar
,
M. F.
,
2011
, “
Pivot Thinking and the Differential Sharing of Information Within New Product Development Teams
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
26.
Kichuk
,
S. L.
, and
Wiesner
,
W. H.
,
1997
, “
The Big Five Personality Factors and Team Performance: Implications for Selecting Successful Product Design Teams
,”
J. Eng. Technol. Manage.
,
14
(
3
), pp.
195
221
.
27.
Sonalkar
,
N.
,
Jablokow
,
K.
,
Edelman
,
J.
,
Mabogunje
,
A.
, and
Leifer
,
L.
,
2017
, “
Design Whodunit: The Relationship Between Individual Characteristics and Interaction Behaviors in Design Concept Generation
,”
Proceedings of the 2017 ASME International Design Engineering Technical Conferences
,
Cleveland, OH
,
Aug. 6–9
.
28.
Jablokow
,
K.
,
Sonalkar
,
N.
,
Avdeev
,
I.
,
Thompson
,
B.
,
Megahed
,
M.
, and
Pachpute
,
P.
,
2018
, “
Exploring the Dynamic Interactions and Cognitive Characteristics of NSF Innovation Corps (I-Corps) Teams
,”
Proceedings of the 2018 ASEE Annual Conference and Exposition
,
Salt Lake City, UT
,
June 24–27
.
29.
McGrath
,
J. E.
,
1964
,
Social Psychology: A Brief Introduction
,
Holt, Rinehart and Winston
,
Boston, MA
.
30.
Ilgen
,
D. R.
,
Hollenbeck
,
J. R.
,
Johnson
,
M.
, and
Jundt
,
D.
,
2005
, “
Teams in Organizations: From Input-Process-Output Models to IMOI Models
,”
Annu. Rev. Psychol.
56
, pp.
517
543
.
31.
Sternberg
,
R. J.
, and
Grigorenko
,
E. L.
,
1997
, “
Are Cognitive Styles Still in Style?
Am. Psychol.
,
52
(
7
), pp.
700
712
.
32.
Sternberg
,
R. J.
, and
Grigorenko
,
E. L.
,
2001
, “
A Capsule History of Theory and Research on Styles
,”
Perspectives on Thinking, Learning, and Cognitive Styles
,
Routledge
,
UK
, pp.
1
21
.
33.
Allinson
,
C. W.
, and
Hayes
,
J.
,
1996
, “
The Cognitive Style Index: A Measure of Intuition-Analysis for Organizational Research
,”
J. Manage. Stud.
,
33
(
1
), pp.
119
135
.
34.
Buffinton
,
K. W.
,
Jablokow
,
K. W.
, and
Martin
,
K. A.
,
2002
, “
Project Team Dynamics and Cognitive Style
,”
Eng. Manage. J.
,
14
(
3
), pp.
25
33
.
35.
Neill
,
C. J.
, and
DeFranco
,
J. F.
,
2011
, “
Problem-Solving Style and Its Impact on Engineering Team Effectiveness
,”
Proceedings of the 9th Conference on Systems Engineering Research
,
Los Angeles, CA
,
April 15–16
.
36.
Jablokow
,
K. W.
,
2008
, “
Developing Problem Solving Leadership: A Cognitive Approach
,”
Int. J. Eng. Ed.
,
24
(
5
), pp.
936
954
.
37.
Vercellone-Smith
,
P.
,
Jablokow
,
K.
, and
Friedel
,
C.
,
2012
, “
Characterizing Communication Networks in a Web-Based Classroom: Cognitive Styles and Linguistic Behavior of Self-Organizing Groups in Online Discussions
,”
Comput. Educ.
,
59
(
2
), pp.
222
235
.
38.
Samuel
,
P.
, and
Jablokow
,
K.
,
2011
, “
Toward an Adaption-Innovation Strategy for Engineering Design
,”
Proceedings of the. 18th International Conference on Engineering Design (ICED)
,
Copenhagen, Denmark
,
Aug. 15–18
.
39.
Jablokow
,
K. W.
,
Teerlink
,
W.
,
Yilmaz
,
S.
,
Daly
,
S.
,
Silk
,
E.
, and
Wehr
,
C.
,
2015
, “
Ideation Variety in Mechanical Design: Examining the Effects of Cognitive Style and Design Heuristics
,”
Proceedings of the ASME 2015 International Design and Engineering Technical Conferences
,
Boston, MA
,
Aug. 2–5
.
40.
Wright
,
S.
,
Silk
,
R.
,
Daly
,
S.
,
Jablokow
,
K.
, and
Yilmaz
,
S.
,
2015
, “
Exploring the Effects of Problem Framing on Solution Shifts: A Case Study
,”
Proceedings of the ASEE 2015 Annual Conference on Engineering Education
,
Seattle, WA
,
June 14–17
.
41.
Yilmaz
,
S.
,
Daly
,
S.
,
Jablokow
,
K. W.
,
Silk
,
E.
, and
Rosenberg
,
M.
,
2014
, “
Investigating Impacts on the Ideation Flexibility of Engineers
,”
Proceedings of the ASEE 2014 Annual Conference on Engineering Education
,
Indianapolis, IN
,
June 15–18
.
42.
Yilmaz
,
S.
,
Berg
,
M.
,
Daly
,
S.
,
Jablokow
,
K. W.
,
Silk
,
E.
, and
Teerlink
,
W.
,
2015
, “
Impact of Problem Contexts on the Diversity of Design Solutions: An Exploratory Case Study
,”
Proceedings of the ASEE 2015 Annual Conference on Engineering Education
,
Seattle, WA
,
June 14–17
.
43.
Silk
,
E. M.
,
Daly
,
S. R.
,
Jablokow
,
K. W.
,
Yilmaz
,
S.
, and
Rosenberg
,
M.
,
2014
, “
Interventions for Ideation: Impact of Framing, Teaming, and Tools on High School Students’ Design Fixation
,”
Proceedings of the 2014 Annual Meeting of the American Educational Research Association
,
Philadelphia, PA
,
April 3–7
.
44.
Silk
,
E.
,
Daly
,
S.
,
Jablokow
,
K. W.
,
Yilmaz
,
S.
, and
Rosenberg
,
M.
,
2014
, “
The Design Problem Framework: Using Adaption-Innovation Theory to Construct Design Problem Statements
,”
Proceedings of the ASEE 2014 Annual Conference on Engineering Education
,
Indianapolis, IN
,
June 15–18
.
45.
Jablokow
,
K.
,
Teerlink
,
W.
,
Yilmaz
,
S.
,
Daly
,
S.
, and
Silk
,
E.
,
2015
, “
The Impact of Teaming and Cognitive Style on Student Perceptions of Design Ideation Outcomes
,”
Proceedings of the ASEE 2015 Annual Conference on Engineering Education
,
Seattle, WA
,
June 14–17
.
46.
Kirton
,
M.
,
1976
, “
Adaptors and Innovators: A Description and Measure
,”
J. Appl. Psychol.
,
61
(
5
), pp.
622
629
.
47.
Jackson
,
D. N.
,
1976
,
Jackson Personality Inventory Manual
,
Research Psychologists’ Press
,
Goshen, NY
.
48.
Eysenck
,
H. J.
, and
Eysenck
,
S.
,
1964
,
Manual of the Eysenck Personality Inventory
,
University of London Press
,
London
.
49.
Eysenck
,
H. J.
,
1996
,
The Structure of Human Personality
,
3rd ed
.,
Methuen
,
London
.
50.
Jablokow
,
K. W.
, and
Kirton
,
M. J.
,
2009
, “
Problem Solving, Creativity, and the Level-Style Distinction
,”
Perspectives on the Nature of Intellectual Styles
,
L.-F.
Zhang
,
R. J.
Sternberg
, eds.,
Springer
,
New York, NY
, pp.
137
168
.
51.
Jablokow
,
K. W.
, and
Booth
,
D. E.
,
2006
, “
The Impact and Management of Cognitive Gap in High Performance Product Development Organizations
,”
J. Eng. Technol. Manage.
,
23
(
4
), pp.
313
336
.
52.
Kurtzberg
,
T. R.
,
2005
, “
Feeling Creative, Being Creative: An Empirical Study of Diversity and Creativity in Teams
,”
Creat. Res. J.
,
17
(
1
), pp.
51
65
.
53.
Hammerschmidt
,
P. K.
,
1996
, “
The Kirton Adaption Innovation Inventory Find Group Problem Solving Success Rates
,”
J. Creat. Behav.
,
30
(
1
), pp.
61
74
.
54.
Norman
,
M. A.
, and
Thomas
,
P. M.
,
1991
, “
Informing HCI Design Through Conversation Analysis
,”
Int. J. Man-Mach. Stud.
,
35
(
2
), pp.
235
350
.
55.
McDonnell
,
J.
,
2009
, “
Collaborative Negotiation in Design: A Study of Design Conversations Between Architect and Building Users
,”
CoDesign
,
5
(
1
), pp.
35
50
.
56.
Matthews
,
B.
,
2009
, “
Intersections of Brainstorming Rules and Social Order
,”
CoDesign
,
5
(
1
), pp.
65
76
.
57.
Sonalkar
,
N.
,
2012
, “
A Visual Representation to Characterize Moment-to-Moment Concept Generation Through Interpersonal Interactions in Engineering Design Teams
,” Ph.D. thesis,
Stanford University
,
Stanford, CA
.
58.
Sonalkar
,
N.
,
Mabogunje
,
A.
, and
Leifer
,
L.
,
2013
, “
Developing a Visual Representation to Characterize Moment-to-Moment Concept Generation in Design Teams
,”
Int. J. Des. Creat. Innov.
,
1
(
2
), pp.
93
108
.
59.
Sonalkar
,
N.
,
Mabogunje
,
A.
,
Pai
,
G.
,
Krishnan
,
A.
, and
Roth
,
B.
,
2016
, “
Diagnostics for Design Thinking Teams
,”
Design Thinking Research
,
L.
Leifer
,
C.
Meinel
,
H.
Plattner
, eds.,
Springer International Publishing
,
New York, NY
, pp.
35
51
.
60.
Talmy
,
L.
,
1988
, “
Force Dynamics in Language and Cognition
,”
Cogn. Sci.
,
12
(
1
), pp.
49
100
.
61.
Gerber
,
E.
,
2007
, “
Improvisation Principles and Techniques for Design
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
San Jose, CA
,
April 28–May 3
.
62.
Gerber
,
E.
,
2009
, “
Using Improvisation to Enhance the Effectiveness of Brainstorming
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
Boston, MA
,
April 4–9
.
63.
Sonalkar
,
N.
,
Mabogunje
,
A.
,
Leifer
,
L.
, and
Roth
,
B.
,
2016
, “
Visualising Professional Vision Interactions in Design Reviews
,”
CoDesign
,
12
(
1–2
), pp.
73
92
.
64.
Hatchuel
,
A.
, and
Weil
,
B.
,
2003
, “
A New Approach of Innovative Design: An Introduction to CK Theory
,”
Proceedings of the 14th International Conference on Engineering Design
,
Stockholm, Sweden
,
Aug. 19–21
.
65.
Dean
,
D. L.
,
Hender
,
J. M.
,
Rodgers
,
T. L.
, and
Santanen
,
E. L.
,
2006
, “
Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation
,”
J. Assoc. Inf. Syst.
,
7
(
10
), pp.
646
699
.
66.
Nelson
,
B. A.
,
Wilson
,
J. O.
,
Rosen
,
D.
, and
Yen
,
J.
,
2009
, “
Refined Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
30
(
6
), pp.
737
743
.
67.
Shah
,
J. J.
,
Smith
,
S. M.
, and
Vargas-Hernandez
,
N.
,
2003
, “
Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
24
(
2
), pp.
111
134
.
68.
Verhaegen
,
P.-A.
,
Vandevenne
,
D.
,
Peeters
,
J.
, and
Duflou
,
J. R.
,
2013
, “
Refinements to the Variety Metric for Idea Evaluation
,”
Des. Stud.
,
34
(
2
), pp.
243
263
.
69.
Hatchuel
,
A.
,
Le Masson
,
P.
,
Reich
,
Y.
, and
Weil
,
B.
,
2011
, “
A Systematic Approach of Design Theories Using Generativeness and Robustness
,”
Proceedings of the 2011 International Conference on Engineering Design
,
Copenhagen, Denmark
,
Aug. 15–18
.
70.
Jablokow
,
K. W.
,
DeFranco
,
J. D.
,
Richmond
,
S. S.
,
Piovoso
,
M. J.
, and
Bilen
,
S. G.
,
2015
, “
Cognitive Style and Concept Mapping Performance
,”
J. Eng. Ed.
,
104
(
3
), pp.
303
325
.
71.
Yujian
,
L.
, and
Bo
,
L.
,
2007
, “
A Normalized Levenshtein Distance Metric
,”
IEEE Trans. Pattern Anal. Mach. Intell.
,
29
(
6
), pp.
1091
1095
.
72.
Goldschmidt
,
G.
,
2014
,
Linkography: Unfolding the Design Process
,
MIT Press
,
Boston, MA
.
73.
McCarthy
,
R.
,
1993
, “
The Relationship of Individual Characteristics of Women Managers to the Pressures Experienced at Work and Choice of Coping Strategy
,” Ph.D. thesis,
University of Hertfordshire
,
Hertfordshire
.
74.
Holm
,
S.
,
1979
, “
A Simple Sequentially Rejective Method Procedure
,”
Scand. J. Stat.
,
6
(
2
), pp.
65
70
.
75.
Gaetano
,
J.
,
2013
, “
Holm-Bonferroni Sequential Correction: An EXCEL Calculator
,” ver. 1.2. http://www.researchgate.net/profile/Justin_Gaetano2
76.
Breiman
,
L.
,
Friedman
,
J.
,
Stone
,
C. J.
, and
Olshen
,
R. A.
,
1984
,
Classification and Regression Trees
,
CRC Press
,
Boca Raton, FL
.
77.
Sravanthi
,
K.
, and
Reddy
,
T. S.
,
2015
, “
Applications of Big Data in Various Fields
,”
Int. J. Comput. Sci. Inf. Technol.
,
6
(
5
), pp.
4629
4632
.
78.
Goldsmith
,
R. E.
,
1986
, “
Adaption-Innovation and Cognitive Complexity
,”
J. Psychol.
,
119
(
5
), pp.
461
467
.
79.
Chan
,
D.
,
1996
, “
Cognitive Misfit of Problem Solving Style at Work: A Facet of the Person-Organization Fit
,”
Organ. Behav. Hum. Decision Process.
,
68
(
3
), pp.
194
207
.
80.
Silk
,
E. M.
,
Daly
,
S. R.
,
Jablokow
,
K. W.
, and
McKilligan
,
S.
,
2019
, “
Incremental to Radical Ideas: Paradigm-Relatedness Metrics for Investigating Ideation Creativity and Diversity
,”
Int. J. Des. Creat. Innov.
,
7
(
1–2
), pp.
30
49
.
81.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2016
, “
Choosing Creativity: The Role of Individual Risk and Ambiguity Aversion on Creative Concept Selection in Engineering Design
,”
Res. Eng. Des.
27
(
3
), pp.
195
219
.
You do not currently have access to this content.