Abstract

We propose to automate the assessment of novelty during the early design stages, where the number of solution alternatives is high, and these alternatives are flexible. The novelty of a solution is measured as its distance from a reference product database. The distance is calculated by comparing the solution and a reference at different levels of abstraction, as defined by a casuality model called SAPPhIRE. The fundamental instrument of this comparison is a text similarity metric, which is integrated with the novelty score, a support for which is developed as an Android application, named IdeA-Novelty. The application of the algorithm upon 20 solutions reveals that the measurement is computationally expensive. The expert's ratings for the same solution set seem to vary drastically. We take this observation as the basis for an extensive discussion on novelty, an operational definition for which is proposed toward the end.

References

References
1.
Sarkar
,
P.
, and
Chakrabarti
,
A.
,
2015
, “
Creativity: Generic Definition, Tests, Factors and Methods
,”
Int. J. Des. Sci. Technol.
,
21
(
1
), pp.
7
37
.
2.
King
,
A. M.
, and
Sivaloganathan
,
S.
,
1999
, “
Development of a Methodology for Concept Selection in Flexible Design Strategies
,”
J. Eng. Des.
,
10
(
4
), pp.
329
349
. 10.1080/095448299261236
3.
Howard
,
T. J.
,
Culley
,
S. J.
, and
Dekoninck
,
E.
,
2008
, “
Describing the Creative Design Process by the Integration of Engineering Design and Cognitive Psychology Literature
,”
Des. Stud.
,
29
(
2
), pp.
160
180
. 10.1016/j.destud.2008.01.001
4.
Asiedu
,
Y.
, and
Gu
,
P.
,
1998
, “
Product Life Cycle Cost Analysis: State of the Art Review
,”
Int. J. Prod. Res.
,
36
(
4
), pp.
883
908
. 10.1080/002075498193444
5.
Siddharth
,
L.
, and
Sarkar
,
P.
,
2017
, “
A Methodology for Predicting the Effect of Engineering Design Changes
,”
Proc. CIRP
,
60
, pp.
452
457
. 10.1016/j.procir.2017.03.071
6.
Brown
,
D. C.
,
2015
, “
Computational Design Creativity Evaluation
,”
Sixth International Conference on Design Computing and Cognition (DCC'14 OR DCC14)
,
University College, London, UK
,
June 23–25
, pp.
207
224
.
7.
Jansson
,
D. G.
, and
Smith
,
S. M.
,
1991
, “
Design Fixation
,”
Des. Stud.
,
12
(
1
), pp.
3
11
. 10.1016/0142-694X(91)90003-F
8.
Shah
,
J. J.
,
Smith
,
S. M.
, and
Vargas-Hernandez
,
N.
,
2003
, “
Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
24
(
2
), pp.
111
134
. 10.1016/S0142-694X(02)00034-0
9.
He
,
Y.
, and
Luo
,
J.
,
2017
, “
The Novelty ‘Sweet Spot’ of Invention
,”
Design Science
,
3
(
1
), pp.
e21
. 10.1017/dsj.2017.23
10.
Kim
,
D.
,
Cerigo
,
D. B.
,
Jeong
,
H.
, and
Youn
,
H.
,
2016
, “
Technological Novelty Profile and Invention’s Future Impact
,”
EPJ Data Sci.
,
5
(
1
), p.
8
. 10.1140/epjds/s13688-016-0069-1
11.
Owens
,
W. A.
,
Schumacher
,
C. F.
, and
Clark
,
J.
,
1957
, “
The Measurement of Creativity in Machine Design
,”
J. Appl. Psychol.
,
41
(
5
), p.
297
. 10.1037/h0040668
12.
Moss
,
J.
,
1966
, “Measuring Creative Abilities in Junior High School Industrial Arts. Monograph 2.,” American Council on Industrial Arts Teacher Education, Washington, DC., Non-journal ED022023.
13.
Garcia
,
R.
, and
Calantone
,
R.
,
2002
, “
A Critical Look at Technological Innovation Typology and Innovativeness Terminology: A Literature Review
,”
J. Prod. Innovation Manage.
,
19
(
2
), pp.
110
132
. 10.1016/S0737-6782(01)00132-1
14.
Besemer
,
S. P.
, and
O’Quin
,
K.
,
1986
, “
Analyzing Creative Products: Refinement and Test of a Judging Instrument
,”
J. Creat. Behav.
,
20
(
2
), pp.
115
126
. 10.1002/j.2162-6057.1986.tb00426.x
15.
Charyton
,
C.
,
Jagacinski
,
R. J.
, and
Merrill
,
J. A.
,
2008
, “
CEDA: A Research Instrument for Creative Engineering Design Assessment
,”
Psychol. Aesthet. Creativ. Arts
,
2
(
3
), p.
147
. 10.1037/1931-3896.2.3.147
16.
Cropley
,
D. H.
,
Kaufman
,
J. C.
, and
Cropley
,
A. J.
,
2011
, “
Measuring Creativity for Innovation Management
,”
J. Technol. Manage. Innovation
,
6
(
3
), pp.
13
30
. 10.4067/S0718-27242011000300002
17.
Sarkar
,
P.
, and
Chakrabarti
,
A.
,
2011
, “
Assessing Design Creativity
,”
Des. Stud.
,
32
(
4
), pp.
348
383
. 10.1016/j.destud.2011.01.002
18.
Lopez-Mesa
,
B.
,
Mulet
,
E.
,
Vidal
,
R.
, and
Thompson
,
G.
,
2011
, “
Effects of Additional Stimuli on Idea-Finding in Design Teams
,”
J. Eng. Des.
,
22
(
1
), pp.
31
54
. 10.1080/09544820902911366
19.
Fu
,
K.
,
Chan
,
J.
,
Cagan
,
J.
,
Kotovsky
,
K.
,
Schunn
,
C.
, and
Wood
,
K.
,
2013
, “
The Meaning of ‘Near’ and ‘Far’: The Impact of Structuring Design Databases and the Effect of Distance of Analogy on Design Output
,”
ASME J. Mech. Des.
,
135
(
2
), p.
021007
. 10.1115/1.4023158
20.
Gosnell
,
C. A.
, and
Miller
,
S. R.
,
2014
, “
A Novel Method for Providing Global Assessments of Design Concepts Using Single-Word Adjectives and Semantic Similarity
,”
2nd Biennial International Conference on Dynamics for Design; 26th International Conference on Design Theory and Methodology
,
Buffalo, NY
,
Aug. 17–20
, No. 46407, p.
V007T07A044
. 10.1115/detc2014-35380
21.
Gosnell
,
C. A.
, and
Miller
,
S. R.
,
2015
, “
But Is It Creative? Delineating the Impact of Expertise and Concept Ratings on Creative Concept Selection
,”
ASME J. Mech. Des.
,
138
(
2
), p.
021101
. 10.1115/1.4031904
22.
Grace
,
K.
,
Maher
,
M. L.
,
Fisher
,
D.
, and
Brady
,
K.
,
2015
, “
Data-Intensive Evaluation of Design Creativity Using Novelty, Value, and Surprise
,”
Int. J. Des. Creativity Innovation
,
3
(
3–4
), pp.
125
147
. 10.1080/21650349.2014.943295
23.
Srivathsavai
,
R.
,
Genco
,
N.
,
Hölttä-Otto
,
K.
, and
Seepersad
,
C. C.
,
2010
, “
Study of Existing Metrics Used in Measurement of Ideation Effectiveness
,”
Proceedings of ASME IDETC/CIE – 22nd International Conference on Design Theory and Methodology
,
Montreal, Quebec, Canada
,
Aug. 15–18
, pp.
355
366
.
24.
Shah
,
J. J.
,
Kulkarni
,
S. V.
, and
Vargas-Hernandez
,
N.
,
2000
, “
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,”
ASME J. Mech. Des.
,
122
(
4
), pp.
377
384
. 10.1115/1.1315592
25.
Oman
,
S. K.
,
Tumer
,
I. Y.
,
Wood
,
K.
, and
Seepersad
,
C.
,
2013
, “
A Comparison of Creativity and Innovation Metrics and Sample Validation Through In-Class Design Projects
,”
Res. Eng. Des.
,
24
(
1
), pp.
65
92
. 10.1007/s00163-012-0138-9
26.
Boden
,
M. A.
,
1996
,
Dimensions of Creativity
,
Mit Press
,
Cambridge, MA
.
27.
Colton
,
S.
,
Charnley
,
J. W.
, and
Pease
,
A.
,
2011
, “
Computational Creativity Theory: The FACE and IDEA Descriptive Models
,”
Proceedings of the Second International Conference on Computational Creativity
,
Mexico City
,
Apr. 27–29
, pp.
90
95
.
28.
Siddharth
,
L.
, and
Chakrabarti
,
A.
,
2018
, “
Evaluating the Impact of Idea-Inspire 4.0 on Analogical Transfer of Concepts
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
32
(
4
), pp.
431
448
. 10.1017/S0890060418000136
29.
Chakrabarti
,
A.
,
Sarkar
,
P.
,
Leelavathamma
,
B.
, and
Nataraju
,
B.
,
2005
, “
A Functional Representation for Aiding Biomimetic and Artificial Inspiration of New Ideas
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
19
(
2
), pp.
113
132
. 10.1017/S0890060405050109
30.
Purcell
,
A. T.
, and
Gero
,
J. S.
,
1998
, “
Drawings and the Design Process: A Review of Protocol Studies in Design and Other Disciplines and Related Research in Cognitive Psychology
,”
Des. Stud.
,
19
(
4
), pp.
389
430
. 10.1016/S0142-694X(98)00015-5
31.
Ware
,
C.
,
2010
,
Visual Thinking: For Design
,
Morgan Kaufmann
,
Burlington, MA
.
32.
Vidal
,
R.
,
Mulet
,
E.
, and
Gómez-Senent
,
E.
,
2004
, “
Effectiveness of the Means of Expression in Creative Problem-Solving in Design Groups
,”
J. Eng. Des.
,
15
(
3
), pp.
285
298
. 10.1080/09544820410001697587
33.
Croft
,
D.
,
Coupland
,
S.
,
Shell
,
J.
, and
Brown
,
S.
,
2013
, “
A Fast and Efficient Semantic Short Text Similarity Metric
,”
2013 13th UK Workshop on Computational Intelligence (UKCI)
,
Guildford, UK
,
Sept. 9–11
, pp.
221
227
.
34.
Li
,
Y.
,
McLean
,
D.
,
Bandar
,
Z. A.
,
O’shea
,
J. D.
, and
Crockett
,
K.
,
2006
, “
Sentence Similarity Based on Semantic Nets and Corpus Statistics
,”
IEEE Trans. Knowl. Data Eng.
,
18
(
8
), pp.
1138
1150
. 10.1109/TKDE.2006.130
35.
Resnik
,
P.
,
1995
, “Using Information Content to Evaluate Semantic Similarity in a Taxonomy,” CoRR, vol. abs/cmp-lg/9511007.
36.
Jiang
,
J. J.
, and
Conrath
,
D. W.
,
1997
, “
Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy
,”
Proceedings of the 10th Research on Computational Linguistics International Conference
,
Taipei, Taiwan
,
August
https://www.aclweb.org/anthology/O97-1002.
37.
Li
,
Y.
,
Bandar
,
Z. A.
, and
McLean
,
D.
,
2003
, “
An Approach for Measuring Semantic Similarity Between Words Using Multiple Information Sources
,”
IEEE Trans. Knowl. Data Eng.
,
15
(
4
), pp.
871
882
. 10.1109/TKDE.2003.1209005
38.
Gao
,
J.-B.
,
Zhang
,
B.-W.
, and
Chen
,
X.-H.
,
2015
, “
A WordNet-Based Semantic Similarity Measurement Combining Edge-Counting and Information Content Theory
,”
Eng. Appl. Artif. Intell.
,
39
(
1
), pp.
80
88
. 10.1016/j.engappai.2014.11.009
39.
Siddharth
,
L.
, and
Sarkar
,
P.
,
2018
, “
A Multiple-Domain Matrix Support to Capture Rationale for Engineering Design Changes
,”
ASME J. Comput. Inf. Sci. Eng.
,
18
(
2
), p.
021014
. 10.1115/1.4039850
40.
Amabile
,
T. M.
,
1982
, “
Social Psychology of Creativity: A Consensual Assessment Technique.
,”
J. Pers. Soc. Psychol.
,
43
(
5
), pp.
997
1013
. 10.1037/0022-3514.43.5.997
41.
Keshwani
,
S.
, and
Chakrabarti
,
A.
,
2017
, “
Towards Automatic Classification of Description of Analogies Into SAPPhIRE Constructs
,”
Proceedings of 6th International Conference on Research into Design
,
Guwahati, India
,
Jan. 10–12
, pp.
643
655
. http://dx.doi.org/10.1007-978-981-10-3521-0_5.
42.
Kudrowitz
,
B. M.
, and
Wallace
,
D.
,
2013
, “
Assessing the Quality of Ideas From Prolific, Early-Stage Product Ideation
,”
J. Eng. Des.
,
24
(
2
), pp.
120
139
. 10.1080/09544828.2012.676633
43.
Christiaans
,
H. H.
,
2002
, “
Creativity as a Design Criterion
,”
Commun. Res. J.
,
14
(
1
), pp.
41
54
.
You do not currently have access to this content.