Abstract
We propose to automate the assessment of novelty during the early design stages, where the number of solution alternatives is high, and these alternatives are flexible. The novelty of a solution is measured as its distance from a reference product database. The distance is calculated by comparing the solution and a reference at different levels of abstraction, as defined by a casuality model called SAPPhIRE. The fundamental instrument of this comparison is a text similarity metric, which is integrated with the novelty score, a support for which is developed as an Android application, named IdeA-Novelty. The application of the algorithm upon 20 solutions reveals that the measurement is computationally expensive. The expert's ratings for the same solution set seem to vary drastically. We take this observation as the basis for an extensive discussion on novelty, an operational definition for which is proposed toward the end.
References
1.
Sarkar
, P.
, and Chakrabarti
, A.
, 2015
, “Creativity: Generic Definition, Tests, Factors and Methods
,” Int. J. Des. Sci. Technol.
, 21
(1
), pp. 7
–37
.2.
King
, A. M.
, and Sivaloganathan
, S.
, 1999
, “Development of a Methodology for Concept Selection in Flexible Design Strategies
,” J. Eng. Des.
, 10
(4
), pp. 329
–349
. 10.1080/0954482992612363.
Howard
, T. J.
, Culley
, S. J.
, and Dekoninck
, E.
, 2008
, “Describing the Creative Design Process by the Integration of Engineering Design and Cognitive Psychology Literature
,” Des. Stud.
, 29
(2
), pp. 160
–180
. 10.1016/j.destud.2008.01.0014.
Asiedu
, Y.
, and Gu
, P.
, 1998
, “Product Life Cycle Cost Analysis: State of the Art Review
,” Int. J. Prod. Res.
, 36
(4
), pp. 883
–908
. 10.1080/0020754981934445.
Siddharth
, L.
, and Sarkar
, P.
, 2017
, “A Methodology for Predicting the Effect of Engineering Design Changes
,” Proc. CIRP
, 60
, pp. 452
–457
. 10.1016/j.procir.2017.03.0716.
Brown
, D. C.
, 2015
, “Computational Design Creativity Evaluation
,” Sixth International Conference on Design Computing and Cognition (DCC'14 OR DCC14)
, University College, London, UK
, June 23–25
, pp. 207
–224
.7.
Jansson
, D. G.
, and Smith
, S. M.
, 1991
, “Design Fixation
,” Des. Stud.
, 12
(1
), pp. 3
–11
. 10.1016/0142-694X(91)90003-F8.
Shah
, J. J.
, Smith
, S. M.
, and Vargas-Hernandez
, N.
, 2003
, “Metrics for Measuring Ideation Effectiveness
,” Des. Stud.
, 24
(2
), pp. 111
–134
. 10.1016/S0142-694X(02)00034-09.
He
, Y.
, and Luo
, J.
, 2017
, “The Novelty ‘Sweet Spot’ of Invention
,” Design Science
, 3
(1
), pp. e21
. 10.1017/dsj.2017.2310.
Kim
, D.
, Cerigo
, D. B.
, Jeong
, H.
, and Youn
, H.
, 2016
, “Technological Novelty Profile and Invention’s Future Impact
,” EPJ Data Sci.
, 5
(1
), p. 8
. 10.1140/epjds/s13688-016-0069-111.
Owens
, W. A.
, Schumacher
, C. F.
, and Clark
, J.
, 1957
, “The Measurement of Creativity in Machine Design
,” J. Appl. Psychol.
, 41
(5
), p. 297
. 10.1037/h004066812.
Moss
, J.
, 1966
, “Measuring Creative Abilities in Junior High School Industrial Arts. Monograph 2.,” American Council on Industrial Arts Teacher Education, Washington, DC., Non-journal ED022023.13.
Garcia
, R.
, and Calantone
, R.
, 2002
, “A Critical Look at Technological Innovation Typology and Innovativeness Terminology: A Literature Review
,” J. Prod. Innovation Manage.
, 19
(2
), pp. 110
–132
. 10.1016/S0737-6782(01)00132-114.
Besemer
, S. P.
, and O’Quin
, K.
, 1986
, “Analyzing Creative Products: Refinement and Test of a Judging Instrument
,” J. Creat. Behav.
, 20
(2
), pp. 115
–126
. 10.1002/j.2162-6057.1986.tb00426.x15.
Charyton
, C.
, Jagacinski
, R. J.
, and Merrill
, J. A.
, 2008
, “CEDA: A Research Instrument for Creative Engineering Design Assessment
,” Psychol. Aesthet. Creativ. Arts
, 2
(3
), p. 147
. 10.1037/1931-3896.2.3.14716.
Cropley
, D. H.
, Kaufman
, J. C.
, and Cropley
, A. J.
, 2011
, “Measuring Creativity for Innovation Management
,” J. Technol. Manage. Innovation
, 6
(3
), pp. 13
–30
. 10.4067/S0718-2724201100030000217.
Sarkar
, P.
, and Chakrabarti
, A.
, 2011
, “Assessing Design Creativity
,” Des. Stud.
, 32
(4
), pp. 348
–383
. 10.1016/j.destud.2011.01.00218.
Lopez-Mesa
, B.
, Mulet
, E.
, Vidal
, R.
, and Thompson
, G.
, 2011
, “Effects of Additional Stimuli on Idea-Finding in Design Teams
,” J. Eng. Des.
, 22
(1
), pp. 31
–54
. 10.1080/0954482090291136619.
Fu
, K.
, Chan
, J.
, Cagan
, J.
, Kotovsky
, K.
, Schunn
, C.
, and Wood
, K.
, 2013
, “The Meaning of ‘Near’ and ‘Far’: The Impact of Structuring Design Databases and the Effect of Distance of Analogy on Design Output
,” ASME J. Mech. Des.
, 135
(2
), p. 021007
. 10.1115/1.402315820.
Gosnell
, C. A.
, and Miller
, S. R.
, 2014
, “A Novel Method for Providing Global Assessments of Design Concepts Using Single-Word Adjectives and Semantic Similarity
,” 2nd Biennial International Conference on Dynamics for Design; 26th International Conference on Design Theory and Methodology
, Buffalo, NY
, Aug. 17–20
, No. 46407, p. V007T07A044
. 10.1115/detc2014-3538021.
Gosnell
, C. A.
, and Miller
, S. R.
, 2015
, “But Is It Creative? Delineating the Impact of Expertise and Concept Ratings on Creative Concept Selection
,” ASME J. Mech. Des.
, 138
(2
), p. 021101
. 10.1115/1.403190422.
Grace
, K.
, Maher
, M. L.
, Fisher
, D.
, and Brady
, K.
, 2015
, “Data-Intensive Evaluation of Design Creativity Using Novelty, Value, and Surprise
,” Int. J. Des. Creativity Innovation
, 3
(3–4
), pp. 125
–147
. 10.1080/21650349.2014.94329523.
Srivathsavai
, R.
, Genco
, N.
, Hölttä-Otto
, K.
, and Seepersad
, C. C.
, 2010
, “Study of Existing Metrics Used in Measurement of Ideation Effectiveness
,” Proceedings of ASME IDETC/CIE – 22nd International Conference on Design Theory and Methodology
, Montreal, Quebec, Canada
, Aug. 15–18
, pp. 355
–366
.24.
Shah
, J. J.
, Kulkarni
, S. V.
, and Vargas-Hernandez
, N.
, 2000
, “Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,” ASME J. Mech. Des.
, 122
(4
), pp. 377
–384
. 10.1115/1.131559225.
Oman
, S. K.
, Tumer
, I. Y.
, Wood
, K.
, and Seepersad
, C.
, 2013
, “A Comparison of Creativity and Innovation Metrics and Sample Validation Through In-Class Design Projects
,” Res. Eng. Des.
, 24
(1
), pp. 65
–92
. 10.1007/s00163-012-0138-926.
Boden
, M. A.
, 1996
, Dimensions of Creativity
, Mit Press
, Cambridge, MA
.27.
Colton
, S.
, Charnley
, J. W.
, and Pease
, A.
, 2011
, “Computational Creativity Theory: The FACE and IDEA Descriptive Models
,” Proceedings of the Second International Conference on Computational Creativity
, Mexico City
, Apr. 27–29
, pp. 90
–95
.28.
Siddharth
, L.
, and Chakrabarti
, A.
, 2018
, “Evaluating the Impact of Idea-Inspire 4.0 on Analogical Transfer of Concepts
,” Artif. Intell. Eng. Des. Anal. Manuf.
, 32
(4
), pp. 431
–448
. 10.1017/S089006041800013629.
Chakrabarti
, A.
, Sarkar
, P.
, Leelavathamma
, B.
, and Nataraju
, B.
, 2005
, “A Functional Representation for Aiding Biomimetic and Artificial Inspiration of New Ideas
,” Artif. Intell. Eng. Des. Anal. Manuf.
, 19
(2
), pp. 113
–132
. 10.1017/S089006040505010930.
Purcell
, A. T.
, and Gero
, J. S.
, 1998
, “Drawings and the Design Process: A Review of Protocol Studies in Design and Other Disciplines and Related Research in Cognitive Psychology
,” Des. Stud.
, 19
(4
), pp. 389
–430
. 10.1016/S0142-694X(98)00015-531.
Ware
, C.
, 2010
, Visual Thinking: For Design
, Morgan Kaufmann
, Burlington, MA
.32.
Vidal
, R.
, Mulet
, E.
, and Gómez-Senent
, E.
, 2004
, “Effectiveness of the Means of Expression in Creative Problem-Solving in Design Groups
,” J. Eng. Des.
, 15
(3
), pp. 285
–298
. 10.1080/0954482041000169758733.
Croft
, D.
, Coupland
, S.
, Shell
, J.
, and Brown
, S.
, 2013
, “A Fast and Efficient Semantic Short Text Similarity Metric
,” 2013 13th UK Workshop on Computational Intelligence (UKCI)
, Guildford, UK
, Sept. 9–11
, pp. 221
–227
.34.
Li
, Y.
, McLean
, D.
, Bandar
, Z. A.
, O’shea
, J. D.
, and Crockett
, K.
, 2006
, “Sentence Similarity Based on Semantic Nets and Corpus Statistics
,” IEEE Trans. Knowl. Data Eng.
, 18
(8
), pp. 1138
–1150
. 10.1109/TKDE.2006.13035.
Resnik
, P.
, 1995
, “Using Information Content to Evaluate Semantic Similarity in a Taxonomy,” CoRR, vol. abs/cmp-lg/9511007.36.
Jiang
, J. J.
, and Conrath
, D. W.
, 1997
, “Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy
,” Proceedings of the 10th Research on Computational Linguistics International Conference
, Taipei, Taiwan
, August
https://www.aclweb.org/anthology/O97-1002.37.
Li
, Y.
, Bandar
, Z. A.
, and McLean
, D.
, 2003
, “An Approach for Measuring Semantic Similarity Between Words Using Multiple Information Sources
,” IEEE Trans. Knowl. Data Eng.
, 15
(4
), pp. 871
–882
. 10.1109/TKDE.2003.120900538.
Gao
, J.-B.
, Zhang
, B.-W.
, and Chen
, X.-H.
, 2015
, “A WordNet-Based Semantic Similarity Measurement Combining Edge-Counting and Information Content Theory
,” Eng. Appl. Artif. Intell.
, 39
(1
), pp. 80
–88
. 10.1016/j.engappai.2014.11.00939.
Siddharth
, L.
, and Sarkar
, P.
, 2018
, “A Multiple-Domain Matrix Support to Capture Rationale for Engineering Design Changes
,” ASME J. Comput. Inf. Sci. Eng.
, 18
(2
), p. 021014
. 10.1115/1.403985040.
Amabile
, T. M.
, 1982
, “Social Psychology of Creativity: A Consensual Assessment Technique.
,” J. Pers. Soc. Psychol.
, 43
(5
), pp. 997
–1013
. 10.1037/0022-3514.43.5.99741.
Keshwani
, S.
, and Chakrabarti
, A.
, 2017
, “Towards Automatic Classification of Description of Analogies Into SAPPhIRE Constructs
,” Proceedings of 6th International Conference on Research into Design
, Guwahati, India
, Jan. 10–12
, pp. 643
–655
. http://dx.doi.org/10.1007-978-981-10-3521-0_5.42.
Kudrowitz
, B. M.
, and Wallace
, D.
, 2013
, “Assessing the Quality of Ideas From Prolific, Early-Stage Product Ideation
,” J. Eng. Des.
, 24
(2
), pp. 120
–139
. 10.1080/09544828.2012.67663343.
Christiaans
, H. H.
, 2002
, “Creativity as a Design Criterion
,” Commun. Res. J.
, 14
(1
), pp. 41
–54
.Copyright © 2019 by ASME
You do not currently have access to this content.
