Abstract

This paper proposes a novel framework for building semantic networks from a seed design statement using Recursive Object Modeling (ROM), Word2Vec language modeling, and vector semantic-based method. Semantic Scholar API was used to retrieve abstracts of scientific papers to build ROM-based Semantic Networks to address the design problem implied in the seed design statement, following Environment Analysis from Environment-Based Design (EBD) methodology. The proposed framework was applied to construct the semantic network for a project to design aircraft braking systems, which demonstrates the framework's efficiency. The presented research makes two major contributions: a ROM-based phrase extractor and a domain-specific language model, which is trained on the automatically collected literature abstracts. Using a manually created and assessed truth set containing 100 pairs of abstract-key phrases, the phrase extractor was evaluated by benchmarking it with two existing off-the-shelf key phrase extraction algorithms: TextRank and Rake. The ROM-based phrase extractor extracted most key phrases from target domains and showed higher precision, recall, and F-1 scores than other methods. Meanwhile, the trained project-specific language model was evaluated using the NASA thesaurus. We randomly sampled 457 pairs of connected domain-specific terms related to aircraft braking and landing knowledge. Our Skip-gram model was compared with Google's pre-trained word2vec model and a baseline word2vec model. The results demonstrated that our language model could detect the most pairs of concepts from the NASA thesaurus. The generated semantic network can be applied to design information retrieval, computer-aided design idea generation, cross-domain communication support system, and designer training tool.

References

1.
Zeng
,
Y.
,
2011
, “
Environment-Based Design (EBD)
,”
Proceedings of the ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Washington, DC
,
Aug. 28–31
, pp.
1
14
.
2.
Tatlisu
,
E.
, and
Kaya
,
Ç
,
2017
, “
The Reflection of Experiential Knowledge Into Professional Practice: Case of Industrial Design Education
,”
Des. J.
,
20
(
sup1
), pp.
S1415
S1429
.
3.
Wong
,
W. L.
, and
Radcliffe
,
D. F.
,
2000
, “
The Tacit Nature of Design Knowledge
,”
Technol. Anal. Strateg. Manag.
,
12
(
4
), pp.
493
512
.
4.
Yoshioka
,
M.
,
Sekiya
,
T.
, and
Tomiyama
,
T.
,
1998
, “
Design Knowledge Collection by Modeling
,” Globalization of Manufacturing in the Digital Communication Era of the 21st Century, pp.
287
298
. 10.1007/978-0-387-35351-7_23.
5.
Ehrlinger
,
L.
, and
Wöß
,
W.
, “
Towards a Definition of Knowledge Graphs.
Joint Proceedings of the Posters and Demos Track of the 12th International Conference on Semantic Systems
,
Leipzig, Germany
,
Sept. 13–14
, p. 651.
6.
Fensel
,
D.
,
Şimşek
,
U.
,
Angele
,
K.
,
Huaman
,
E.
,
Kärle
,
E.
,
Panasiuk
,
O.
,
Toma
,
I.
, et al
,
2020
, “Introduction: What is a Knowledge Graph?,”
Knowledge Graphs
,
Springer Cham
,
Cham
, pp.
1
10
.
7.
Buchgeher
,
G.
,
Gabauer
,
D.
,
Martinez-Gil
,
J.
, and
Ehrlinger
,
L.
,
2021
, “
Knowledge Graphs in Manufacturing and Production: A Systematic Literature Review
,”
IEEE Access
,
9
, pp.
55537
55554
.
8.
Abu-Salih
,
B.
,
2021
, “
Domain-Specific Knowledge Graphs: A Survey
,”
J. Netw. Comput. Appl.
,
185
, p.
103076
.
9.
Han
,
J.
,
Sarica
,
S.
,
Shi
,
F.
, and
Luo
,
J.
,
2022
, “
Semantic Networks for Engineering Design: State of the Art and Future Directions
,”
ASME J. Mech. Des.
,
144
(
2
), p.
020802
.
10.
Geum
,
Y.
, and
Park
,
Y.
,
2016
, “
How to Generate Creative Ideas for Innovation: A Hybrid Approach of WordNet and Morphological Analysis
,”
Technol. Forecast. Soc. Change
,
111
, pp.
176
187
.
11.
He
,
Y.
,
Camburn
,
B.
,
Liu
,
H.
,
Luo
,
J.
,
Yang
,
M.
, and
Wood
,
K.
,
2019
, “
Mining and Representing the Concept Space of Existing Ideas for Directed Ideation
,”
ASME J. Mech. Des.
,
141
(
12
), p.
121101
.
12.
Sarica
,
S.
,
Song
,
B.
,
Luo
,
J.
, and
Wood
,
K.
,
2019
, “
Technology Knowledge Graph for Design Exploration: Application to Designing the Future of Flying Cars
,”
Proceedings of the ASME Design Engineering Technical Conference
,
Anaheim, CA
,
Aug. 18–21
.
13.
Sarica
,
S.
,
Luo
,
J.
, and
Wood
,
K. L.
,
2020
, “
TechNet: Technology Semantic Network Based on Patent Data
,”
Expert Syst. Appl.
,
142
, p.
112995
.
14.
Hu
,
M.
, and
Liu
,
B.
,
2004
, “
Mining and Summarizing Customer Reviews
,”
KDD-2004—Proceedings Of the Tenth ACM SIGKDD International. Conference on Knowledge Discovery and Data Mining
, pp.
168
177
.
15.
Zeng
,
Y.
,
2020
, “
Environment: the First Thing to Look at in Conceptual Design
,”
J. Integr. Des. Process Sci.
,
24
(
1
), pp.
45
66
.
16.
Bojanowski
,
P.
,
Grave
,
E.
,
Joulin
,
A.
, and
Mikolov
,
T.
,
2017
, “
Enriching Word Vectors With Subword Information
,”
Trans. Assoc. Comput. Linguist.
,
5
, pp.
135
146
.
17.
Zeng
,
Y.
,
2008
, “
Recursive Object Model (ROM)-Modelling of Linguistic Information in Engineering Design
,”
Comput. Ind.
,
59
(
6
), pp.
612
625
.
18.
Noy
,
N. F.
, and
McGuinness
,
D. L.
,
2001
, “
Ontology Development 101: A Guide to Creating Your First Ontology
,”
Knowl. Syst. Lab. Tech Rep.
,
9
(
12
), p.
2317
.
19.
Gruber
,
T. R.
,
1993
, “
A Translation Approach to Portable Ontology Specifications
,”
Knowl. acqusition
,
5
(
2
), pp.
199
220
.
20.
Miller
,
G.
,
Beckwith
,
R.
,
Fellbaum
,
C.
,
Gross
,
D.
, and
Miller
,
K.
,
1993
, “
Introduction to WordNet: On-Line Database
,”
Int. J. Lexicogr.
,
3
(
4
), pp.
235
244
.
21.
Štorga
,
M.
,
Andreasen
,
M. M.
, and
Marjanović
,
D.
,
2010
, “
The Design Ontology: Foundation for the Design Knowledge Exchange and Management
,”
J. Eng. Des.
,
21
(
4
), pp.
427
454
.
22.
El-Sappagh
,
S.
,
Franda
,
F.
,
Ali
,
F.
, and
Kwak
,
K. S.
,
2018
, “
SNOMED CT Standard Ontology Based on the Ontology for General Medical Science
,”
BMC Med. Inform. Decis. Mak.
,
18
(
1
), pp.
1
19
.
23.
Pulido
,
J. R. G.
,
Ruiz
,
M. A. G.
,
Herrera
,
R.
,
Cabello
,
E.
,
Legrand
,
S.
, and
Elliman
,
D.
,
2006
, “
Ontology Languages for the Semantic web: A Never Completely Updated Review
,”
Knowledge-Based Syst.
,
19
(
7
), pp.
489
497
.
24.
Lin
,
J.
,
Fox
,
M. S.
, and
Bilgic
,
T.
,
1996
, “
A Requirement Ontology for Engineering Design
,”
Concurr. Eng. Res. Appl.
,
4
(
3
), pp.
279
291
.
25.
Gero
,
J. S.
, and
Kannengiesser
,
U.
,
2014
, “The Function-Behaviour-Structure Ontology of Design,”
An Anthology of Theories and Models of Design
,
A.
Chakrabarti
, and
L. T. M.
Blessing
, eds.,
Springer
,
London
, pp.
67
81
.
26.
Sim
,
S. K.
, and
Duffy
,
A. H. B.
,
2003
, “
Towards an Ontology of Generic Engineering Design Activities
,”
Res. Eng. Des.
,
14
(
4
), pp.
200
223
.
27.
Fernandes
,
R.
,
Grosse
,
I.
,
Krishanamutry
,
S.
, and
Wileden
,
J.
,
2007
, “
Design and Innovative Methodologies in a Semantic Framework
,”
International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Las Vegas, NV
,
Sept. 4–7
.
28.
Catalano
,
C. E.
,
Camossi
,
E.
,
Ferrandes
,
R.
,
Cheutet
,
V.
, and
Sevilmis
,
N.
,
2009
, “
A Product Design Ontology for Enhancing Shape Processing in Design Workflows
,”
J. Intell. Manuf.
,
20
(
5
), pp.
553
567
.
29.
Rockwell
,
J.
,
Grosse
,
I. R.
,
Krishnamurty
,
S.
, and
Wileden
,
J. C.
,
2009
, “
A Decision Support Ontology for Collaborative Decision Making in Engineering Design
,”
2009 International Symposium on Collaborative Technology Systems CTS 2009
,
Baltimore, MD
,
May 18–22
, pp.
1
9
.
30.
Rockwell
,
J. A.
,
Grosse
,
I. R.
,
Krishnamurty
,
S.
, and
Wileden
,
J. C.
,
2010
, “
A Semantic Information Model for Capturing and Communicating Design Decisions
,”
ASME J. Comput. Inf. Sci. Eng.
,
10
(
3
), p.
031008
.
31.
Dixon
,
J. R.
,
Howe
,
A.
,
Cohen
,
P. R.
, and
Simmons
,
M. K.
,
1987
, “
Dominic I: Progress Toward Domain Independence in Design by Iterative Redesign
,”
Eng. Comput.
,
2
(
3
), pp.
137
145
.
32.
O'Leary
,
D. E.
,
1991
, “Design, Development and Validation Of Expert Systems: A Survey of Developers,”
Validation, Verification and Test of Knowledge-Based Systems
,
M.
Ayel
, and
J.-P.
Laurent
, eds.,
John Wiley & Sons, Inc.
,
New York
, pp.
3
19
.
33.
Sowa
,
J. F.
,
1987
, “Semantic Networks,”
Encyclopedia of Artificial Intelligence
,
S. C.
Shapiro
, ed.,
John Wiley & Sons, Inc.
,
New York
.
34.
Frisch
,
A. M.
,
1982
, “
What’ s in a Semantic Network?
20th Annual Meeting of the Association for Computational Linguistics
,
Toronto, Ontario, Canada
,
June 16–18
, pp.
19
27
.
35.
Jamie. Rogers
,
K. J.
,
Priest
,
J. W.
, and
Haddock
,
G.
,
1995
, “
The Use of Semantic Networks to Support Concurrent Engineering in Semiconductor Product Development
,”
J. Intell. Manuf.
,
6
(
5
), pp.
311
319
.
36.
Siddharth
,
L.
,
Blessing
,
L. T. M.
,
Wood
,
K. L.
, and
Luo
,
J.
,
2022
, “
Engineering Knowledge Graph From Patent Database
,”
ASME J. Comput. Inf. Sci. Eng.
,
22
(
2
), p.
021008
.
37.
Jiang
,
S.
,
Sarica
,
S.
,
Song
,
B.
,
Hu
,
J.
, and
Luo
,
J.
,
2022
, “
Patent Data for Engineering Design: A Critical Review and Future Directions
,”
ASME J. Comput. Inf. Sci. Eng.
,
22
(
6
), p.
060902
.
38.
Cheong
,
H.
,
Li
,
W.
,
Cheung
,
A.
,
Nogueira
,
A.
, and
Iorio
,
F.
,
2017
, “
Automated Extraction of Function Knowledge From Text
,”
ASME J. Mech. Des.
,
139
(
11
), p.
111407
.
39.
Liu
,
Q.
,
Wang
,
K.
,
Li
,
Y.
, and
Liu
,
Y.
,
2020
, “
Data-Driven Concept Network for Inspiring Designers’ Idea Generation
,”
ASME J. Comput. Inf. Sci. Eng.
,
20
(
3
), p.
031004
.
40.
Siddharth
,
L.
,
Blessing
,
L.
, and
Luo
,
J.
,
2022
, “
Natural Language Processing in-and-for Design Research
,”
Des. Sci.
,
8
.
41.
Tan
,
S.
,
Zeng
,
Y.
, and
Montazami
,
A.
,
2011
, “Medical Devices Design Based on EBD: A Case Study,”
Biomedical Engineering
,
S. C.
Suh
,
V. P.
Gurupur
, and
M. M.
Tanik
, eds.,
Springer
,
New York
, pp.
3
15
.
42.
Yi
,
H.
,
Deng
,
X.
, and
Zeng
,
Y.
,
2014
, “
Curriculum Design Using EBD Methodology: Preliminary Study of English Education in Mid-West University of China
,”
Proceedings of the 2014 International Conference on Innovative Design and Manufacturing, ICIDM 2014
,
Montreal, Quebec, Canada
,
Aug. 13–15
, vol. 17, pp.
282
287
.
43.
Tan
,
S.
,
Zeng
,
Y.
,
Huet
,
G.
, and
Fortin
,
C.
,
2013
, “
Effective Reverse Engineering of Qualitative Design Knowledge: a Case Study of Aerospace Pylon Design
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Portland, OR
,
Aug. 4–7
.
44.
Chen
,
Z. Y.
, and
Zeng
,
Y.
,
2006
, “
Classification of Product Requirements Based on Product Environment
,”
Concurr. Eng. Res. Appl.
,
14
(
3
), pp.
219
230
.
45.
Wang
,
M.
, and
Zeng
,
Y.
,
2009
, “
Asking the Right Questions to Elicit Product Requirements
,”
Int. J. Comput. Integr. Manuf.
,
22
(
4
), pp.
283
298
.
46.
Qi
,
P.
,
Zhang
,
Y.
,
Zhang
,
Y.
,
Bolton
,
J.
, and
Manning
,
C. D.
,
2020
, “
Stanza: A Python Natural Language Processing Toolkit For Many Human Languages
”, pp.
101
108
.
47.
Deng
,
X.
, and
Yong
,
Z.
,
2014
, “
A Novel Framework for Product/Service Systems Using Environment-Based Design Methodology
,”
ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Buffalo, NY
,
Aug. 17–20
, pp.
1
12
.
48.
Manning
,
C. D.
,
Surdeanu
,
M.
,
Bauer
,
J.
,
Finkel
,
J.
,
Bethard
,
S. J.
, and
McClosky
,
D.
,
2014
, “
The Stanford CoreNLP Natural Language Processing Toolkit
,”
Proceedings of 52nd Annual Meeting of the Association For Computer Linguistics: System Demonstration
,
Baltimore, MD
,
June 23–24
, pp.
55
60
.
49.
Devlin
,
J.
,
Chang
,
M. W.
,
Lee
,
K.
, and
Toutanova
,
K.
,
2018
, “
BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding
,”
2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics
,
Minneapolis, MN
,
June 2–7
.
50.
Brown
,
Tom
,
Mann
,
Benjamin
,
Ryder
,
Nick
,
Subbiah
,
Melanie
,
Kaplan
,
Jared D
, et al
,
2020
, “
Language Models are Few-Shot Learners
,”
NeurIPS 2020
,
Virtual online
,
Dec. 6–12
.
51.
Liu
,
Y.
,
Myle
,
Ott
,
Goyal
,
Naman
,
Du
,
Jingfei
,
Joshi
,
Mandar
,
Chen
,
Danqi
,
Levy
,
Omer
,
Lewis
,
Mike
,
Zettlemoyer
,
Luke
, and
Stoyanov
,
Veselin
,
2019
, “
RoBERTa: A Robustly Optimized BERT Pretraining Approach
,”
arXiv preprint
, https://arxiv.org/abs/1907.11692pp.
1
13
.
52.
Mikolov
,
T.
,
Chen
,
K.
,
Corrado
,
G.
, and
Dean
,
J.
,
2013
, “
Efficient Estimation of Word Representations in Vector Space
”, ICLR (Workshop Poster). January 2013, pp.
1
12
.
53.
Rong
,
X.
,
2014
, “
Word2vec Parameter Learning Explained
”, pp.
1
21
. http://arxiv.org/abs/1411.2738.
54.
van der Maaten
,
L.
, and
Hinton
,
G.
,
2008
, “
Visualizing Data Using t-SNE
,”
J. Mach. Learn. Res.
,
9
(
11
), pp.
187
202
.
55.
Rose
,
S.
,
Engel
,
D.
,
Cramer
,
N.
, and
Cowley
,
W.
,
2010
, “Automatic Keyword Extraction From Individual Documents,”
Textile Mining: Applications and Theory
,
M. W.
Berry
, and
J.
Kogan
, eds.,
Wiley
,
Chichester, UK
, pp.
1
277
.
56.
Mihalcea
,
R.
, and
Tarau
,
P.
,
2004
, “
TextRank: Bringing Order Into Texts
,”
Proceedings of 2004 Conference on Empirical Methods in Natural Language Processing, EMNLP 2004—A Meet. SIGDAT, a Spec. Interes. Gr. ACL Held Conjunction With ACL 2004
, vol.
85
, pp.
404
411
.
57.
NASA
,
1998
, “
NASA Thesaurus Volume 1—Hierarchical Listing With Definitions
”, No. NASA SP-1998-7501, 1998, p.
1100
.
58.
Zeng
,
Y.
, and
Gu
,
P.
,
1999
, “
A Science-Based Approach to Product Design Theory. Part I: Formulation and Formalization of Design Process
,”
Robot. Comput. Integr. Manuf.
,
15
(
4
), pp.
331
339
.
59.
Zeng
,
Y.
,
2015
, “
Environment-Based Design (EBD): A Methodology for Transdisciplinary Design
,”
J. Integr. Des. Process Sci.
,
19
(
1
), pp.
5
24
.
60.
Zeng
,
Y.
, and
Cheng
,
G.
,
1991
, “
On the Logic of Design
,”
Des. Stud.
,
12
(
3
), pp.
137
141
.
61.
Nguyen
,
T. A.
, and
Zeng
,
Y.
,
2012
, “
A Theoretical Model of Design Creativity: Nonlinear Design Dynamics and Mental Stress-Creativity Relation
,”
J. Integr. Des. Process Sci.
,
16
(
3
), pp.
65
88
.
62.
Eris
,
O.
,
2004
,
Effective Inquiry for Innovative Engineering Design
,
Springer
,
New York
.
63.
Moreno
,
D. P.
,
Hernández
,
A. A.
,
Yang
,
M. C.
,
Otto
,
K. N.
,
Hölttä-Otto
,
K.
,
Linsey
,
J. S.
,
Wood
,
K. L.
, and
Linden
,
A.
,
2014
, “
Fundamental Studies in Design-by-Analogy: A Focus on Domain-Knowledge Experts and Applications to Transactional Design Problems
,”
Des. Stud.
,
35
(
3
), pp.
232
272
.
64.
Jiang
,
S.
,
Hu
,
J.
,
Wood
,
K. L.
, and
Luo
,
J.
,
2022
, “
Data-Driven Design-by-Analogy: State-of-the-Art and Future Directions
,”
ASME J. Mech. Des.
,
144
(
2
), p.
020801
.
65.
Linsey
,
J. S.
,
Markman
,
A. B.
, and
Wood
,
K. L.
,
2012
, “
Design by Analogy: A Study of the WordTree Method for Problem Re-Representation
,”
ASME J. Mech. Des.
,
134
(
4
), p.
041009
.
66.
Chakrabarti
,
A.
,
Sarkar
,
P.
,
Leelavathamma
,
B.
, and
Nataraju
,
B. S.
,
2006
, “
A Functional Representation for Aiding Biomimetic and Artificial Inspiration of New Ideas
,”
Artif. Intell. Eng. Des. Anal. Manuf. AIEDAM
,
19
(
2
), pp.
113
132
.
67.
Akondy
,
V.
, and
Murthy
,
S.
,
2016
, “
From Novice to Expert Instructional Designer: a Training Based on Cognitive Apprenticeship Model
,”
Proceedings of the IEEE 7th International Conference on Technology Education, T4E 2015
,
Warangal, India
,
Dec. 10–12
, pp.
53
60
. .
68.
Egan
,
P. F.
,
Schunn
,
C.
,
Cagan
,
J.
, and
LeDuc
,
P. R.
,
2015
, “
Development of Graphical User Interfaces to Improve Human Design Proficiency for Complex Multi-Level Biosystems
,”
ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Boston, MA
,
Aug. 2–5
.
69.
Sarica
,
S.
,
Song
,
B.
,
Luo
,
J.
, and
Wood
,
K. L.
,
2021
, “
Idea Generation With Technology Semantic Network
,”
Artif. Intell. Eng. Des. Anal. Manuf. AIEDAM
,
35
(
3
), pp.
265
283
.
70.
Lan
,
Z.
,
Chen
,
M.
,
Goodman
,
S.
,
Gimple
,
K.
,
Sharma
,
P.
, and
Soricut
,
R.
,
2020
, “
Albert: A Lite BERT for Self-Supervised Learning of Language Representation
,”
8th International Conference on Learning Representations
,
Addis, Ababa, Ethiopia
,
Apr. 26–30
, pp.
1
17
.
71.
Raffel
,
C.
,
Shazeer
,
N.
,
Roberts
,
A.
,
Lee
,
K.
,
Narang
,
S.
,
Matena
,
M.
,
Zhou
,
Y.
,
Li
,
W.
, and
Liu
,
P. J.
,
2020
, “
Exploring the Limits of Transfer Learning With a Unified Text-to-Text Transformer
,”
J. Mach. Learn. Res.
,
21
(
140
), pp.
1
67
.
72.
Qiu
,
X. P.
,
Sun
,
T. X.
,
Xu
,
Y. G.
,
Shao
,
Y. F.
,
Dai
,
N.
, and
Huang
,
X. J.
,
2020
, “
Pre-Trained Models for Natural Language Processing: A Survey
,”
Sci. China Technol. Sci.
,
63
(
10
), pp.
1872
1897
.
You do not currently have access to this content.