Abstract

Design education has traditionally relied heavily on physical integration as it involves a lot of hands-on work, group critiques, and collaborative projects, but the COVID-19 pandemic has fundamentally shifted the way teaching is done, which resulted in many institutions adapting to remote teaching and learning environments. This has created challenges for design educators who have had to find ways to evaluate students’ progress in the absence of in-person interactions. In this paper, we are proposing a dashboard visualization approach that helps educators monitor the progression of the entire class of students using artificial intelligence (AI) by tracking a time-based evolution of a design statement. This approach uses various natural language processing (NLP) models to produce stock-like charts, which represent students’ and student groups’ progression through a series of divergence and convergence phases. These charts become a form of design artifact that allows educator(s) to gain a bird’s-eye view of the class and react to groups that may require assistance; at the same time, it becomes a qualitative means of evaluation and comparison across students and groups. Toward the end, this paper also showcases a web-based platform that is publicly available using such methodology, a case study that applied so methodology and recommendations of future works possible.

References

1.
Camburn
,
B. A.
,
Auernhammer
,
J. M.
,
Sng
,
K. H. E.
,
Mignone
,
P. J.
,
Arlitt
,
R. M.
,
Perez
,
K. B.
,
Huang
,
Z.
,
Basnet
,
S.
,
Blessing
,
L. T.
, and
Wood
,
K. L.
,
2017
, “
Design Innovation: A Study of Integrated Practice
,”
29th International Conference on Design Theory and Methodology (DTM)
,
Cleveland, OH
,
Aug. 6–9
.
2.
Lauff
,
C.
,
Lauff
,
C.
,
Yu Hui
,
W.
,
Teo
,
K.
,
Png
,
S.
,
Swee
,
A.
,
Collopy
,
A.
, and
Vargas
,
B.
,
2021
,
Design Innovation Methodology Handbook – Embedding Design in Organizations
1st ed.,
SUTD International Design Centre
.
3.
Newbill
,
L.
,
2010
, “
Instructional Design as Critical and Creative Thinking: A Journey Through a Jamestown-Era Native American Village
,”
TechTrends
,
54
(
4
), pp.
27
37
.
4.
Šuligoj
,
V.
,
Zavbi
,
R.
, and
Avsec
,
S.
,
2020
, “
Interdisciplinary Critical and Design Thinking
,”
Int. J. Eng. Educ.
,
36
(
1
), pp.
84
95
.
5.
Cropley
,
A.
,
2006
, “
In Praise of Convergent Thinking
,”
Creat. Res. J.
,
18
(
3
), pp.
391
404
.
6.
Buchanan
,
R.
,
1992
, “
Wicked Problems in Design Thinking
,”
Des. Issues
,
8
(
2
), pp.
5
21
.
7.
OpenAI
,
2023
, “ChatGPT (Mar 14 Version) [Large Language Model].”
8.
Thiruselvam
,
A.
,
2022
, “Singapore Has Among the World's Best Education Systems, so What Can Australia Learn From It?,” https://www.abc.net.au/news/2022-10-21/how-australia-can-compare-to-singapore-education/101511316
9.
Design Education Advisory Committee
,
2022
, “Beyond 2050: Reimagining Design Education in Singapore,” https://designsingapore.org/resources/design-education-advisory-committee/
11.
Ministry of Education Singapore
,
2017
, “Collaborating & Solving Problems in Teams: Singapore Students Show They Have What It Takes,” https://www.moe.gov.sg/news/press-releases/20171121-collaborating-and-solving-problems-in-teams-singapore-students-show-they-have-what-it-takes
12.
Ministry of Education Singapore
,
2022
, “21st Century Competencies,” https://www.moe.gov.sg/education-in-sg/21st-century-competencies
13.
Sudhindra
,
S. T.
, and
Blessing
,
L. T.
,
2021
, “
A Framework for Design Competency Assessment
,”
ICED21 International Conference on Engineering Design
,
Gothenburg, Sweden
,
Aug. 16–20
.
14.
Koronis
,
G.
,
Casakin
,
H.
, and
Silva
,
A.
,
2021
, “
Crafting Briefs to Stimulate Creativity in the Design Studio
,”
Think. Ski. Creat.
,
40
(
1
), p.
100810
.
15.
Kang
,
K. S. J.
,
Chia
,
P. Z.
,
Koronis
,
G.
, and
Silva
,
A.
,
2018
, “
Exploring the Use of a Full Factorial Design of Experiment to Study Design Briefs for Creative Ideation
,”
ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Quebec, Canada
,
Aug. 26–29
.
16.
Koronis
,
G.
,
Silva
,
A.
, and
Kang
,
J.
,
2018
, “
The Impact of Design Briefs on Creativity: A Study on Measuring Student Designers Outcomes
,”
DS 92: Proceedings of the DESIGN 2018 15th International Design Conference
,
Dubrovnik, Croatia
,
May 21–24
.
17.
Howard
,
T. J.
,
Dekoninck
,
E. A.
, and
Culley
,
S. J.
,
2010
, “
The Use of Creative Stimuli at Early Stages of Industrial Product Innovation
,”
Res. Eng. Des.
,
21
(
4
), pp.
263
274
.
18.
Chiu
,
M.
,
Silva
,
A.
, and
Lim
,
S.
,
2023
, “
Design Progress Dashboard: Visualising a Quantitative Divergent/Convergent Pattern of Design Team Progress Through Natural Language Processing
,”
Design Computing and Cognition’22
,
Glasgow, Scotland
,
July 2–6
.
19.
Tannen
,
D.
,
1986
, “
0/Frame
,”
Quaderni di semantica
,
7
(
1
), p.
106
.
20.
Paton
,
R.
, and
Dorst
,
K.
,
2010
, “
Briefing and Reframing
,”
DTRS8 Interpreting Design Thinking: Procedings of the 8th Design Thinking Research Symposium
,
Sydney, Australia
,
Oct. 19–20
.
21.
Carlgren
,
L.
,
Rauth
,
I.
, and
Elmquist
,
M.
,
2016
, “
Framing Design Thinking: The Concept in Idea and Enactment
,”
Creat. Innov. Manag.
,
25
(
1
), pp.
38
57
.
22.
UNESCO
,
2023
, “UNESCO’s Education Response to COVID-19,” https://www.unesco.org/en/covid-19/education-response/initiatives
23.
Boon
,
N. S.
,
2021
, “
Developing a Hybrid Learning Curriculum Framework for Schools
,”
Current and Critical Issues in Curriculum, Learning and Assessment
,
UNESCO International Bureau of Education
, https://unesdoc.unesco.org/ark:/48223/pf0000377482
24.
Dziuban
,
C.
,
Graham
,
C. R.
,
Moskal
,
P. D.
,
Norberg
,
A.
, and
Sicilia
,
N.
,
2018
, “
Blended Learning: The New Normal and Emerging Technologies
,”
Int. J. Educ. Technol. High. Educ.
,
15
(
1
), pp.
1
16
.
25.
Bhargava
,
P.
,
2022
, “The Age of Hybrid Education,” The Economic Times, https://economictimes.indiatimes.com/nri/study/the-age-of-hybrid-education/articleshow/93638236.cms
26.
Garrison
,
D. R.
, and
Kanuka
,
H.
,
2004
, “
Blended Learning: Uncovering Its Transformative Potential in Higher Education
,”
Internet High. Educ.
,
7
(
2
), pp.
95
105
.
27.
Picciano
,
A.
,
2009
, “
Blending With Purpose: The Multimodal Model
,”
J. Res. Center Educ. Technol.
,
5
(
1
), pp.
4
14
.
28.
Dziuban
,
C.
, and
Moskal
,
P.
,
2011
, “
A Course Is a Course Is a Course: Factor Invariance in Student Evaluation of Online, Blended and Face-to-Face Learning Environments
,”
Internet High. Educ.
,
14
(
4
), pp.
236
241
.
29.
Means
,
B.
,
Toyama
,
Y.
,
Murphy
,
R.
, and
Baki
,
M.
,
2013
, “
The Effectiveness of Online and Blended Learning: A Meta-Analysis of the Empirical Literature
,”
Teach. Coll. Rec.
,
115
(
3
), pp.
1
47
.
30.
Chen
,
L.
,
Chen
,
P.
, and
Lin
,
Z.
,
2020
, “
Artificial Intelligence in Education: A Review
,”
IEEE Access
,
8
(
1
), pp.
75264
75278
.
31.
Han
,
X.
,
Hu
,
F.
,
Xiong
,
G.
,
Liu
,
X.
,
Gong
,
X.
,
Niu
,
X.
,
Shi
,
W.
, and
Wang
,
X.
,
2018
, “
Design of AI + Curriculum for Primary and Secondary Schools in Qingdao
,”
2018 Chinese Automation Congress (CAC)
,
Xi'an, China
, pp.
4135
4140
.
32.
Alshater
,
M. M.
,
2022
, “Exploring the Role of Artificial Intelligence in Enhancing Academic Performance: A Case Study of ChatGPT,” Available at SSRN.
33.
Hertz
,
A.
,
Mokady
,
R.
,
Tenenbaum
,
J.
,
Aberman
,
K.
,
Pritch
,
Y.
, and
Cohen-Or
,
D.
,
2022
, “
Prompt-to-Prompt Image Editing With Cross Attention Control
,” arXiv preprint
arXiv:2208.01626
. https://arxiv.org/abs/2208.01626
34.
Koh
,
E. C.
,
2022
, “
Design Change Prediction Based on Social Media Sentiment Analysis
,”
AI EDAM
,
36
(
1
), p.
e24
.
35.
Dong
,
A.
,
Hill
,
A. W.
, and
Agogino
,
A. M.
,
2004
, “
A Document Analysis Method for Characterizing Design Team Performance
,”
ASME J. Mech. Des.
,
126
(
3
), pp.
378
385
.
36.
Ferguson
,
S. A.
,
Cheng
,
K.
,
Adolphe
,
L.
,
Van de Zande
,
G.
,
Wallace
,
D.
, and
Olechowski
,
A.
,
2022
, “
Communication Patterns in Engineering Enterprise Social Networks: An Exploratory Analysis Using Short Text Topic Modelling
,”
Des. Sci.
,
8
(
1
), p.
e18
.
37.
Goel
,
V.
,
2014
, “
Creative Brains: Designing in the Real World
,”
Front. Hum. Neurosci.
,
8
(
1
), p.
241
.
38.
Council
,
U. D.
,
2019
, “What Is the Framework for Innovation? Design Council's Evolved Double Diamond,” https://www.designcouncil.org.uk/news-opinion/what-framework-innovation-design-councils-evolved-double-diamond
39.
Chiu
,
M.
,
Lim
,
S.
, and
Silva
,
A.
,
2023
, “
Visualising Design Project Team and Individual Progress Using NLP: A Comparison Between Latent Semantic Analysis and Word2Vector Algorithms
,”
AI EDAM
,
37
, p.
e18
.
40.
Li
,
B.
,
Drozd
,
A.
,
Guo
,
Y.
,
Liu
,
T.
,
Matsuoka
,
S.
, and
Du
,
X.
,
2019
, “
Scaling word2vec on big Corpus
,”
Data Sci. Eng.
,
4
(
2
), pp.
157
175
.
41.
Ma
,
L.
, and
Zhang
,
Y.
,
2015
, “
Using Word2Vec to Process Big Text Data
,”
2015 IEEE International Conference on Big Data (Big Data)
,
Santa Clara, CA
.
42.
Smetanin
,
S.
,
2019
, “Google News and Leo Tolstoy: Visualizing Word2Vec Word Embeddings Using t-SNE,” https://towardsdatascience.com/google-news-and-leo-tolstoy-visualizing-word2vec-word-embeddings-with-t-sne-11558d8bd4d
43.
Jones
,
S. G.
,
Ashby
,
A. J.
,
Momin
,
S. R.
, and
Naidoo
,
A.
,
2010
, “
Spatial Implications Associated With Using Euclidean Distance Measurements and Geographic Centroid Imputation in Health Care Research
,”
Health Serv. Res.
,
45
(
1
), pp.
316
327
.
44.
Chiu
,
M.
,
2023
, “Design Progress Dashboard,” https://datatracking.deeplab-sutd.com
45.
Ministry of Education Singapore
,
2022
, “Educational Technology Plan,” https://www.moe.gov.sg/education-in-sg/educational-technology-journey/edtech-masterplan
46.
Webster
,
J. J.
, and
Kit
,
C.
,
1992
, “
Tokenization as the Initial Phase in NLP
,”
COLING 1992 Volume 4: The 14th International Conference on Computational Linguistics
,
Nantes, France
,
Aug. 23–28
.
47.
Kutuzov
,
A.
, and
Kuzmenko
,
E.
,
2019
, “
To Lemmatize or not to Lemmatize: How Word Normalisation Affects ELMo Performance in Word Sense Disambiguation
,”
Proceedings of the First NLPL Workshop on Deep Learning for Natural Language Processing
,
Turku, Finland
,
Sept. 30
.
48.
Manders
,
T.
, and
Klaassen
,
E.
,
2019
, “
Unpacking the Smart Mobility Concept in the Dutch Context Based on a Text Mining Approach
,”
Sustainability
,
11
(
23
), p.
6583
.
49.
Purcell
,
A. T.
, and
Gero
,
J. S.
,
1996
, “
Design and Other Types of Fixation
,”
Des. Stud.
,
17
(
1
), pp.
363
383
.
50.
Linsey
,
J. S.
,
Tseng
,
I.
,
Fu
,
K.
,
Cagan
,
J.
,
Wood
,
K. L.
, and
Schunn
,
C.
,
2010
, “
A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
,”
ASME J. Mech. Des.
,
132
(
4
), p.
041003
.
51.
Cardoso
,
C.
, and
Badke-Schaub
,
P.
,
2011a
, “
Fixation or Inspiration: Creative Problem Solving in Design
,”
J. Creat. Behav.
,
45
(
2
), pp.
77
82
.
52.
Crilly
,
N.
,
2019
, “
Creativity and Fixation in the Real World: A Literature Review of Case Study Research
,”
Des. Stud.
,
64
(
1
), pp.
154
168
.
53.
Banathy
,
B. H.
,
2013
,
Designing Social Systems in a Changing World
, 1st ed.,
Springer Science & Business Media
,
New York
.
You do not currently have access to this content.