Abstract

The global pandemic of 2020 caused a paradigm shift in engineering education. In a matter of weeks, and sometimes days, faculty members across the world had to move their hands-on engineering courses to an online environment. During this shift, educators relied on technology more so than ever to improve student design learning without an empirically understanding of the impact of this shift on students' cognition and understanding. The current study was developed to determine the cognitive underpinnings of such shifts by exploring the impact of Augmented Reality (AR) and animation impact engineering student learning, cognitive load, and recall during a virtual product dissection educational activity. This was achieved through a full factorial experiment with 117 first-year engineering students where students were divided into one of four conditions: baseline of virtual dissection; virtual dissection + animation, AR dissection, and AR dissection + animation. The results of the study show that students in the virtual dissection + animation showed an increased understanding of the product over the three other conditions. In addition, participant cognitive load and recall in the AR condition were not significantly different than in a non-AR virtual environment. The results are used to provide recommendations on how technology can be utilized in a virtual classroom environment, providing crucial insight into the steps needed to virtualize engineering education during the pandemic as well as future steps toward possible education reform.

References

1.
Mineo
,
L.
,
2020
, “
Time to Fix American Education with Race-for-Space Resolve
,”
The Harvard Gazette
.
2.
Burgess
,
S.
, and
Sievertsen
,
H. H.
,
2020
, “
Schools, Skills, and Learning: The Impact of Covid19 on Education
,”
VOXEU CEPR
.
3.
Yilmaz
,
N.
,
2020
, “
Engineering Education in the Time of Covid
,”
National Society of Professional Engineers
.
4.
Alvim
,
L.
,
2020
, “
Constricted by Covid19: College of Engineering
,”
The Oracle
.
5.
Foresman
,
B.
,
2020
, “
Here Are The U.S. Universities That Have Closed Due to Coronavirus
,” edscoop.
6.
Lederman
,
D.
,
2020
, “
Preparing for a Fall Without In-Person Classes
,” Inside Higher Ed.
7.
Eisenberg
,
J.
, and
Escobar
,
A.
,
2020
, “
COVID-19: 10 Steps for Transferring Your Course Online
,”
World Economic Forum
.
8.
Brophy
,
S.
,
Klein
,
S.
,
Portsmore
,
M.
, and
Rogers
,
C.
,
2008
, “
Advancing Engineering Education in P-12 Classrooms
,”
J. Eng. Educ.
,
97
(
3
), pp.
369
387
.
9.
Hoskins
,
B.
, and
Fredriksson
,
U.
,
2009
,
Learning to Learn: What Is It and Can It Be Measured, Luxembourg: Office for Official Publications of the European Communities
.
10.
Potkonjak
,
V.
,
Gardner
,
M.
,
Callaghan
,
V.
,
Mattila
,
P.
,
Guetl
,
C.
,
Petrovic
,
V. M.
, and
Jovanovic
,
K.
,
2016
, “
Virtual Laboratories for Education in Science, Technology, and Engineering: A Review
,”
Comput. Educ.
,
95
, pp.
309
327
.
11.
Chittaro
,
L.
, and
Ranon
,
R.
,
2007
, “
Web3D Technologies in Learning, Education, and Training: Motivations, Issues, Opportunities
,”
Comput. Educ.
,
49
(
1
), pp.
3
18
.
12.
Lourdes
,
M.
, and
Cartas
,
M.
,
2012
, “
Using an Improved Virtual Learning Environment for Engineering Students
,”
Eur. J. Eng. Educ.
,
37
(
3
), pp.
229
241
.
13.
Messner
,
J.
,
Yerrapathruni
,
S.
,
Baratta
,
A.
, and
Whisker
,
V.
,
2003
, “
Using Virtual Reality to Improve Construction Engineering Education
,”
American Society for Engineering Education Annual Conference
,
Nashville, TN
,
June 22–23
.
14.
Trindade
,
J.
,
Fiolhais
,
C.
, and
Almeida
,
L.
,
2002
, “
Science Learning in Virtual Environments: A Descriptive Study
,”
Br. J. Educ. Technol.
,
33
(
4
), pp.
471
488
.
15.
Selway
,
M.
,
2019
, “
Tech Flop: When NOT to Use Technology in the Classroom
,”
KQED Education
.
16.
Sheppard
,
S. D.
,
1992
, “
Mechanical Dissection: An Experience in How Things Work
,”
Proceedings of the Engineering Education: Curriculum Innovation & Integration
,
Santa Barbara, CA
,
Jan. 5–10
.
17.
Lamancusa
,
J.
,
Jorgensen
,
J. E.
, and
Fridley
,
J. L.
,
1996
, “
Product Dissection – A Tool For Benchmarking in the Process of Teaching Design
,”
Frontiers in Education Conference
,
Salt Lake City, UT
,
Nov. 6–9
.
18.
Lamancusa
,
J.
,
Torres
,
M.
,
Kumar
,
V.
, and
Jorgensen
,
J.
,
1996
, “
Learning Engineering by Product Dissection
,”
ASEE Annual Conference
,
Washington. DC
.
19.
Devendorf
,
M.
,
Lewis
,
K.
,
Simpson
,
T. W.
,
Stone
,
R. B.
, and
Regli
,
W. C.
,
2009
, “
Evaluating the Use of Digital Product Repositories to Enhance Product Dissection Activities in the Classroom
,”
ASME J. Comput. Inf. Sci. Eng.
,
9
(
4
), p.
041008
.
20.
McKenna
,
A. F.
,
Chen
,
W.
, and
Simpson
,
T. W.
,
2008
, “
Exploring the Impact of Virtual and Physical Dissection Activities on Students’ Understanding of Engineering Design Principles
,”
ASME Conference Brooklyn
,
NY
.
21.
Starkey
,
E. M.
,
McKay
,
A. S.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2016
, “
Let’s Get Physical? The Impact of Dissection Modality on Engineering Student Design Learning
,”
Proceedings of the ASME Design Engineering Technical Conference
,
Charlotte, NC
.
22.
Olympiou
,
G.
,
Zacharia
,
Z. C.
,
Papaevripidou
,
M.
, and
Constantinou
,
C. P.
,
2008
, “
Effects of Physical and Virtual Experimentation on Students’ Conceptual Understanding in Heat and Temperature
,”
Res. Sci. Teach.
,
45
(
9
), pp.
1021
1035
.
23.
Starkey
,
E. M.
,
McKay
,
A. S.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2017
, “
Dissecting Creativity: How Dissection Virtuality, Analogical Distance and Product Complexity Impact Creativity and Self-efficacy
,”
Des. Comput. Cogn.
,
16
, pp.
59
77
.
24.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2013
, “
Exploring the Utility of Product Dissection for Early-Phase Idea Generation
,”
ASME DETC Conference
,
Portland, OR
.
25.
Bétrancourt
,
M.
, and
Tversky
,
B.
,
2000
, “
Effect of Computer Animation on Users’ Performance: A Review
,”
Le Trav. Hum. A Biling. Multi-Disciplinary J. Hum. Factors
,
63
(
4
), pp.
311
329
.
26.
Ainsworth
,
S.
, and
VanLabeke
,
N.
,
2004
, “
Multiple Forms of Dynamic Representation
,”
Learn. Instr.
,
14
(
3
), pp.
241
255
.
27.
Tversky
,
B.
,
Morrison
,
J. B.
, and
Betrancourt
,
M.
,
2002
, “
Animation: Can It Facilitate
,”
Int. J. Hum-Comput. Stud.
,
57
(
4
), pp.
247
262
.
28.
Wozny
,
M. J.
,
1978
, “
Interactive Computer Graphics for Engineering Education
,”
Prof. Eng.
,
48
(
6
), pp.
14
18
.
29.
Hooper
,
P.
, and
Morton
,
J.
,
1982
, “
Fluctuations in the Dollar: A Model of Nominal and Real Exchange Rate Determination
,”
J. Int. Money Finance
,
1
(
1
), pp.
39
56
.
30.
DiSessa
,
A. A.
,
1982
, “
Unlearning Aristotelian Physics: A Study of Knowledge-Based Learning
,”
Cogn. Sci.
,
6
(
1
), pp.
37
75
.
31.
Xiao
,
L.
,
2013
, “
Animation Trends in Education
,”
Int. J. Inf. Educ. Technol.
,
3
(
3
), pp.
286
289
.
32.
Azuma
,
R.
,
Baillot
,
Y.
,
Behringer
,
R.
,
Feiner
,
S.
,
Julier
,
S.
, and
MacIntyre
,
B.
,
2001
, “
Recent Advances in Augmented Reality
,”
IEEE Comput. Graph. Appl.
,
21
(
6
), pp.
34
47
.
33.
el Sayed
,
N. A. M.
,
Zayed
,
H. H.
, and
Sharawy
,
M. I.
,
2011
, “
ARSC: Augmented Reality Student Card: An Augmented Reality Solution for the Education Field
,”
Comput. Educ.
,
56
(
4
), pp.
1045
1061
.
34.
Chen
,
C. J.
,
2006
, “
The Design, Development and Evaluation of a Virtual Reality Based Learning Environment
,”
Australas. J. Educ. Technol.
,
22
(
1
), pp.
39
63
.
35.
2019
, “
EDrawings Functionality Matrix
”.
36.
Starkey
,
E. M.
,
McKay
,
A. S.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2018
, “
Piecing Together Product Dissection: How Dissection Conditions Impact Student Conceptual Understanding and Cognitive Load
,”
ASME J. Mech. Des.
,
140
(
5
), p.
052001
.
37.
Kearney
,
K. G.
,
Starkey
,
E. M.
, and
Miller
,
S. R.
,
2019
, “
Leveraging Animations to Enhance Learning Through Virtual Product Dissection
,”
Proceedings of the ASME 2019 International Design Engineering Technical Conference
,
Anaheim, CA
,
Aug. 18–21
, pp.
1
6
.
38.
Badi
,
H. J.
,
Zeki
,
A. M.
, and
Othman
,
R.
,
2013
, “
Animation as a Problem Solving Technique in Mechanical Engineering Education
,”
Int. J. Sci. Eng. Res.
,
4
(
5
), pp.
96
99
.
39.
Badi
,
Hana
,
Zeki
,
Akram
,
Faris
,
Waleed
, and
Othman
,
Roslina
,
2013
, “
Animation: A Problem Solving Technique in Mechanical Engineering Education
,”
Int. J. Sci. Eng. Res.
,
4
(
5
), pp.
96
99
.
40.
Foster
,
N.
, and
Fedkiw
,
R.
,
2001
, “
Practical Animation of Liquids
,”
Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques
,
Los Angeles, CA
,
Aug. 12–17
, pp.
23
30
.
41.
Fok
,
S. C.
,
Tan
,
F. L.
, and
NG
,
P.
,
1994
, “
An Application of Computer Graphics for Teaching Robot Kinematics
,”
Proceedings of the 9th Annual International Conference on Frontiers of Technology
,
Singapore
,
Aug. 22–26
.
42.
Hejase
,
A. J.
, and
Hasbini
,
B. M.
,
1993
, “
Computer-Aided Instructions in Robotics
,”
Int. J. Eng. Educ.
,
9
, pp.
156
161
.
43.
Tan
,
F. L.
, and
Fok
,
S. C.
,
1995
, “
Development of Engineering Courseware for University Undergraduate Teaching Using Computer Animation
,”
Comput. Appl. Eng. Educ.
,
3
(
2
), pp.
121
126
.
44.
Sutherland
,
I. E.
,
1968
, “
A Head-Mounted Three-Dimensional Display
,”
Proceedings of Fall Joint Computer Conference
,
San Francisco, CA
,
Dec. 9–11
, pp.
757
764
.
45.
Pence
,
H. E.
,
2011
, “
Smartphones, Smart Objects, and Augmented Reality
,”
Ref. Libr.
,
52
(
1–2
), pp.
136
145
.
46.
Lee
,
K.
,
2012
, “
Augmented Reality in Education and Training
,”
TechTrends
,
56
(
2
), pp.
13
21
.
47.
Chang
,
G.
,
Morreale
,
P.
, and
Medicherla
,
P.
,
2010
, “
Applications of Augmented Reality Systems in Education
,”
Society for Information Technology & Teacher Education International Conference
,
San Diego, CA
,
Mar. 29
, pp.
1380
1385
.
48.
Shelton
,
B. E.
, and
Hedley
,
N. R.
,
2002
, “
Using Augmented Reality for Teaching Earth-Sun Relationships to Undergraduate Geography Students
,”
The First IEEE International Workshop Augmented Reality Toolkit
, p.
8
.
49.
Johnson
,
L.
,
Levine
,
A.
,
Smith
,
R.
, and
Stone
,
S.
,
2010
, “
Simple Augmented Reality
,” The 2010 Horizon Report, pp.
21
24
.
50.
Kerawalla
,
L.
,
Luckin
,
R.
,
Seljeflot
,
S.
, and
Woolard
,
A.
,
2006
, “
Making It Real’: Exploring the Potential of Augmented Reality for Teaching Primary School Science
,”
Virtual Real.
,
10
(
3–4
), pp.
163
174
.
51.
Feiner
,
S.
,
Macintyre
,
B.
, and
Selligmann
,
D.
,
1993
, “
Knowledge-Based Augmented Reality
,”
Commun. ACM
,
36
(
7
), pp.
53
62
.
52.
Billinghurst
,
M.
,
2003
, “
Augmented Reality in Education
,”
New Horizons for Learning
.
53.
de Freitas
,
S.
, and
Levene
,
M.
,
2005
, “
Wearable and Mobile Devices for Informal Learning
,”
Encyclopedia of Human Computer Interaction
.
54.
McPherson
,
C.
, and
Radkowski
,
R.
,
2016
, “
Tangible Augmented Reality and Engineering Product Dissection
,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9740, pp.
633
642
.
55.
Akçayır
,
M.
, and
Akçayır
,
G.
,
2017
, “
Advantages and Challenges Associated With AR for Education: A Systematic Review of the Literature
,”
Educ. Res. Rev.
,
20
, pp.
1
11
.
56.
Wu
,
H.
,
Lee
,
S. W.
,
Chang
,
H.
, and
Liang
,
J.
,
2013
, “
Current Status,Opportunities, and Challenges of AR in Education
,”
Comput. Educ.
,
62
, pp.
41
49
.
57.
Shirazi
,
A.
, and
Behzadan
,
A. H.
,
2013
, “
Technology-Enhanced Learning in Construction Education Using Mobile Context-Aware Augmented Reality Visual Simulation
,”
Proceedings of the 2013 Winter Simulation Conference
,
Washington, DC
,
Dec. 8–11
, pp.
3074
3085
.
58.
Camba
,
J.
,
Contero
,
M.
, and
Salvador-Herranz
,
G.
,
2014
, “
Desktop vs. Mobile: A Comparative Study of Augmented Reality Systems for Engineering Visualizations in Education
,”
Proceedings of the IEEE Frontiers in Education Conference
,
Madrid, Spain
.
59.
Figueiredo
,
M.
,
Cardoso
,
P.
,
Gonclaves
,
C.
, and
Rodrigues
,
J.
,
2014
, “
Augmented Reality and Holograms for Tech Visualization of Mechanical Engineering Parts
,”
Proceedings of the 18th International Conference on Information Visualisation
,
Paris, France
.
60.
Gonzalez
,
C.
,
Dominguez
,
M.
,
Martin-Gutierrez
,
J.
,
Contero
,
M.
, and
Alcaniz
,
M.
,
2012
, “
Training With Augmented Reality on Engineering Degrees
,”
Proceedings of the ASME 2012 11th Biennial Conference on Engineering Systems Design and Analysis
,
Nantes, France
,
July 2–4
, pp.
1
8
.
61.
Guiterrez
,
J.
, and
Fernandez
,
M.
,
2014
, “
Applying Augmented Reality in Engineering Education to Improve Academic Performance Student Motivation
,”
Int. J. Eng. Educ.
,
30
(
3
), pp.
625
635
.
62.
Paas
,
F.
,
Renkl
,
A.
, and
Sweller
,
J.
,
2003
, “
Cognitive Load Theory and Instructional Design: Recent Developments
,”
Educ. Psychol.
,
38
(
1
), pp.
1
4
.
63.
Sweller
,
J.
,
1988
, “
Cognitive Load During Problem Solving: Effects on Learning
,”
Cogn. Sci.
,
12
(
2
), pp.
257
285
.
64.
Feinberg
,
S.
, and
Murphy
,
M.
,
2000
, “
Applying Cognitive Load Theory to the Design of Web-Based Instruction
,”
Proceedings of IEEE Professional Communication Society International Professional Communication Conference and Proceedings of the 18th Annual ACM International Conference on Computer Documentation
, pp.
353
360
.
65.
Moreno
,
R.
,
2002
, “
Who Learns Best With Multiple Representations? Cognitive Theory Predictions on Individual Differences in Multimedia Learning
,” EdMedia + Innovate Learning, Denver, CO.
66.
Chandler
,
P.
, and
Sweller
,
J.
,
1991
, “
Cognitive Load Theory and the Format of Instruction
,”
Cogn. Instr.
,
8
(
4
), pp.
293
332
.
67.
Britannica
,
2007
, “Recall,” https://www.britannica.com/topic/recall-memory
68.
Paas
,
F.
, and
Ayres
,
P.
,
2014
, “
Cognitive Load Theory: A Broader View on the Role of Memory in Learning and Education
,”
Educ. Psychol. Rev.
,
26
(
2
), pp.
191
105
.
69.
Baddeley
,
A. D.
,
2000
, “
The Episodie Buffer: A New Component of Working Memory?
,”
Trends Cogn. Sci.
,
11
(
4
), pp.
417
423
.
70.
Clair-Thompson
,
H. L.
,
2009
, “
Backwards Digit Recall: A Measure of Short-Term Memory or Working Memory?
,”
Eur. J. Cogn. Psychol.
,
22
(
2
), pp.
286
296
.
71.
Xie
,
H.
,
Wang
,
F.
,
Hao
,
Y.
,
Chen
,
J.
,
An
,
J.
,
Wang
,
Y.
, and
Liu
,
H.
,
2017
, “
The More Total Cognitive Load Is Reduced by Cues, the Better Retention and Transfer of Multimedia Learning: A Meta-Analysis and Two Meta-Regression Analyses
,”
PLoS One
,
12
(
8
), p.
e0183884
.
72.
Spence
,
K. W.
, and
Spence
,
J. T.
,
1968
,
Human Memory: A Proposed System and Its Control Processes
,
Academic Press
,
Cambridge, MA
, pp.
89
195
.
73.
Toh
,
C.
,
Miller
,
S.
, and
Simpson
,
T.
,
2015
, “
The Impact of Virtual Product Dissection Environments on Student Learning and Self-Efficacy
,”
J. Eng. Des.
,
26
(
1–3
), pp.
48
73
.
74.
75.
Tsang
,
P. S.
, and
Velazquez
,
V. L.
,
1996
, “
Diagnosticity and Multidimensional Subjective Workload Ratings
,”
Ergonomics
,
39
(
3
), pp.
358
381
.
76.
Rubio
,
S.
,
Díaz
,
E.
,
Martín
,
J.
, and
Puente
,
J. M.
,
2004
, “
Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA-TLX, and Workload Profile Methods
,”
Appl. Psychol.
,
53
(
1
), pp.
61
86
.
77.
Jamieson
,
S.
,
2004
, “
Likert Scales: How to (Ab) Use Them
,”
Med. Educ.
,
38
(
12
), pp.
1217
1218
.
78.
Cohen
,
J.
,
1988
,
Statistical Power Analysis for the Behavioral Sciences
,
Lawrence Erlbaum Associates
,
Mahwah, NJ
.
79.
MacKay
,
J.
,
2019
, “
Screen Time Stats 2019: Here’s How Much You Use Your Phone During the Workday
,” RescueTime:Blog.
80.
Chandler
,
P.
, and
Sweller
,
J.
,
1996
, “
Cognitive Load While Learning to Use a Computer
,”
Appl. Cogn. Psychol.
,
10
(
2
), pp.
151
170
.
81.
Norman
,
G.
,
2010
, “
Likert Scales, Levels of Measurement and the ‘Laws’ of Statistics
,”
Adv. Health Sci. Educ.
,
15
(
5
), pp.
625
632
.
82.
Byrne
,
B. M.
,
2013
,
Structural Equation Modeling with Mplus: Basic Concepts, Applications, and Programming
,
Rutledge
,
Abingdon, Oxfordshire
.
83.
Hair
,
J.
,
Black
,
W.
,
Babin
,
B.
, and
Anderson
,
R.
,
2010
,
Multivariate Data Analysis
, 7th ed.,
Pearson Education International
,
Upper Saddle River, NJ
.
84.
Hegarty
,
M.
,
2004
, “
Dynamic Visualizations and Learning: Getting to the Difficult Questions
,”
Learn. Instr.
,
14
(
3
), pp.
343
351
.
85.
Germain
,
C. M.
, and
Hess
,
T. M.
,
2007
, “
Motivational Influences on Controlled Processing: Moderating Distractibility in Older Adults
,”
Aging Neuropsychol. Cogn.
,
14
(
5
), pp.
462
486
.
86.
Hidi
,
S.
,
1990
, “
Interest and Its Contribution as a Mental Resource for Learning
,”
Rev. Educ. Res.
,
60
(
4
), pp.
549
571
.
87.
Isaacowitz
,
D. M.
,
Wadlinger
,
H. A.
,
Goren
,
D.
, and
Wilson
,
H. R.
,
2006
, “
Selective Preference in Visual Fixation Away From Negative Images in Old Age? An Eye-Tracking Study
,”
Psychol. Aging
,
21
(
1
), pp.
40
48
.
88.
Renninger
,
A.
, and
Hidi
,
S.
,
2011
, “
Revisiting the Conceptualization, Measurement, and Generation of Interest
,”
Educ. Psychol.
,
46
(
3
), pp.
168
184
.
You do not currently have access to this content.