Abstract
As technology advances, we are surrounded by more complex products that can be challenging to use and troubleshoot. We often turn to online resources and the help of others to learn how to use a product’s features or fix malfunctions. This is a common issue in both everyday life and industry. The key to being able to use a product or fix malfunctions is having access to accurate information and instructions and gaining the necessary skills to perform the tasks correctly. This paper offers an overview of how artificial intelligence, digital twins, and the metaverse—currently popular technologies—can enhance the process of acquiring knowledge, know-how, and skills, with a focus on industrial maintenance. However, the concepts discussed may also apply to the maintenance of consumer products.
References
1.
Karki
, B. R.
, and Porras
, J.
, 2021
, “Digitalization for Sustainable Maintenance Services: A Systematic Literature Review
,” Digit. Bus.
, 1
(2
), p. 100011
. 2.
Gavish
, N.
, Gutiérrez
, T.
, Webel
, S.
, Rodríguez
, J.
, Peveri
, M.
, Bockholt
, U.
, and Tecchia
, F.
, 2015
, “Evaluating Virtual Reality and Augmented Reality Training for Industrial Maintenance and Assembly Tasks
,” Interact. Learn. Environ.
, 23
(6
), pp. 778
–798
. 3.
Palmarini
, R.
, Erkoyuncu
, J. A.
, Roy
, R.
, and Torabmostaedi
, H.
, 2018
, “A Systematic Review of Augmented Reality Applications in Maintenance
,” Rob. Comput. Integr. Manuf.
, 49
, pp. 215
–228
. 4.
Fast-Berglund
, Å.
, Gong
, L.
, and Li
, D.
, 2018
, “Testing and Validating Extended Reality (XR) Technologies in Manufacturing
,” Proc. Manuf.
, 25
, pp. 31
–38
. 5.
Lasi
, H.
, Fettke
, P.
, Kemper
, H.-G.
, Feld
, T.
, and Hoffmann
, M.
, 2014
, “Industry 4.0
,” Bus. Inf. Syst. Eng.
, 6
, pp. 239
–242
. 6.
Cañas
, H.
, Mula
, J.
, Díaz-Madroñero
, M.
, and Campuzano-Bolarín
, F.
, 2021
, “Implementing Industry 4.0 Principles
,” Comput. Ind. Eng.
, 158
, p. 107379
.7.
European Commission and Directorate-General for Research and Innovation
, Breque
, M.
, De Nul
, L.
, and Petridis
, A.
, 2021
, Industry 5.0: Towards a Sustainable, Human-Centric and Resilient European Industry
, Publications Office
.8.
McCarthy
, J.
, Minsky
, M. L.
, Rochester
, N.
, and Shannon
, C. E.
, 2006
, “A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
,” AI Mag.
, 27
(4
), pp. 12
–12
.9.
Haenlein
, M.
, and Kaplan
, A.
, 2019
, “A Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial Intelligence
,” California Manage. Rev.
, 61
(4
), pp. 5
–14
. 10.
Floridi
, L.
, 2019
, “What the Near Future of Artificial Intelligence Could Be
,” Philos. Technol.
, 32
, pp. 1
–15
. 11.
Floridi
, L.
, 2021
, Ethics, Governance, and Policies in Artificial Intelligence
, Springer
.12.
Huynh-The
, T.
, Pham
, Q.-V.
, Pham
, X.-Q.
, Nguyen
, T. T.
, Han
, Z.
, and Kim
, D.-S.
, 2023
, “Artificial Intelligence for the Metaverse: A Survey
,” Eng. Appl. Artif. Intell.
, 117
, p. 105581
. 13.
Samek
, W.
, Montavon
, G.
, Vedaldi
, A.
, Hansen
, L. K.
, and Müller
, K.-R.
, 2019
, Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
, Vol. 411700
, Springer Nature
.14.
Grieves
, M.
, 2002
, “Conceptual Ideal for PLM
,” Presentation for the Product Lifecycle Management (PLM) Center, University of Michigan.15.
Glaessgen
, E.
, and Stargel
, D.
, 2012
, “The Digital Twin Paradigm for Future NASA and US Air Force Vehicles
,” 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA
, Honolulu, HI
, Apr. 23–26
, p. 1818
.16.
Liu
, M.
, Fang
, S.
, Dong
, H.
, and Xu
, C.
, 2021
, “Review of Digital Twin About Concepts, Technologies, and Industrial Applications
,” J. Manuf. Syst.
, 58
, pp. 346
–361
. 17.
Thelen
, A.
, Zhang
, X.
, Fink
, O.
, Lu
, Y.
, Ghosh
, S.
, Youn
, B. D.
, Todd
, M. D.
, Mahadevan
, S.
, Hu
, C.
, and Hu
, Z.
, 2022
, “A Comprehensive Review of Digital Twin—Part 1: Modeling and Twinning Enabling Technologies
,” Struct. Multidiscipl. Optim.
, 65
(12
), p. 354
. 18.
Negri
, E.
, Fumagalli
, L.
, and Macchi
, M.
, 2017
, “A Review of the Roles of Digital Twin in CPS-Based Production Systems
,” Proc. Manuf.
, 11
, pp. 939
–948
. 19.
Grieves
, M.
, and Vickers
, J.
, 2017
, “Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems
,” Transdisciplinary Perspectives on Complex Systems, Springer International Publishing
, Cham, Switzerland
, pp. 85
–113
.20.
Clausen
, A.
, Arendt
, K.
, Johansen
, A.
, Sangogboye
, F. C.
, Kjærgaard
, M. B.
, Veje
, C. T.
, and Jørgensen
, B. N.
, 2021
, “A Digital Twin Framework for Improving Energy Efficiency and Occupant Comfort in Public and Commercial Buildings
,” Energy Inf.
, 4
(Suppl 2), pp. 1
–19
. 21.
Pan
, M.
, Xing
, Q.
, Chai
, Z.
, Zhao
, H.
, Sun
, Q.
, and Duan
, D.
, 2023
, “Real-Time Digital Twin Machine Learning-Based Cost Minimization Model for Renewable-Based Microgrids Considering Uncertainty
,” Sol. Energy
, 250
, pp. 355
–367
. 22.
He
, B.
, and Bai
, K.-J.
, 2021
, “Digital Twin-Based Sustainable Intelligent Manufacturing: A Review
,” Adv. Manuf.
, 9
, pp. 1
–21
. 23.
van Dinter
, R.
, Tekinerdogan
, B.
, and Catal
, C.
, 2022
, “Predictive Maintenance Using Digital Twins: A Systematic Literature Review
,” Inf. Softw. Technol.
, 151
, p. 107008
. 24.
Ball
, M.
, 2022
, The Metaverse: And How it Will Revolutionize Everything
, Liveright Publishing
.25.
Stephenson
, N.
, 1992
, Snow Crash
, Bantam Books
.26.
Rimol
, M.
, 2022
, “Gartner Predicts 25% of People Will Spend at Least One Hour Per Day in the Metaverse by 2026
,” Retrieved March 2023.27.
Navas
, M. A.
, Sancho
, C.
, and Carpio
, J.
, 2020
, “Disruptive Maintenance Engineering 4.0
,” Int. J. Quality Reliab. Manage.
, 37
(6/7
), pp. 853
–871
. 28.
Hlihel
, F. B.
, Chater
, Y.
, and Boumane
, A.
, 2022
, “Maintenance 4.0 Employees’ Competencies: Systematic Literature Review
,” Proceedings of 2nd International Conference on Innovative Research in Applied Science, Engineering and Technology
, Meknes, Morocco
, Mar. 3–4
, IEEE
, pp. 1
–14
.29.
Kozak
, J. J.
, Hancock
, P. A.
, Arthur
, E. J.
, and Chrysler
, S. T.
, 1993
, “Transfer of Training From Virtual Reality
,” Ergonomics
, 36
(7
), pp. 777
–784
. 30.
Sacks
, R.
, Perlman
, A.
, and Barak
, R.
, 2013
, “Construction Safety Training Using Immersive Virtual Reality
,” Construct. Manage. Econ.
, 31
(9
), pp. 1005
–1017
. 31.
Cross
, J. I.
, Boag-Hodgson
, C.
, Ryley
, T.
, Mavin
, T.
, and Potter
, L. E.
, 2022
, “Using Extended Reality in Flight Simulators: A Literature Review
,” IEEE Trans. Vis. Comput. Graph.
32.
Ota
, D.
, Loftin
, B.
, Saito
, T.
, Lea
, R.
, and Keller
, J.
, 1995
, “Virtual Reality in Surgical Education
,” Comput. Biol. Med.
, 25
(2
), pp. 127
–137
. 33.
Romero
, D.
, Stahre
, J.
, Wuest
, T.
, Noran
, O.
, Bernus
, P.
, Fast-Berglund
, Å.
, and Gorecky
, D.
, 2016
, “Towards an Operator 4.0 Typology: A Human-Centric Perspective on the Fourth Industrial Revolution Technologies
,” Proceedings of the International Conference on Computers and Industrial Engineering (CIE46)
, Tianjin, China
, Oct. 29–31
, pp. 29
–31
.34.
Romero
, D.
, and Stahre
, J.
, 2021
, “Towards the Resilient Operator 5.0: The Future of Work in Smart Resilient Manufacturing Systems
,” Proc. CIRP
, 104
, pp. 1089
–1094
. 35.
Masoni
, R.
, Ferrise
, F.
, Bordegoni
, M.
, Gattullo
, M.
, Uva
, A. E.
, Fiorentino
, M.
, Carrabba
, E.
, and Di Donato
, M.
, 2017
, “Supporting Remote Maintenance in Industry 4.0 Through Augmented Reality
,” Proc. Manuf.
, 11
, pp. 1296
–1302
. 36.
Scurati
, G. W.
, Gattullo
, M.
, Fiorentino
, M.
, Ferrise
, F.
, Bordegoni
, M.
, and Uva
, A. E.
, 2018
, “Converting Maintenance Actions Into Standard Symbols for Augmented Reality Applications in Industry 4.0
,” Comput. Ind.
, 98
, pp. 68
–79
. 37.
Gattullo
, M.
, Scurati
, G. W.
, Fiorentino
, M.
, Uva
, A. E.
, Ferrise
, F.
, and Bordegoni
, M.
, 2019
, “Towards Augmented Reality Manuals for Industry 4.0: A Methodology
,” Rob. Comput. Integr. Manuf.
, 56
, pp. 276
–286
. 38.
Maman
, Z. S.
, Yazdi
, M. A. A.
, Cavuoto
, L. A.
, and Megahed
, F. M.
, 2017
, “A Data-Driven Approach to Modeling Physical Fatigue in the Workplace Using Wearable Sensors
,” Appl. Ergon.
, 65
, pp. 515
–529
. 39.
Ekman
, P.
, 1993
, “Facial Expression and Emotion
,” Am. Psychol.
, 48
(4
), p. 384
. 40.
Egger
, M.
, Ley
, M.
, and Hanke
, S.
, 2019
, “Emotion Recognition From Physiological Signal Analysis: A Review
,” Electron. Notes Theor. Comput. Sci.
, 343
, pp. 35
–55
. 41.
Haas
, E. C.
, and Van Erp
, J. B.
, 2014
, “Multimodal Warnings to Enhance Risk Communication and Safety
,” Saf. Sci.
, 61
, pp. 29
–35
. 42.
Gattullo
, M.
, Evangelista
, A.
, Uva
, A. E.
, Fiorentino
, M.
, and Gabbard
, J. L.
, 2020
, “What, How, and Why are Visual Assets Used in Industrial Augmented Reality? A Systematic Review and Classification in Maintenance, Assembly, and Training (From 1997 to 2019)
,” IEEE Trans. Vis. Comput. Graph.
, 28
(2
), pp. 1443
–1456
. 43.
Gallace
, A.
, Ngo
, M. K.
, Sulaitis
, J.
, and Spence
, C.
, 2012
, “Multisensory Presence in Virtual Reality: Possibilities & Limitations
,” Multiple Sensorial Media Advances and Applications: New Developments in MulSeMedia, IGI Global
, pp. 1
–38
.44.
Hayward
, V.
, Astley
, O. R.
, Cruz-Hernandez
, M.
, Grant
, D.
, and Robles-De-La-Torre
, G.
, 2004
, “Haptic Interfaces and Devices
,” Sens. Rev.
, 24
(1
), pp. 16
–29
. 45.
Geronazzo
, M.
, and Serafin
, S.
, 2023
, Sonic Interactions in Virtual Environments
, Springer Nature
, Switzerland AG
.46.
Nakamoto
, T.
, 2013
, Human Olfactory Displays and Interfaces: Odor Sensing and Presentation
, IGI Global
.47.
Micaroni
, L.
, Carulli
, M.
, Ferrise
, F.
, Gallace
, A.
, and Bordegoni
, M.
, 2019
, “An Olfactory Display to Study the Integration of Vision and Olfaction in a Virtual Reality Environment
,” ASME J. Comput. Inf. Sci. Eng.
, 19
(3
), p. 031015
. 48.
Patel
, D.
, and Bhalodiya
, P.
, 2019
, “3D Holographic and Interactive Artificial Intelligence System
,” 2019 International Conference on Smart Systems and Inventive Technology (ICSSIT)
, Tirunelveli, India
, Nov. 27–29
, IEEE
, pp. 657
–662
.49.
Svensson-Hoglund
, S.
, Richter
, J. L.
, Maitre-Ekern
, E.
, Russell
, J. D.
, Pihlajarinne
, T.
, and Dalhammar
, C.
, 2021
, “Barriers, Enablers and Market Governance: A Review of the Policy Landscape for Repair of Consumer Electronics in the EU and the US
,” J. Clean. Prod.
, 288
, p. 125488
. Copyright © 2023 by ASME
You do not currently have access to this content.
