Abstract
Human error is one of the primary reasons for accidents in complex industries like aviation, nuclear power plant management, and health care. Physical and cognitive workload, flawed information processing, and poor decision making are some of the reasons that make humans vulnerable to error and lead to failures and accidents. In many accidents and failures, oftentimes, vulnerabilities that are embedded in the system, in the form of design deficiencies and poor human factors, lead to latent or catastrophic failures, but the last link is a human operator who gets blamed or worse, injured. This paper introduces an early design human performance assessment framework to identify what type of digital prototyping methodologies are appropriate to detect the deviation of the operator's performance due to an emergency condition. Fire in a civilian aircraft cockpit was introduced as a performance shaping factor (PSF). Ergonomics performance was evaluated using two prototyping strategies: (1) a computational prototyping framework includes digital human modeling (DHM) and computer-aided design; and (2) a novel mixed prototyping framework includes motion capture, DHM, and virtual reality. Results showed that the mixed prototyping framework can simulate emergency scenarios with increased realism and also has the potential to incorporate subjective aspects of ergonomics outcomes, overcoming the underlying lack of design knowledge in conventional early design methodologies.
Issue Section:
Research Papers
References
1.
Park
,
J.
,
Jung
,
W.
,
Kim
,
J.
,
Ha
,
J.
, and
Shin
,
Y.
, 2001
, “
The Step Complexity Measure for Emergency Operating Procedures Comparing With Simulation Data
,” Reliab. Eng. Syst. Saf.
,
74
(1
), pp. 63
–74
.10.1016/S0951-8320(01)00063-12.
Högberg
,
L.
, 2013
, “
Root Causes and Impacts of Severe Accidents at Large Nuclear Power Plants
,” Ambio
,
42
(3
), pp. 267
–284
.10.1007/s13280-013-0382-x3.
Makary
,
M. A.
, and
Daniel
,
M.
, 2016
, “
Medical Errorthe Third Leading Cause of Death in the us
,” BMJ
,
353
, p. i2139
.10.1136/bmj.i21394.
Reason
,
J.
, 1990
, “
The Contribution of Latent Human Failures to the Breakdown of Complex Systems
,” Philos. Trans. R. Soc., B, 327(1241), pp. 475
–484
.5.
WHO,
2012
, “Improving Medication Safety,” World Health Organization, Geneva, Switzerland, Report
.https://www.who.int/patientsafety/education/curriculum/course11_handout.pdf6.
Reason
,
J.
, 1990
, “
The Contribution of Latent Human Failures to the Breakdown of Complex Systems
,” Phil. Trans. R. Soc. Lond. B
,
327
(1241
), pp. 475
–484
.10.1098/rstb.1990.00907.
Shappell
,
S. A.
, and
Wiegmann
,
D. A.
, 1996
, “
US Naval Aviation Mishaps, 1977–92: Differences Between Single-and Dual-Piloted Aircraft
,” Aviation, Space, Environ. Med.
,
67
(1
), pp. 65
–69
.https://europepmc.org/abstract/med/8929208.
Li
,
G.
,
Baker
,
S. P.
,
Grabowski
,
J. G.
, and
Rebok
,
G. W.
, 2001
, “
Factors Associated With Pilot Error in Aviation Crashes
,” Aviation, Space, Environ. Med
.
,
72
(1
), pp. 52
–58
.https://www.researchgate.net/profile/Guohua_Li3/publication/12136068_Factors_associated_with_pilot_error_in_aviation_crashes/links/5407268b0cf2c48563b29739.pdf9.
Helmreich
,
R. L.
, 2000
, “
On Error Management: Lessons From Aviation
,” BMJ
,
320
(7237
), pp. 781
–785
.10.1136/bmj.320.7237.78110.
Salmon
,
P. M.
,
Lenné
,
M. G.
,
Stanton
,
N. A.
,
Jenkins
,
D. P.
, and
Walker
,
G. H.
, 2010
, “
Managing Error on the Open Road: The Contribution of Human Error Models and Methods
,” Saf. Sci.
,
48
(10
), pp. 1225
–1235
.10.1016/j.ssci.2010.04.00411.
Reason
,
J.
, 1990
, Human Error
,
Cambridge University Press,
Cambridge, UK.12.
Reason
,
J.
, 2000
, “
Human Error: Models and Management
,” BMJ
,
320
(7237
), pp. 768
–770
.10.1136/bmj.320.7237.76813.
Amalberti
,
R.
, 1996
, La Conduite de Systèmes à Risques: Le Travail à L'hôpital
,
Presses Universitaires de France
, Paris, France.14.
Helmreich
,
R. L.
, and
Merritt
,
A. C.
, 1998
, “
Culture at Work in Aviation and Medicine
,” National, Organizational and Professional Influences
,
Ashgate
,
Hampshire, UK
.15.
Norman
,
D.
, 2013
, The Design of Everyday Things: Revised and Expanded Edition
,
Constellation
, New York.16.
Xu
,
S.
,
Song
,
F.
,
Li
,
Z.
,
Zhao
,
Q.
,
Luo
,
W.
,
He
,
X.
, and
Salvendy
,
G.
, 2008
, “
An Ergonomics Study of Computerized Emergency Operating Procedures: Presentation Style, Task Complexity, and Training Level
,” Reliab. Eng. Syst. Saf.
,
93
(10
), pp. 1500
–1511
.10.1016/j.ress.2007.09.00617.
Iwaki
,
K.
, 1990
, “
Control Room Design and Automation in the Advanced Bwr
,” Proceedings/Annual International Symposium Balancing Automation Human Action in Nuclear Power Plants
, Piscataway, NJ, pp. 399
–412
.18.
Burian
,
B. K.
,
Barshi
,
I.
, and
Dismukes
,
K.
, 2005
, “
The Challenge of Aviation Emergency and Abnormal Situations
,” Ames Research Center, Moffett Field, CA, Report No. NASA/TM—2005–213462
. https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20060023295.pdf19.
Burian
,
B. K.
, and
Barshi
,
I.
, 2003
, “
Emergency and Abnormal Situations: A Review of ASRS Reports
,” 12th International Symposium on Aviation Psychology
, Wright State University Press, Dayton, OH.20.
Ranter
,
H.
, 2018
, “Asn Aircraft Accident de Havilland Canada dhc-8-402q dash 8 s2-agu Kathmandu-Tribhuvan Airport (KTM),” Aviation Safety Network
. https://aviation-safety.net/database/record.php?id=20180312-021.
The Kathmandu Post,
2019
, “
Exclusive: US-Bangla Pilot was Mentally Stressed and Reckless—National—The Kathmandu Post
,” accessed Sept. 19, 2019, http://kathmandupost.ekantipur.com/news/2018-08-27/exclusive-us-bangla-pilot-was-mentally-stressed-and-reckless.html22.
The Daily Star,
2018
, “
US-Bangla Airlines Flight Crash: Guilty, Who?—The Daily Star
,”
accessed Sept. 19, 2019, https://www.thedailystar.net/frontpage/us-bangla-airlines-flight-crash-guilty-who-154741323.
Dekker
,
S.
, and
Meyer
,
J.
, 2006
, “
Book Review: Field Guide to Human Error Investigations
,” Creative Nurs.
,
12
(3
), pp. 15
–16
. http://leonardo-in-flight.nl/PDF/FieldGuide%20to%20Human%20Error.PDF24.
Dekker
,
S. W.
, 2001
, “
The Re-Invention of Human Error
,” Hum. Factors Aerosp. Saf.
,
1
(3
), pp. 247
–265
. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.522.4705&rep=rep1&type=pdf25.
Kariuki
,
G.
, and
Löwe
,
K.
, 2012
, Incorporation of Human Factors in the Design Process
,
Institute for Plant and Process Technology, Process Safety and Plant Technology
,
TU, Berlin
.26.
Van Zandt
,
T.
, and
Proctor
,
R. W.
, 2008
, “
Human Factors in Simple and Complex Systems
,” 2nd ed., Taylor & Francis Group, London.27.
Rothwell
,
W. J.
,
Hohne
,
C. K.
, and
King
,
S. B.
, 2018
, Human Performance Improvement: Building Practitioner Performance
,
Routledge,
Abingdon, UK.28.
Charles
,
J. M.
, 2002
, Contemporary Kinesiology
,
Stipes Publishing
, Champaign, IL.29.
Wolfe
,
J. M.
,
Kluender
,
K. R.
,
Levi
,
D. M.
,
Bartoshuk
,
L. M.
,
Herz
,
R. S.
,
Klatzky
,
R. L.
,
Lederman
,
S. J.
, and
Merfeld
,
D. M.
, 2006
, Sensation and Perception
,
Sinauer
,
Sunderland, MA
.30.
Pham
,
D. T.
, and
Gault
,
R. S.
, 1998
, “
A Comparison of Rapid Prototyping Technologies
,” Int. J. Mach. Tools Manuf.
,
38
(10–11
), pp. 1257
–1287
.10.1016/S0890-6955(97)00137-531.
Stowe
,
D.
, 2008
, “
Investigating the Role of Prototyping in Mechanical Design Using Case Study Validation
,” Clemson, SC.32.
Jönsson
,
A.
, 2004
, “
Lean Prototyping of Multi-Body and Mechatronic Systems
,” Ph.D. thesis, Blekinge Institute of Technology, Karlskrona, Sweden.33.
Tseng
,
M. M.
,
Jiao
,
J.
, and
Su
,
C.-J.
, 1997
, “
A Framework of Virtual Design for Product Customization
,” IEEE Sixth International Conference on Emerging Technologies and Factory Automation Proceedings
(ETFA'97
), Piscataway, NJ, Sept. 9–12, pp. 7
–14
.10.1109/ETFA.1997.61623434.
Demirel
,
H. O.
, 2015
, “
Modular Human-in-the-Loop Design Framework Based on Human Factors
,” Ph.D. thesis, Purdue University, West Lafayette, IN.35.
Verlinden
,
J.
, and
Horváth
,
I.
, 2009
, “
Analyzing Opportunities for Using Interactive Augmented Prototyping in Design Practice
,” AI Eda
m
,
23
(3
), pp. 289
–303
. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.945.3793&rep=rep1&type=pdf36.
Vandevelde
,
A.
,
Van Dierdonck
,
R.
, and
Clarysse
,
B.
, 2002
, “
The Role of Physical Prototyping in the Product Development Process
,” Vlerick Leuven Gent Management School Work Paper Series
.37.
Hall
,
R. R.
, 2001
, “
Prototyping for Usability of New Technology
,” Int. J. Human-Comput. Stud.
,
55
(4
), pp. 485
–501
.10.1006/ijhc.2001.047838.
Walker
,
M.
,
Takayama
,
L.
, and
Landay
,
J. A.
, 2002
, “
High-Fidelity or Low-Fidelity, Paper or Computer? Choosing Attributes When Testing Web Prototypes
,” Human Factors and Ergonomics Society Annual Meeting
, Vol.
46
, SAGE Publications Sage, Los Angeles, CA, pp. 661
–665
.39.
Ward
,
S.
, 1994
, “
Getting Feedback From Users Early in the Design Process: A Case Study
,” Ergonomics: The Fundamental Design Science, 30th Annual Conference of the Ergonomics Society of Australia
, The Ergonomics Society of Australia Canberra, Australia, pp. 22
–29
.40.
Brereton
,
M.
, and
McGarry
,
B.
, 2000
, “
An Observational Study of How Objects Support Engineering Design Thinking and Communication: Implications for the Design of Tangible Media
,” SIGCHI Conference on Human Factors in Computing Systems
, The Hague, The Netherlands, pp. 217
–224
.41.
Kuutti
,
K.
,
Battarbee
,
K.
,
Sade
,
S.
,
Mattelmaki
,
T.
,
Keinonen
,
T.
,
Teirikko
,
T.
, and
Tornberg
,
A.-M.
, 2001
, “
Virtual Prototypes in Usability Testing
,” IEEE
34th Annual Hawaii International Conference on System Sciences,
Maui, HI, Jan. 6, p. 7
.10.1109/HICSS.2001.92654542.
Alexopoulos
,
K.
,
Mavrikios
,
D.
, and
Chryssolouris
,
G.
, 2013
, “
Ergotoolkit: An Ergonomic Analysis Tool in a Virtual Manufacturing Environment
,” Int. J. Comput. Integr. Manuf.
,
26
(5
), pp. 440
–452
.10.1080/0951192X.2012.73161043.
Bi
,
Z. M.
, 2010
, “
Computer Integrated Reconfigurable Experimental Platform for Ergonomic Study of Vehicle Body Design
,” Int. J. Comput. Integr. Manuf.
,
23
(11
), pp. 968
–978
.10.1080/0951192X.2010.50067844.
Zorriassatine
,
F.
,
Wykes
,
C.
,
Parkin
,
R.
, and
Gindy
,
N.
, 2003
, “
A Survey of Virtual Prototyping Techniques for Mechanical Product Development
,” Proc. Inst. Mech. Eng., Part B: J. Eng. Manuf.
,
217
(4
), pp. 513
–530
.10.1243/09544050332162818945.
Bullinger
,
H.-J.
, and
Dangelmaier
,
M.
, 2003
, “
Virtual Prototyping and Testing of in-Vehicle Interfaces
,” Ergonomics
,
46
(1–3
), pp. 41
–51
.10.1080/0014013030352846.
Bordegoni
,
M.
,
Cugini
,
U.
,
Caruso
,
G.
, and
Polistina
,
S.
, 2009
, “
Mixed Prototyping for Product Assessment: A Reference Framework
,” Int. J. Interact. Des. Manuf. (IJIDeM)
,
3
(3
), pp. 177
–187
.10.1007/s12008-009-0073-947.
Nilsson
,
S.
, and
Johansson
,
B.
, 2006
, “
A Cognitive Systems Engineering Perspective on the Design of Mixed Reality Systems
,” 13th Eurpoean Conference on Cognitive Ergonomics: Trust and Control in Complex Socio-Technical Systems
, Zurich, Switzerland, Sept. 20–22, pp. 154
–161
.10.1145/1274892.127492348.
Lee
,
Y.-G.
,
Park
,
H.
,
Woo
,
W.
,
Ryu
,
J.
,
Kim
,
H. K.
,
Baik
,
S. W.
,
Ko
,
K. H.
,
Choi
,
H. K.
,
Hwang
,
S.-U.
,
Kim
,
D. B.
,
Kim
,
H.
, and
Lee
,
K. H.
, 2010
, “
Immersive Modeling System (IMMs) for Personal Electronic Products Using a Multi-Modal Interface
,” Comput.-Aided Des.
,
42
(5
), pp. 387
–401
.10.1016/j.cad.2009.11.00349.
Barbieri
,
L.
,
Angilica
,
A.
,
Bruno
,
F.
, and
Muzzupappa
,
M.
, 2013
, “
Mixed Prototyping With Configurable Physical Archetype for Usability Evaluation of Product Interfaces
,” Comput. Ind.
,
64
(3
), pp. 310
–323
.10.1016/j.compind.2012.11.01050.
Rajesh
,
R.
, and
Srinath
,
R.
, 2016
, “
Review of Recent Developments in Ergonomic Design and Digital Human Models
,” Ind. Eng. Manage.
,
5
, p. 186
.10.4172/2169-0316.100018651.
Zhang
,
X.
, and
Chaffin
,
D. B.
, 2005
, “
Digital Human Modeling for Computer-Aided Ergonomics
,” Handbook of Occupational Ergonomics. Taylor & Francis
,
CRC Press
,
London
, pp. 1
–20
.52.
Sundin
,
A.
, and
Örtengren
,
R.
, 2006
, “
Digital Human Modeling for Cae Applications
,” Handbook of Human Factors and Ergonomics
, Wiley, Hoboken, NJ, pp. 1053
–1078
.53.
Chaffin
,
D. B.
, 2008
, “
Digital Human Modeling for Workspace Design
,” Rev. Human Factors Ergonom.
,
4
(1
), pp. 41
–74
.10.1518/155723408X34284454.
Stephens
,
A.
, and
Godin
,
C.
, 2006
, “
The Truck That Jack Built: Digital Human Models and Their Role in the Design of Work Cells and Product Design
,” SAE
Technical Paper No. 2006-01-2314.10.4271/2006-01-231455.
Lämkull
,
D.
,
Hanson
,
L.
, and
Örtengren
,
R.
, 2009
, “
A Comparative Study of Digital Human Modelling Simulation Results and Their Outcomes in Reality: A Case Study Within Manual Assembly of Automobiles
,” Int. J. Ind. Ergonom.
,
39
(2
), pp. 428
–441
.10.1016/j.ergon.2008.10.00556.
Frey Law
,
L.
,
Xia
,
T.
, and
Laake
,
A.
, 2009
, “
Modeling Human Physical Capability: Joint Strength and Range of Motion
,” Handbook of Digital Human Modeling
,
CRC Press
,
Boca Raton, FL
.57.
Colombo
,
G.
, and
Cugini
,
U.
, 2005
, “
Virtual Humans and Prototypes to Evaluate Ergonomics and Safety
,” J. Eng. Des.
,
16
(2
), pp. 195
–203
.10.1080/0954482050003154258.
Ahmed
,
S.
,
Gawand
,
M. S.
,
Irshad
,
L.
, and
Demirel
,
H. O.
, 2018
, “
Exploring the Design Space Using a Surrogate Model Approach With Digital Human Modeling Simulations
,” ASME
Paper No. DETC2018-86323.10.1115/DETC2018-8632359.
Chaffin
,
D.
, 2001
, Human Digital Modelling for Vehicle and Workplace Design
,
Society of Automotive Engineers
,
Warrendale, PA
.60.
Hart
,
S. G.
, and
Staveland
,
L. E.
, 1988
, “
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
,” Adv. Psychol.
,
52
, pp. 139
–183
. http://stavelandhfe.com/images/NASA-TLX_paper.pdf61.
Laughery
,
K. R.
, 1989
, “
Micro Sainta Tool for Modeling Human Performance in Systems
,” Applications of Human Performance Models to System Design
,
Springer
, Berlin, pp. 219
–230
.62.
Lexico,
2019
, “Emergency—Definition of Emergency in English by Oxford Dictionaries,”
accessed Sept. 19, 2019, https://en.oxforddictionaries.com/definition/emergency63.
Jenvald
,
J.
, and
Morin
,
M.
, 2004
, “
Simulation-Supported Live Training for Emergency Response in Hazardous Environments
,” Simul. Gaming
,
35
(3
), pp. 363
–377
.10.1177/104687810426622364.
McGaghie
,
W. C.
,
Issenberg
,
S. B.
,
Petrusa
,
E. R.
, and
Scalese
,
R. J.
, 2010
, “
A Critical Review of Simulation-Based Medical Education Research: 2003–2009
,” Med. Educ.
,
44
(1
), pp. 50
–63
.10.1111/j.1365-2923.2009.03547.x65.
Jenckes
,
M. W.
,
Catlett
,
C. L.
,
Hsu
,
E. B.
,
Kohri
,
K.
,
Green
,
G. B.
,
Robinson
,
K. A.
,
Bass
,
E. B.
, and
Cosgrove
,
S. E.
, 2007
, “
Development of Evaluation Modules for Use in Hospital Disaster Drills
,” Am. J. Disaster Med.
,
2
(2
), pp. 87
–95
.10.5055/ajdm.2007.001666.
Cohen
,
D.
,
Sevdalis
,
N.
,
Patel
,
V.
,
Taylor
,
M.
,
Lee
,
H.
,
Vokes
,
M.
,
Heys
,
M.
,
Taylor
,
D.
,
Batrick
,
N.
, and
Darzi
,
A.
, 2013
, “
Tactical and Operational Response to Major Incidents: Feasibility and Reliability of Skills Assessment Using Novel Virtual Environments
,” Resuscitation
,
84
(7
), pp. 992
–998
.10.1016/j.resuscitation.2012.12.01167.
Ingrassia
,
P. L.
,
Ragazzoni
,
L.
,
Carenzo
,
L.
,
Colombo
,
D.
,
Gallardo
,
A. R.
, and
Della Corte
,
F.
, 2015
, “
Virtual Reality and Live Simulation: A Comparison Between Two Simulation Tools for Assessing Mass Casualty Triage Skills
,” Eur. J. Emerg. Med.
,
22
(2
), pp. 121
–127
.10.1097/MEJ.000000000000013268.
Franc-Law
,
J. M.
,
Ingrassia
,
P. L.
,
Ragazzoni
,
L.
, and
Della Corte
,
F.
, 2010
, “
The Effectiveness of Training With an Emergency Department Simulator on Medical Student Performance in a Simulated Disaster
,” Can. J. Emerg. Med.
,
12
(1
), pp. 27
–32
.https://pdfs.semanticscholar.org/cd7b/822134eb122a21fbd3a9d26ea2bfb0e0e970.pdf69.
Franc-Law
,
J. M.
,
Bullard
,
M.
, and
Della Corte
,
F.
, 2008
, “
Simulation of a Hospital Disaster Plan: A Virtual, Live Exercise
,” Prehospital Disaster Med.
,
23
(4
), pp. 346
–353
.10.1017/S1049023X0000599970.
Ahmed
,
S.
,
Zhang
,
J.
, and
Demirel
,
O.
, 2018
, “
Assessment of Types of Prototyping in Human-Centered Product Design
,” International Conference on Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management
, Las Vegas, NV, pp. 3
–18
.71.
Mail Online,
2010
, “How a Faulty Heater Caused the Windshield in the Cockpit of a Passenger Jet to Shatter—Thousands of Feet Above the Atlantic—Daily M
ail Online,” accessed Nov. 25, 2018, https://www.dailymail.co.uk/news/article-1290535/How-faulty-heater-caused-windshield-cockpit-passenger-jet-shatter– thousands-feet-Atlantic.html72.
The San Diego Union-Tribune, 2010, “
Incidents, Events Involving Boeing Cockpit Fires—The San Diego Union-Tribune
,” accessed Nov. 25, 2018, https://www.sandiegouniontribune.com/sdut-incidents-events-involving-boeing-cockpit-fires-2010jun29-story.html73.
Niehorster
,
D. C.
,
Li
,
L.
, and
Lappe
,
M.
, 2017
, “
The Accuracy and Precision of Position and Orientation Tracking in the Htc Vive Virtual Reality System for Scientific Research
,” i-Perception
,
8
(3
), pp. 1
–23
.https://journals.sagepub.com/doi/pdf/10.1177/204166951770820574.
Flisher
,
A. J.
,
Evans
,
J.
,
Muller
,
M.
, and
Lombard
,
C.
, 2004
, “
Brief Report: Test–Retest Reliability of Self-Reported Adolescent Risk Behaviour
,” J. Adolescence
,
27
(2
), pp. 207
–212
.10.1016/j.adolescence.2001.10.00175.
Tzannes
,
A.
,
Paxinos
,
A.
,
Callanan
,
M.
, and
Murrell
,
G. A.
, 2004
, “
An Assessment of the Interexaminer Reliability of Tests for Shoulder Instability
,” J. Shoulder Elbow Surgery
,
13
(1
), pp. 18
–23
.10.1016/j.jse.2003.09.00276.
Demirel
,
H. O.
, and
Duffy
,
V. G.
, 2017
, “
Incorporating Tactile Cues Into Human-Centered Virtual Product Design
,” Human Factors Ergonom. Manuf. Serv. Ind.
,
27
(1
), pp. 5
–16
.10.1002/hfm.2040277.
Hoonakker
,
P.
,
Carayon
,
P.
,
Gurses
,
A. P.
,
Brown
,
R.
,
Khunlertkit
,
A.
,
McGuire
,
K.
, and
Walker
,
J. M.
, 2011
, “
Measuring Workload of ICU Nurses With a Questionnaire Survey: The NASA Task Load Index (TLX)
,” IIE Trans. Healthcare Syst. Eng.
,
1
(2
), pp. 131
–143
.10.1080/19488300.2011.609524Copyright © 2020 by ASME
You do not currently have access to this content.
