https://orcid.org/0000-0002-7576-6698
Abstract
This article presents a set of nondestructive test methodologies designed to evaluate and compare performance of the communication links used for control and telemetry of small unmanned aircraft systems (sUAS) (drones) that are operating indoors and in subterranean environments. Such a set of standardized test methodologies does not yet exist. Indoor and subterranean operation requires sUAS to operate without global positioning system and often in a spatially constrained non-line-of-sight (NLOS) communication environment. Operating in constrained indoor environments puts additional constraints on the communication links and requires a set of tests to allow evaluation and comparison of different units in typical scenarios that will be encountered. Tests to measure and compare communication link performance and ability to pilot in tunnels and office type buildings with doors, walls, and other obstructions, as well as stairwells are described. The test methods consist of measuring and comparing the NLOS radio range between the sUAS and the ground control station or operator control unit (OCU), observing the sUAS behavior with partial or total communication failure. Near the edge of coverage, correlated packet loss can lead to difficulties in piloting. A methodology for evaluating video latency that is critical for remote piloting by camera only is presented. Finally, a test methodology for characterizing the effects of interference and jamming by waveforms such as Wi-Fi often encountered in buildings is described. These test methodologies described here extend standards developed for ground robots to three dimensions. The test methodologies described in this article are part of a multifaceted project that evaluates many essential elements of drone operation indoors. These include communication, navigation, collision tolerance, mapping, trust, and automation. The test methodologies are designed to be reproduced in user facilities.
Issue Section:
Technical Papers
References
1.
Gupta
S. G.
, Ghonge
D.
, and Jawandhiya
P. M.
, “Review of Unmanned Aircraft System (UAS)
,” International Journal of Advanced Research in Computer Engineering & Technology
2
, no. 4
(April 2013
): 1646
–1658
, https://doi.org/10.2139/ssrn.34510392.
Yaacoub
J. P.
, Noura
H.
, Salman
O.
, and Chehab
A.
, “Security Analysis of Drones Systems: Attacks, Limitations, and Recommendations
,” Internet of Things
11
(September 2020
): 100218, https://doi.org/10.1016/j.iot.2020.1002183.
Jacoff
A.
, Measuring and Comparing Small Unmanned Aircraft System Capabilities and Remote Pilot Proficiency
, Version 2020B1 (Gaithersburg, MD: National Institute of Standards and Technology
, 2020
).4.
Martz
J.
, Al-Sabban
W.
, and Smith
R. N.
, “Survey of Unmanned Subterranean Exploration, Avigation, and Localisation
,” IET Cyber-Systems and Robotics
2
, no. 1
(March 2020
): 1
–13
, https://doi.org/10.1049/iet-csr.2019.00435.
Bradshaw
M.
, “Prometheus Drones to Explore Subterranean Environments
,” The Engineer
301
, no. 7925
(2021
): 6, https://doi.org/10.12968/S0013-7758(22)90063-76.
Zingg
S.
, Scaramuzza
D.
, Weiss
S.
, and Siegwart
R.
, “MAV Navigation through Indoor Corridors Using Optical Flow
” (paper presentation, 2010 Institute of Electrical and Electronics Engineers International Conference on Robotics and Automation, Anchorage, AK, May 3–8, 2010
), https://doi.org/10.1109/ROBOT.2010.55097777.
Weiss
S.
, Scaramuzza
D.
, and Siegwart
R.
, “Monocular-SLAM–Based Navigation for Autonomous Micro Helicopters in GPS-Denied Environments
,” Journal of Field Robotics
28
, no. 6
(November/December 2011
): 854
–874
, https://doi.org/10.1002/rob.204128.
Rouček
T.
, Pecka
M.
, Čížek
P.
, Petříček
T.
, Bayer
J.
, Šalanský
V.
, Azayev
T.
, et al., “System for Multi-robotic Exploration of Underground Environments CTU-CRAS-NORLAB in the DARPA Subterranean Challenge
,” Field Robotics
2
(August 2022
): 1779
–1818
, https://doi.org/10.55417/fr.20220559.
Rizzo
C.
, Cavestany
P.
, Chataigner
F.
, Soler
M.
, Moreno
G.
, Serrano
D.
, Lera
F.
, and Villarroel
J. L.
, “Wireless Propagation Characterization of Underground Sewers towards Autonomous Inspections with Drones
,” in ROBOT 2017: Third Iberian Robotics Conference: Volume 2
(New York
: Springer International Publishing
, 2017
), 849
–860
.10.
Matić
V.
, Kosjer
V.
, Lebl
A.
, Pavić
B.
, and Radivojević
J.
, “Methods for Drone Detection and Jamming
” (paper presentation, 10th International Conference on Information Society and Technology, Kopaonik, Serbia, March 8–11, 2020
).11.
Shahmoradi
J.
, Talebi
E.
, Roghanchi
P.
, and Hassanalian
M.
, “A Comprehensive Review of Applications of Drone Technology in the Mining Industry
,” Drones
4
, no. 3
(September 2020
): 34, https://doi.org/10.3390/drones403003412.
Zhou
Y.
, Li
J.
, Lamont
L.
, and Rabbath
C. A.
, “Modeling of Packet Dropout for UAV Wireless Communications
” (paper presentation, 2012 International Conference on Computing, Networking and Communications, Maui, HI, January 31–February 2, 2012
).13.
Johansson
R.
, Hammar
P.
, and Thorén
P.
, “On Simulation-Based Adaptive UAS Behavior during Jamming
” (paper presentation, 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, Linköping, Sweden, October 3–5, 2017
).14.
Poisel
R.
, Modern Communications Jamming Principles and Techniques
(Norwood, MA
: Artech House Publishers
, 2011
).15.
Norton
A.
, Ahmadzadeh
R.
, Jerath
K.
, Robinette
P.
, Weitzen
J.
, Wickramarathne
T.
, Yanco
H.
, et al., DECISIVE Benchmarking Data Report: sUAS Performance Results from Phase I, PAO #PR2023_74172
(Lowell, MA
: University of Massachusetts Lowell
), https://doi.org/10.48550/arXiv.2301.0785316.
Norton
A.
, Ahmadzadeh
R.
, Jerath
K.
, Robinette
P.
, Weitzen
J.
, Wickramarathne
T.
, Yanco
H.
, et al., DECISIVE Test Methods Handbook: Test Methods for Evaluating sUAS in Subterranean and Constrained Indoor Environments, Version 1.1, PAO #PR2022_47058
(Lowell, MA
: University of Massachusetts Lowell
), https://doi.org/10.48550/arXiv.2211.0180117.
Meriaux
E.
and Jerath
K.
, “Evaluation of Navigation and Trajectory-Following Capabilities of Small Unmanned Aerial Systems
” (paper presentation, 2022 Institute of Electrical and Electronics Engineers International Symposium on Technologies for Homeland Security, Boston, MA, November 14–15, 2022
).18.
Norton
A.
, Gavriel
P.
, Donoghue
B.
, and Yanco
H.
, “Test Methods to Evaluate Mapping Capabilities of Small Unmanned Aerial Systems in Constrained Indoor and Subterranean Environments
” (paper presentation, 2021 Institute of Electrical and Electronics Engineers International Symposium on Technologies for Homeland Security, Boston, MA, November 8–9, 2021
).19.
Perkins
R.
, Khavas
Z. R.
, McCallum
K.
, Kotturu
M. R.
, and Robinette
P.
, “The Reason for an Apology Matters for Robot Trust Repair
” (paper presentation, 14th International Conference on Social Robotics, Florence, Italy, December 13–16, 2022
).20.
Khavas
Z. R.
, Ahmadzadeh
S. R.
, and Robinette
P.
, “Modeling Trust in Human-Robot Interaction: A Survey
” (paper presentation, 12th International Conference on Social Robotics, Golden, CO, November 14–18, 2020
).21.
Donald
R.
, Gavriel
P.
, Norton
A.
, and Ahmadzadeh
S. R.
, Contextual Autonomy Evaluation of Unmanned Aerial Vehicles in Subterranean Environments, PAO #PR2023_74172
(Lowell, MA
: University of Massachusetts Lowell
, 2022
), https://doi.org/10.48550/arXiv.2301.0260322.
Scaramuzza
D.
, Achtelik
M. C.
, Doitsidis
L.
, Friedrich
F.
, Kosmatopoulos
E.
, Martinelli
A.
, Achtelik
M. W.
, et al., “Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments
,” IEEE Robotics & Automation Magazine
21
, no. 3
(September 2014
): 26
–40
, https://doi.org/10.1109/MRA.2014.232229523.
Gross
J.
, De Petrillo
M.
, Beard
J.
, Nichols
H.
, Swiger
T.
, Watson
R.
, Kirk
C.
, et al., “Field-Testing of a UAV-UGV Team for GNSS-Denied Navigation in Subterranean Environments
” (paper presentation, Proceedings of the 32nd International Technical Meeting of the Satellite Division of the Institute of Navigation, Miami, FL, September 16–20, 2019
).24.
Klein
K. T.
, Uysal
F.
, Cuenca
M. C.
, Otten
M. P.
, and de Wit
J. J.
, “Radar-Aided Navigation System for Small Drones in GPS-Denied Environments
” (paper presentation, 2021 Institute of Electrical and Electronics Engineers Radar Conference, Atlanta, GA, May 7–14, 2021
).25.
Wyder
P. M.
, Chen
Y. S.
, Lasrado
A. J.
, Pelles
R. J.
, Kwiatkowski
R.
, Comas
E. O.
, Kennedy
R.
, Mangla
A.
, Huang
Z.
, Hu
X.
, and Xiong
Z.
, “Autonomous Drone Hunter Operating by Deep Learning and All-Onboard Computations in GPS-Denied Environments
,” PLoS One
14
, no. 11
(November 2019
): e0225092, https://doi.org/10.1371/journal.pone.022509226.
Shi
Y.
, Enami
R.
, Wensowitch
J.
, and Camp
J.
, “Measurement-Based Characterization of LOS and NLOS Drone-to-Ground Channels
” (paper presentation, 2018 Institute of Electrical and Electronics Engineers Wireless Communications and Networking Conference, Barcelona, Spain, April 15–18, 2018
).27.
Li
H.
, Ding
M.
, López-Pérez
D.
, Fotouhi
A.
, Lin
Z.
, and Hassan
M.
, “Performance Analysis of the Access Link of Drone Base Station Networks with LoS/NLoS Transmissions
,” in International Conference on Industrial Networks and Intelligent Systems
(Cham, Switzerland
: Springer
, 2018
), 111
–121
, https://doi.org/10.1007/978-3-030-05873-9_1028.
Venkatraman
S.
, Caffery
J.
, and You
H. R.
, “Location Using LOS Range Estimation in NLOS Environments
” (paper presentation, Institute of Electrical and Electronics Engineers 55th Vehicular Technology Conference, Birmingham, AL, May 6–9, 2002
).29.
Venkatraman
S.
, Caffery
J.
, and You
H. R.
, “A Novel TOA Location Algorithm Using LOS Range Estimation for NLOS Environments
,” IEEE Transactions on Vehicular Technology
53
, no. 5
(September 2004
): 1515
–1524
, https://doi.org/10.1109/TVT.2004.83238430.
Al-Jazzar
S.
and Caffery
J.
, “ML and Bayesian TOA Location Estimators for NLOS Environments
” (paper presentation, Institute of Electrical and Electronics Engineers 56th Vehicular Technology Conference, Vancouver, Canada, September 24–28, 2002
).31.
Zhang
Y. P.
and Hwang
Y.
, “Measurements and Statistical Modeling of 900 MHz Radio Propagation Channels for Microcellular and Personal Communications in Tunnels
,” Wireless Personal Communications
7
, no. 1
(May 1998
): 25
–39
, https://doi.org/10.1023/A:100883472451032.
El Azhari
M.
, Nedil
M.
, Alj
Y. S.
, Mabrouk
I. B.
, Ghanem
K.
, and Talbi
L.
, “Off-Body LOS and NLOS Channel Characterization in a Mine Environment
” (paper presentation, 2015 International Conference on Electrical and Information Technologies, Marrakech, Morocco, March 25–27, 2015
).33.
Shi
Y.
, Enami
R.
, Wensowitch
J.
, and Camp
J.
, “Measurement-Based Characterization of LOS and NLOS Drone-to-Ground Channels
” (paper presentation, 2018 Institute of Electrical and Electronics Engineers Wireless Communications and Networking Conference, Barcelona, Spain, April 15–18, 2018
).34.
Amer
R.
, Saad
W.
, Galkin
B.
, and Marchetti
N.
, “Performance Analysis of Mobile Cellular-Connected Drones under Practical Antenna Configurations
” (paper presentation, 2020 Institute of Electrical and Electronics Engineers International Conference on Communications, Dublin, Ireland, June 7–11, 2020
).35.
Forooshani
A. E.
, Bashir
S.
, Michelson
D. G.
, and Noghanian
S.
, “A Survey of Wireless Communications and Propagation Modeling in Underground Mines
,” IEEE Communications Surveys & Tutorials
15
, no. 4
(March 2013
): 1524
–1545
, https://doi.org/10.1109/SURV.2013.031413.0013036.
Cao
B.
, Wang
S.
, Ge
S.
, and Liu
W.
, “Improving the Positioning Accuracy of UWB System for Complicated Underground NLOS Environments
,” IEEE Systems Journal
16
, no. 2
(June 2021
): 1808
–1819
, https://doi.org/10.1109/JSYST.2021.308310337.
Standard Test Method for Evaluating Emergency Response Robot Capabilities: Radio Communication: Non-Line-of-Sight Range
, ASTM E2855-12 (West Conshohocken, PA: ASTM International
, approved February 1, 2012
). https://doi.org/10.1520/E2855-1238.
Standard Test Method for Evaluating Response Robot Radio Communications Line-of-Sight Range
, ASTM E2854/E2854M-21 (West Conshohocken, PA: ASTM International
, approved January 1, 2021
). https://doi.org/10.1520/E2854_E2854M-21
This content is only available via PDF.
All rights reserved. This material may not be reproduced or copied, in whole or part, in any printed, mechanical, electronic, film, or other distribution and storage media, without the written consent of ASTM International.
You do not currently have access to this content.
