In this paper, we propose distributed Gaussian process regression (GPR) for resource-constrained distributed sensor networks under localization uncertainty. The proposed distributed algorithm, which combines Jacobi over-relaxation (JOR) and discrete-time average consensus (DAC), can effectively handle localization uncertainty as well as limited communication and computation capabilities of distributed sensor networks. We also extend the proposed method hierarchically using sparse GPR to improve its scalability. The performance of the proposed method is verified in numerical simulations against the centralized maximum a posteriori (MAP) solution and a quick-and-dirty solution. We show that the proposed method outperforms the quick-and-dirty solution and achieve an accuracy comparable to the centralized solution.
Issue Section:
Research Papers
References
1.
Culler
, D.
, Estrin
, D.
, and Srivastava
, M.
, 2004
, “Guest Editors' Introduction: Overview of Sensor Networks
,” Computer
, 7
(8
), pp. 41
–49
.10.1109/MC.2004.932.
Estrin
, D.
, Culler
, D.
, Pister
, K.
, and Sukhatme
, G.
, 2002
, “Connecting the Physical World With Pervasive Networks
,” IEEE Pervasive Comput.
, 1
(1
), pp. 59
–69
.10.1109/MPRV.2002.9931453.
Lynch
, K.
, Schwartz
, I.
, Yang
, P.
, and Freeman
, R.
, 2008
, “Decentralized Environmental Modeling by Mobile Sensor Networks
,” IEEE Trans. Rob.
, 24
(3
), pp. 710
–724
.10.1109/TRO.2008.9215674.
Choi
, J.
, Oh
, S.
, and Horowitz
, R.
, 2009
, “Distributed Learning and Cooperative Control for Multi-Agent Systems
,” Automatica
, 45
(12
), pp. 2802
–2814
.10.1016/j.automatica.2009.09.0255.
Gu
, D.
, and Hu
, H.
, 2012
, “Spatial Gaussian Process Regression With Mobile Sensor Networks
,” IEEE Trans. Neural Networks Learn. Syst.
, 23
(8
), pp. 1279
–1290
.6.
Rasmussen
, C.
, and Williams
, C.
, 2006
, Gaussian Processes for Machine Learning
, Vol. 1
, MIT
, Cambridge, MA
.7.
Choi
, J.
, Lee
, J.
, and Oh
, S.
, 2008
, “Swarm Intelligence for Achieving the Global Maximum Using Spatio-Temporal Gaussian Processes
,” Proceedings of the American Control Conference
, Seattle, WA, pp. 135
–140
.8.
Xu
, Y.
, Choi
, J.
, and Oh
, S.
, 2011
, “Mobile Sensor Network Navigation Using Gaussian Processes With Truncated Observations
,” IEEE Trans. Rob.
, 27
(6
), pp. 1118
–1131
.10.1109/TRO.2011.21627669.
Williams
, C.
, and Seeger
, M.
, 2001
, “Using the Nystrom Method to Speed up Kernel Machines
,” Proceedings of the Advances in Neural Information Processing Systems
, Vancouver, British Columbia, Canada, pp. 682
–688
.10.
Lawrence
, N.
, Seeger
, M.
, and Herbrich
, R.
, 2002
, “Fast Sparse Gaussian Process Methods: The Informative Vector Machine
,” Proceedings of the Advances in Neural Information Processing Systems
, Montreal, Quebec, Canada, pp. 609
–616
.11.
Quiñonero-Candela
, J.
, and Rasmussen
, C. E.
, 2005
, “A Unifying View of Sparse Approximate Gaussian Process Regression
,” J. Mach. Learn. Res.
, 6
, pp. 1939
–1959
.12.
Chen
, J.
, Low
, K. H.
, Tan
, C. K.-Y.
, Oran
, A.
, Jaillet
, P.
, Dolan
, J. M.
, and Sukhatme
, G. S.
, 2012
, “Decentralized Data Fusion and Active Sensing With Mobile Sensors for Modeling and Predicting Spatiotemporal Traffic Phenomena
,” Proc. of the Conference on Uncertainty in Artificial Intelligence, Catalina Island, CA
, pp. 163
–173
.13.
Oguz-Ekim
, P.
, Gomes
, J.
, Xavier
, J.
, and Oliveira
, P.
, 2011
, “Robust Localization of Nodes and Time-Recursive Tracking in Sensor Networks Using Noisy Range Measurements
,” IEEE Trans. Signal Process.
, 59
(8
), pp. 3930
–3942
.10.1109/TSP.2011.215384814.
Karlsson
, R.
, and Gustafsson
, F.
, 2006
, “Bayesian Surface and Underwater Navigation
,” IEEE Trans. Signal Process.
, 54
(11
), pp. 4204
–4213
.10.1109/TSP.2006.88117615.
Mysorewala
, M.
, Popa
, D.
, and Lewis
, F.
, 2009
, “Multi-Scale Adaptive Sampling With Mobile Agents for Mapping of Forest Fires
,” J. Intell. Rob. Syst.
, 54
(4
), pp. 535
–565
.10.1007/s10846-008-9246-116.
Jadaliha
, M.
, Xu
, Y.
, Choi
, J.
, Johnson
, N.
, and Li
, W.
, 2013
, “Gaussian Process Regression for Sensor Networks Under Localization Uncertainty
,” IEEE Trans. Signal Process.
, 61
(2
), pp. 223
–237
.10.1109/TSP.2012.222369517.
Choi
, S.
, Jadaliha
, M.
, Choi
, J.
, and Oh
, S.
, 2013
, “Distributed Gaussian Process Regression for Mobile Sensor Network Under Localization Uncertainty
,” Proceedings of the IEEE Conference on Decision and Control
, Florence, Italy, pp. 4766
–4771
.18.
Smola
, A.
, and Bartlett
, P.
, 2001
, “Sparse Greedy Gaussian Process Regression
,” Proceedings of the Advances in Neural Information Processing Systems
, Vancouver, British Columbia, Canada.19.
Tierney
, L.
, and Kadane
, J.
, 1986
, “Accurate Approximations for Posterior Moments and Marginal Densities
,” J. Am. Stat. Assoc.
, 81
(393
), pp. 82
–86
.10.1080/01621459.1986.1047824020.
Tierney
, L.
, Kass
, R.
, and Kadane
, J. B.
, 1989
, “Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions
,” J. Am. Stat. Assoc.
, 84
(407
), pp. 710
–716
.10.1080/01621459.1989.1047882421.
Miyata
, Y.
, 2004
, “Fully Exponential Laplace Approximations Using Asymptotic Modes
,” J. Am. Stat. Assoc.
, 99
(468
), pp. 1037
–1049
.10.1198/01621450400000167322.
Miyata
, Y.
, 2010
, “Laplace Approximations to Means and Variances With Asymptotic Modes
,” J. Stat. Plann. Inference
, 140
(2
), pp. 382
–392
.10.1016/j.jspi.2009.06.01523.
Bertsekas
, D.
, and Tsitsiklis
, J.
, 1989
, Parallel and Distributed Computation: Numerical Methods
, Prentice-Hall
, Englewood Cliffs, NJ
.24.
Udwadia
, F.
, 1992
, “Some Convergence Results Related to the JOR Iterative Method for Symmetric, Positive-Definite Matrices
,” Appl. Math. Comput.
, 47
(1
), pp. 37
–45
.10.1016/0096-3003(92)90063-725.
Cortés
, J.
, 2009
, “Distributed Kriged Kalman Filter for Spatial Estimation
,” IEEE Trans. Autom. Control
, 54
(12
), pp. 2816
–2827
.10.1109/TAC.2009.203419226.
Olfati-Saber
, R.
, Fax
, J. A.
, and Murray
, R. M.
, 2007
, “Consensus and Cooperation in Networked Multi-Agent Systems
,” Proc. IEEE
, 95
, pp. 215
–233
.10.1109/JPROC.2006.88729327.
Olshevsky
, A.
, and Tsitsiklis
, J. N.
, 2009
, “Convergence Speed in Distributed Consensus and Averaging
,” SIAM J. Control Optim.
, 48
(1
), pp. 33
–55
.10.1137/06067832428.
Kempe
, D.
, and McSherry
, F.
, 2008
, “A Decentralized Algorithm for Spectral Analysis
,” J. Comput. Syst. Sci.
, 74
(1
), pp. 70
–83
.10.1016/j.jcss.2007.04.01429.
Forero
, P. A.
, Cano
, A.
, and Giannakis
, G. B.
, 2008
, “Consensus-Based k-Means Algorithm for Distributed Learning Using Wireless Sensor Networks
,” Proceedings of the Workshop on Sensors, Signal and Info. Process
., Sedona, AZ, pp. 11
–14
.30.
Forero
, P. A.
, Cano
, A.
, and Giannakis
, G. B.
, 2010
, “Convergence Analysis of Consensus-Based Distributed Clustering
,” IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP)
, Dallas, TX, pp. 1890
–1893
.31.
Choi
, S.
, Jadaliha
, M.
, Choi
, J.
, and Oh
, S.
, “Distributed Gaussian Process Regression Under Localization Uncertainty (Longer Version)
,” Technical Report No. 2014-04-1.Copyright © 2015 by ASME
You do not currently have access to this content.
