Vector Markov processes (also known as population Markov processes) are an important class of stochastic processes that have been used to model a wide range of technological, biological, and socioeconomic systems. The dynamics of vector Markov processes are fully characterized, in a stochastic sense, by the state transition probability matrix P. In most applications, P has to be estimated based on either incomplete or aggregated process observations. Here, in contrast to established methods for estimation given aggregate data, we develop Bayesian formulations for estimating P from asynchronous aggregate (longitudinal) observations of the population dynamics. Such observations are common, for example, in the study of aggregate biological cell population dynamics via flow cytometry. We derive the Bayesian formulation, and show that computing estimates via exact marginalization are, generally, computationally expensive. Consequently, we rely on Monte Carlo Markov chain sampling approaches to estimate the posterior distributions efficiently. By explicitly integrating problem constraints in these sampling schemes, significant efficiencies are attained. We illustrate the algorithm via simulation examples and show that the Bayesian estimation schemes can attain significant advantages over point estimates schemes such as maximum likelihood.
Estimation of State Transition Probabilities in Asynchronous Vector Markov Processes
Contributed by the Dynamic Systems Division of ASME for publication in the JOURNAL OF DYNAMIC SYSTEMS, MEASUREMENT, AND CONTROL. Manuscript received February 25, 2010; final manuscript received November 27, 2011; published online September 13, 2012. Assoc. Editor: Sheng-Guo Wang.
- Views Icon Views
- Share Icon Share
- Cite Icon Cite
- Search Site
Farahat, W. A., and Asada, H. H. (September 13, 2012). "Estimation of State Transition Probabilities in Asynchronous Vector Markov Processes." ASME. J. Dyn. Sys., Meas., Control. November 2012; 134(6): 061003. https://doi.org/10.1115/1.4006087
Download citation file:
- Ris (Zotero)
- Reference Manager