Text

Efficient Parameter Sampling for Markov Jump Processes

Markov jump processes (MJPs) are continuous-time stochastic processes widely used in a variety of applied disciplines. Inference typically proceeds via Markov chain Monte Carlo (MCMC), the state-of-the-art being a uniformization-based auxiliary variable Gibbs sampler. This was designed for situations where the process parameters are known, and Bayesian inference over unknown parameters is typically carried out by incorporating it into a larger Gibbs sampler. This strategy of sampling parameters given path, and path given parameters can result in poor Markov chain mixing. In this work, we propose a simple and efficient algorithm to address this problem. Our scheme brings Metropolis–Hastings (MH) approaches for discrete-time hidden Markov models to the continuous-time setting, resulting in a complete and clean recipe for parameter and path inference in MJPs. In our experiments, we demonstrate superior performance over Gibbs sampling, a more naïve MH algorithm, as well as another popular approach, particle MCMC. We also show our sampler inherits geometric mixing from an “ideal” sampler that is computationally much more expensive. Supplementary materials for this article are available online.

Ketersediaan

Informasi Detail

Judul Seri

JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS; Vol.30 No.1 March 2021

No. Panggil

-

Penerbit

: .,

Deskripsi Fisik

p. 25 - 42

Bahasa

English

ISBN/ISSN

-

Klasifikasi

-

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

MARKOV CHAIN MONTE CARLO
GEOMETRIC ERGODICITY
UNIFORMIZATION
CONTINUOUS-TIME MARKOV CHAIN
METROPOLIS–HASTINGS

Info Detail Spesifik

https://doi.org/10.1080/10618600.2020.1763807

Pernyataan Tanggungjawab

Boqian Zhang, Vinayak Rao

Versi lain/terkait

Lampiran Berkas

Komentar