Estimation and selection for high-order Markov chains with Bayesian mixture transition distribution models

We develop two models for Bayesian estimation and selection in high-order, discrete-state Markov chains. Both are based on the mixture transition distribution, which constructs a transition probability tensor with additive mixing of probabilities from first-order transition matrices. We demonstrate...

Full description

Bibliographic Details
Published in:Journal of Computational and Graphical Statistics
Main Authors: Heiner, Matthew, Kottas, Athanasios
Format: Text
Language:unknown
Published: 2019
Subjects:
Online Access:http://arxiv.org/abs/1906.10781
https://doi.org/10.1080/10618600.2021.1979565
Description
Summary:We develop two models for Bayesian estimation and selection in high-order, discrete-state Markov chains. Both are based on the mixture transition distribution, which constructs a transition probability tensor with additive mixing of probabilities from first-order transition matrices. We demonstrate two uses for the proposed models: parsimonious approximation of high-order dynamics by mixing lower-order transition models, and order/lag selection through over-specification and shrinkage via priors for sparse probability vectors. The priors further shrink all models to an identifiable and interpretable parameterization, useful for data analysis. We discuss properties of the models and demonstrate their utility with simulation studies. We further apply the methodology to a data analysis from the high-order Markov chain literature and to a time series of pink salmon abundance in a creek in Alaska, U.S.A.