The asymptotic tails of limit distributions of continuous-time Markov chains
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Standard
The asymptotic tails of limit distributions of continuous-time Markov chains. / Xu, Chuang; Hansen, Mads Christian; Wiuf, Carsten.
I: Advances in Applied Probability, Bind 56, Nr. 2, 2024, s. 693–734.Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - The asymptotic tails of limit distributions of continuous-time Markov chains
AU - Xu, Chuang
AU - Hansen, Mads Christian
AU - Wiuf, Carsten
N1 - Publisher Copyright: © The Author(s), 2023. Published by Cambridge University Press on behalf of Applied Probability Trust.
PY - 2024
Y1 - 2024
N2 - This paper investigates tail asymptotics of stationary distributions and quasi-stationary distributions (QSDs) of continuous-time Markov chains on subsets of the non-negative integers. Based on the so-called flux-balance equation, we establish identities for stationary measures and QSDs, which we use to derive tail asymptotics. In particular, for continuous-time Markov chains with asymptotic power law transition rates, tail asymptotics for stationary distributions and QSDs are classified into three types using three easily computable parameters: (i) super-exponential distributions, (ii) exponential-tailed distributions, and (iii) sub-exponential distributions. Our approach to establish tail asymptotics of stationary distributions is different from the classical semimartingale approach, and we do not impose ergodicity or moment bound conditions. In particular, the results also hold for explosive Markov chains, for which multiple stationary distributions may exist. Furthermore, our results on tail asymptotics of QSDs seem new. We apply our results to biochemical reaction networks, a general single-cell stochastic gene expression model, an extended class of branching processes, and stochastic population processes with bursty reproduction, none of which are birth-death processes. Our approach, together with the identities, easily extends to discrete-time Markov chains.
AB - This paper investigates tail asymptotics of stationary distributions and quasi-stationary distributions (QSDs) of continuous-time Markov chains on subsets of the non-negative integers. Based on the so-called flux-balance equation, we establish identities for stationary measures and QSDs, which we use to derive tail asymptotics. In particular, for continuous-time Markov chains with asymptotic power law transition rates, tail asymptotics for stationary distributions and QSDs are classified into three types using three easily computable parameters: (i) super-exponential distributions, (ii) exponential-tailed distributions, and (iii) sub-exponential distributions. Our approach to establish tail asymptotics of stationary distributions is different from the classical semimartingale approach, and we do not impose ergodicity or moment bound conditions. In particular, the results also hold for explosive Markov chains, for which multiple stationary distributions may exist. Furthermore, our results on tail asymptotics of QSDs seem new. We apply our results to biochemical reaction networks, a general single-cell stochastic gene expression model, an extended class of branching processes, and stochastic population processes with bursty reproduction, none of which are birth-death processes. Our approach, together with the identities, easily extends to discrete-time Markov chains.
KW - Discrete-time Markov chain
KW - quasi-stationary distribution
KW - stationary measure
KW - stochastic reaction network
KW - tail distribution
U2 - 10.1017/apr.2023.42
DO - 10.1017/apr.2023.42
M3 - Journal article
AN - SCOPUS:85174342288
VL - 56
SP - 693
EP - 734
JO - Advances in Applied Probability
JF - Advances in Applied Probability
SN - 0001-8678
IS - 2
ER -
ID: 390284738