Detecting Markov Chain Instability a Monto Carlo approach
| Authors |
|
|---|---|
| Publication date | 12-2017 |
| Journal | Stochastic Systems |
| Volume | Issue number | 7 | 2 |
| Pages (from-to) | 289-314 |
| Organisations |
|
| Abstract |
We devise a Monte Carlo based method for detecting whether a non-negative Markov chain is stable for a given set of parameter values. More precisely, for a given subset of the parameter space, we develop an algorithm that is capable of deciding whether the set has a subset of positive Lebesgue measure for which the Markov chain is unstable. The approach is based on a variant of simulated annealing, and consequently only mild assumptions are needed to obtain performance guarantees.
The theoretical underpinnings of our algorithm are based on a result stating that the stability of a set of parameters can be phrased in terms of the stability of a single Markov chain that searches the set for unstable parameters. Our framework leads to a procedure that is capable of performing statistically rigorous tests for instability, which has been extensively tested using several examples of standard and non-standard queueing networks. |
| Document type | Article |
| Language | English |
| Published at | https://doi.org/10.1287/stsy.2017.0003 |
| Downloads |
Detecting Markov Chain Instability
(Final published version)
|
| Permalink to this page | |