Approximation of the I-divergence between stationary and hidden Markov processes

Authors
Publication date 2008
Book title Proceedings of the 2008 International Workshop on Applied Probability (IWAP 2008)
Event 2008 International Workshop on Applied Probability (IWAP 2008), Compiègne, France
Publisher Compiègne, France: Université de Technologie de Compiègne
Organisations
  • Faculty of Science (FNWI) - Korteweg-de Vries Institute for Mathematics (KdVI)
Abstract We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under mild conditions, the existence of the divergence rate between a stationary process and an HMM. Since in general there is no analytic expression available for this divergence rate, we approximate it with a properly defined, and easily computable, divergence between Hankel matrices, which we propose as an approximation criterion.

Document type Conference contribution
Note Alleen verkrijgbaar op CD-rom
Published at http://staff.science.uva.nl/~spreij/hmmIWAP2008.pdf
Permalink to this page
Back