Name
Abstract | ||
|---|---|---|
The method of types is one of the most popular techniques in information theory and combinatorics. Two sequences of equal length have the same type if they have identical empirical distributions. In this paper, we focus on Markov types, that is, sequences generated by a Markov source (of order one). We note that sequences having the same Markov type share the same so-called balanced frequency matrix that counts the number of distinct pairs of symbols. We enumerate the number of Markov types for sequences of length $n$ over an alphabet of size $m$ . This turns out to be asymptotically equivalent to estimating the number of the balanced frequency matrices, the number of integer solutions of a system of linear Diophantine equations, and the number of connected Eulerian multigraphs. For fixed $m$, we prove that the number of Markov types is asymptotically equal to $$ d(m) {{n^{m^{2}-m}} \\over {(m^{2}-m)!}} $$where we give an integral representation for $d(m)$. For $m\\to \\infty$, we conclude that asymptotically the number of types is equivalent to $$ {{\\sqrt {2}m^{3m/2} e^{m^{2}}} \\over {m^{2m^{2}} 2^{m} \\pi^{m/2}}} n^{m^{2}-m} $$provided that $m=o(n^{1/4})$ . These findings are derived by analytical techniques ranging from analytic combinatorics, to multidimensional generating functions, to the saddle point method. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1109/TIT.2012.2191476 | IEEE Transactions on Information Theory |
Keywords | Field | DocType |
information theory,empirical distribution,generating function,probabilistic logic,markov processes,graph theory,eulerian graph,analytic combinatorics,probability,markov process,diophantine equation | Integer,Discrete mathematics,Analytic combinatorics,Combinatorics,Markov process,M/M/c queue,Matrix (mathematics),Markov chain,Eulerian path,Matrix analytic method,Mathematics | Journal |
Volume | Issue | ISSN |
58 | 7 | 0018-9448 |
Citations | PageRank | References |
6 | 0.59 | 8 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Philippe Jacquet | 1 | 714 | 90.11 |
| Charles Knessl | 2 | 215 | 40.43 |
| Wojciech Szpankowski | 3 | 1557 | 192.33 |