 inline">\(n, n&#39; \geq 0\)</span>, the
probability function <span class="math inline">\(p(\theta^{(n+1)}|\theta^{(n)})\)</span> is the same as
<span class="math inline">\(p(\theta^{(n&#39;+1)}|\theta^{(n&#39;)})\)</span> (following the convention of
overloading random and bound variables and picking out a probability
function by its arguments).</p>
<p>Stationary Markov chains have an <em>equilibrium distribution</em> on states
in which each has the same marginal probability function, so that
<span class=