the data</p></li>
<li><p>tradeoff: ‚Äúgood‚Äù prob. models for the data permit shorter code lengths</p>
<ul>
<li><p>generally agrees w/ low mse</p></li>
</ul>
</li>
<li><p>ex. encode data w/ model defined by mle estimates, quantized optimally to finite precision, then encode estimate w/ prefix code</p></li>
<li><p>mdl</p>
<ul>
<li><p>likelihood = summarize data in accodance / model (e.g. <span class="math notranslate nohighlight">\(P(y|x, \theta)\)</span>)</p></li>
<li><p>parametric complexity = sum