t actually generate our data</p></li>
</ul>
</li>
<li><p>basic coding</p>
<ul>
<li><p>set A, code C (mapping from A to a set of codewords)</p></li>
<li><p>Q is a distr. on A</p></li>
<li><p><span class="math notranslate nohighlight">\(-\log_2Q\)</span> is the code length for symbols in A</p>
<ul>
<li><p>can construct such a code w/ Huffman coding</p></li>
</ul>
</li>
<li><p>expected code length is minimized when Q = P, the true distr of our data</p></li>
</ul>
</li>
<li><p>different forms</p>
<ul>
<li><p>2-