 (which coincides with the number of RL steps per episode)<br>
<code>NUM_BINS</code> : number of bins in which the state space is split. This is set to have one state per value of the counter<br>
<code>NUM_ACTIONS</code> : number of actions<br>
<code>GAMMA</code> : forgetting parameter <span class="math inline">\(\gamma\)</span> in PS<br>
<code>ETA_GLOW</code> : glow damping parameter <span class="math inline">\(\eta_g\)</span> in PS<br>
<code>PI_INIT</code> : policy initialization <span class="math inline"