P<span class="op">-</span><span class="dv">1</span>, TIME_EP), np.arange(<span class="dv">1</span>), np.arange(<span class="dv">1</span>)] <span class="co"># one state per value that the counter may possibly have within an episode.</span></span>
<span id="cb4-3"><a href="#cb4-3" aria-hidden="true" tabindex="-1"></a><span class="co">#--the last two entries are just placeholders here, but the code is general enough to implement ensembles of interacting agents that forage together.--</span></span>
<span id="cb