list): Next state of the agent.</span>
<span class="sd">            reward (float): Reward for the selected action.</span>
<span class="sd">            epsilon (float): The exploration parameter.</span>
<span class="sd">            lr (float): Learning rate.</span>
<span class="sd">            **kwargs (dict): The keyword arguments.</span>
<span class="sd">        &quot;&quot;&quot;</span>
        <span class="n">Q_a</span> <span class="o">=</span> <span class="n">kwargs</span><span class="p">[</span><span 