><span></span><span class="bp">self</span><span class="o">.</span><span class="n">key</span></code>
, and <code  class="highlight"><span></span><span class="bp">self</span><span class="o">.</span><span class="n">value</span></code>
.</p>
<p>We combine a spatial depth-wise convolution layer to each of them and replace <code  class="highlight"><span></span><span class="bp">self</span><span class="o">.</span><span class="n">query</span></code>
, <code  class="highlight"><span></span><span class="bp">self</span