r>

    <tr>
      <td valign="top">Functor</td>

      <td valign="top"><tt>func(next, end, tok)</tt></td>

      <td valign="top"><tt>bool</tt></td>
    </tr>

    <tr>
      <td valign="top">reset</td>

      <td valign="top"><tt>reset()</tt></td>

      <td valign="top"><tt>void</tt></td>
    </tr>
  </table>

  <h2>Expression semantics</h2>

  <p>In addition to the expression semantics in Assignable and
  CopyConstructable, TokenizerFunction has the following expression
  semantcs</p>

  <table border=