</h2>

  <table border="1" summary="">
    <tr>
      <td valign="top"><tt>X</tt></td>

      <td valign="top">A type that is a model of TokenizerFunction</td>
    </tr>

    <tr>
      <td valign="top"><tt>func</tt></td>

      <td valign="top">Object of type <tt>X</tt></td>
    </tr>

    <tr>
      <td valign="top"><tt>tok</tt></td>

      <td valign="top">Object of Token</td>
    </tr>

    <tr>
      <td>next</td>

      <td>iterator that points to the first unparsed element of the sequence
      being