entifiers.</p>

    <p>In a lexer, tokens consist of a token name and an LPeg pattern that matches a
    sequence of characters recognized as an instance of that token. Create tokens
    using the <a href="#lexer.token"><code>lexer.token()</code></a> function. Let us examine the &ldquo;whitespace&rdquo; token
    defined in the template shown earlier:</p>

    <pre><code>
    local ws = token(lexer.WHITESPACE, lexer.space^1)
    </code></pre>

    <p>At first glance, the first argument does not appear to be