ce. Your language probably also has
    elements like comments, strings, and keywords. Lexers refer to these elements
    as &ldquo;tokens&rdquo;. Tokens are the fundamental &ldquo;building blocks&rdquo; of lexers. Lexers
    break down source code into tokens for coloring, which results in the syntax
    highlighting familiar to you. It is up to you how specific your lexer is when
    it comes to tokens. Perhaps only distinguishing between keywords and
    identifiers is necessary, or maybe recognizing con