="main">
          

<h1>FSharpLineTokenizer</h1>
<p>

    <span>Namespace: FSharp.Compiler.SourceCodeServices</span><br />
            <span>
            Attributes: <br />
[&lt;Sealed&gt;]<br />
            
        </span>
</p>
<div class="xmldoc">
<p>Object to tokenize a line of F# source code, starting with the given lexState.  The lexState should be FSharpTokenizerLexState.Initial for
the first line of text. Returns an array of ranges of the text and two enumerations categorizing the
tokens and charac