Skip to content

lexer.h#

Lexer and tokenizer for Nest code.

Authors#

TheSilvered

Functions#

Nst_tokenize#

Synopsis:

Nst_DynArray Nst_tokenize(Nst_SourceText *text)

Description:

Tokenize a Nst_SourceText.

Parameters:

  • text: the text to tokenize

Returns:

A Nst_DynArray of Nst_Tok. On failure it has length 0. The error is set.