Tokens - How do I identify a token?

Identification of the Lexer control token according to its specific rules. Tokens can be located using a dictionary definition, regular expressions, flagging with certain sequences of characters, or delimiters.