![Checkout](https://naologiccom.imgix.net/website-update/general/checkout.png?auto=compress&w=64&fm=png)
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial Question
Tokens - How do I identify a token?
Answer
Identification of the Lexer control token according to its specific rules. Tokens can be located using a dictionary definition, regular expressions, flagging with certain sequences of characters, or delimiters.