Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Pre-Trained Model - What is a Pretrained model in NLP?

Answer

In natural language processing, pre-trained models are known as Large Language Models (LLMs). Without any particular downstream goals in mind, they are trained on massive amounts of textual data. A big amount of data should be processed by the model, and some "general knowledge" should be extracted from it.