Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Pre-Trained Model - What is a Pretrained model in NLP?

Answer

In natural language processing, pre-trained models are known as Large Language Models (LLMs). Without any particular downstream goals in mind, they are trained on massive amounts of textual data. A big amount of data should be processed by the model, and some "general knowledge" should be extracted from it.