Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Generative Pretrained Transformer - Is GPT pretraining unsupervised?

Answer

An approach to deep learning known as generative pretraining (GPT) makes use of a big collection of text data to train a language model unsupervisedly.