Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Generative Pretrained Transformer - Is GPT pretraining unsupervised?

Answer

An approach to deep learning known as generative pretraining (GPT) makes use of a big collection of text data to train a language model unsupervisedly.