Generative Pretrained Transformer - How big is GPT-3 pretraining data?

By a wide margin, GPT-3 outshines all prior language models with its estimated 175 billion parameters. It was trained using around 45 terabytes of text data extracted from many databases.