Pre-Trained Model - Is BERT a Pretrained model?

To be sure, BERT is unlike any pretrained model out there. It differs from its predecessors in that it trains exclusively on a raw text corpus and uses a deep bidirectional unsupervised language representation.