Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Bert - Who invented BERT?

Answer

Scientists at Google including Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova were the first to present BERT. The architecture is based on pre-training contextual representations that are inspired by ELMo, ULMFit, generative pre-training, semi-supervised sequence learning, and others.