Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Bert - Who invented BERT?

Answer

Scientists at Google including Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova were the first to present BERT. The architecture is based on pre-training contextual representations that are inspired by ELMo, ULMFit, generative pre-training, semi-supervised sequence learning, and others.