Ohio State University, Columbus

These are the SQuAD v2.0 Test results after fine-tuning:
- BERT$_{LARGE}$ outperforms the authors’ baseline ESIM+ELMo system by +27.1% and OpenAI GPT by 8.3%


SWAG Results

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.

https://paperswithcode.com/method/bert

Learn Before

Related