Ohio State University, Columbus

These are the General Language Understanding Evaluation (GLUE) test results for BERT after fine-tuning:
- Both BERT$$_{BASE}$$ and BERT$$_{LARGE}$$ outperform all systems on all tasks by a substantial margin, obtaining 4.5% and 7.0% respective average accuracy improvements.
- BERT$$_{LARGE}$$ significantly outperforms BERT$$_{BASE}$$ across all tasks, especially those with very little training data.

BERT GLUE Results

Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.

https://paperswithcode.com/method/bert

Learn Before