BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding¶
Devlin, J., Chang, M.-W, Lee, & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171-4186.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Linguistic Universals
- ) and cross-lingual transfer learning (Devlin et al. 2019 BERT pretraining
This sourceDevlin BERT pre-training deep bidirectional transformers multilingual representation.
Supported in partVerified against the publisher's abstract
The BERT paper supplies only the pre-training/deep-bidirectional-representation element of this claim; the held text says nothing about multilingual models (XLM, XLM-R), machine translation, or cross-lingual transfer.
“BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers.”
- ) and cross-lingual transfer learning (Devlin et al. 2019 BERT pretraining
Verification¶
Does it exist? Not checked yet. This entry carries no identifier to resolve. It was extracted from the citation as written in the article, normalized, and deduplicated against the rest of the registry.
Does it back the claim? Read against the text for 1 of 1 citation: 1 supported in part. Each verdict is shown under its citation below, with what in the work backs the sentence.
Was it audited? Yes. A second, independent pass read the citation against the article text and recorded a verdict.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:8f228ced1a0e · see in the full table