Unsupervised Cross-lingual Representation Learning at Scale.

Conneau, A., Khandelwal, Goyal, Chaudhary, Wenzek, Guzman, Grave, et al. (2020). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 8440-8451.

Type

Conference paper

Intellectual base

Primary research

Year

2020

Link

https://aclanthology.org/2020.acl-main.747/

Cited from

linguistics_semiotics

Cited by

2 citations across 2 artifacts.

Each citation links to the sentence it supports in the citing article.

Primes

• Code-Switching
  • Analogous structurally even if the user group is a single brain. Computational linguistics and NLP: Modern multilingual language models (XLM-R)

    This sourceIntroduces XLM-R, a multilingual masked-language model trained on 100 languages of CommonCrawl that implicitly ingests code-switched data.

• Linguistic Universals
  • - Machine translation and multilingual NLP: Multilingual models (XLM, mBERT, XLM-R

    This sourceConneau XLM-R multilingual model cross-lingual transfer learning universals.

Verification

This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.

Registry ID ref:fd245cd95642 · see in the full table