Reported Scores
| Model | Score | Source paper | Year |
|---|---|---|---|
| mBERT | 82.2% | Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer / arxiv.org | 2021 |
| mBERT | 71.1% | From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers / arxiv.org | 2020 |
| mBERT | 48.5% | Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension / arxiv.org | 2022 |
| mBERT | 25.0% | XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization / arxiv.org | 2020 |
Interpretation
This page groups score claims extracted from papers for the same model and benchmark label. A nonzero spread means the public literature reports different values for this cluster.
Differences are not automatically errors. They may come from prompt choices, dataset versions, evaluation protocol, scoring rule, preprocessing, fine-tuning, or reporting convention. Source papers remain authoritative for their own claims. See the quality guide for how to read evidence links, manifests, and automated assessment fields.
Source coverage is a conservative count of distinct public paper URLs or titles in the cluster. It measures coverage breadth, not correctness.
Source profile reports public URL domains and publication years when they are available in extracted records. It is included for auditability only.