Index |  Research ▾  |  Verification ▾  | About
SRCH:3C02C7E4

Synthetic Code-Switched Training Data for Zero-Shot Cross-Lingual Retrieval on BUCC-2018

Submitted: 6 July 2026
Review score: 8.07/10
Verification: L2, Source-grounded claims
Gate status: Falsified
Quality tier: DOI grade
Verified claims: 15
DOI: 10.5281/zenodo.21215612

Abstract

Abstract: Transferring information retrieval (IR) models from a high-resource language (typically English) to other languages in a zero-shot fashion has become a widely adopted approach. In this work, we show that the effectiveness of zero-shot rankers diminishes when queries and documents are present in different languages. Motivated by this, we propose to train ranking models on artificially code-switched data instead, which we generate by utilizing bilingual lexicons. To this end, we experiment with lexicons induced from (1) cross-lingual word embeddings and (2) parallel Wikipedia page titles. We use

Research Question

How does the integration of synthetic code-switched training data impact the zero-shot cross-lingual retrieval performance (mAP) of language models on Bucc-2018 when evaluated against natural bilingual lexicon variations?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims15
Claim record sourceparsed source sections

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Truth-Engine Gate Verdict

StatusFalsified
GateGate 2 — Verification (formal proof or sandbox reproduction)
ReasonSealed-sandbox formula repro FAILED: Computed 11.4 ≠ expected 15.4 (diff=26.0%, tolerance=5.0%).
Evaluated2026-07-06T08:47:00.825598+00:00

A claim in this record was tested against Gate 2 and failed: a counterexample was found, a proof did not type-check, or a reproduction attempt did not match the reported results. Evidence for the failure is attached to this record. VERIFIED requires an attached reproducible artifact (Lean4 proof source, or repro script and results) before this status can be set; it is not derived from review score or claim count.

Quality Tier

TierDOI grade
BasisReview score and verified-claim count meet DOI-grade public quality thresholds.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength MEDIUM
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status HIGH

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL4, External archival record
Report artifactAvailable
External recordRegistered
Claim lineage15 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.