Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:60289CAF

To what extent does incorporating unanswerable questions through negative sampling techniques improve performa

Submitted: 29 May 2026
Review score: 7.33/10
Verification: L2, Source-grounded claims
Quality tier: Watchlist
Verified claims: 9

Abstract

Abstract: We present the results of the Machine Reading for Question Answering (MRQA) 2019 shared task on evaluating the generalization capabilities of reading comprehension systems. 1 In this task, we adapted and unified 18 distinct question answering datasets into the same format. Among them, six datasets were made available for training, six datasets were made available for development, and the final six were hidden for final evaluation. Ten teams submitted systems, which explored various ideas including data sampling, multi-task learning, adversarial training, and ensembling. The best system achieve

Research Question

To what extent does incorporating unanswerable questions through negative sampling techniques improve performance on the MRQA datasets when evaluated on the SQuAD 2.0 and MRQA out-of-distribution splits?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims9
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierWatchlist
BasisReview score or public verified-claim signal is below DOI-grade threshold.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL3, Claim aggregate record
Report artifactAvailable
External recordNot registered
Claim lineage9 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.