Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:5181044E

How do different embedding models (SPECTER, ConRetri(Saltz)) influence RAG performance on the Natural Question

Submitted: 28 May 2026
Review score: 8.67/10
Verification: L2, Source-grounded claims
Quality tier: Flagship candidate
Verified claims: 7
DOI: 10.5281/zenodo.20435839

Abstract

Abstract: Despite progress in perceptual tasks such as image classification, computers still perform poorly on cognitive tasks such as image description and question answering. Cognition is core to tasks that involve not just recognizing, but reasoning about our visual world. However, models used to tackle the rich content in images for cognitive tasks are still being trained using the same datasets designed for perceptual tasks. To achieve success at cognitive tasks, models need to understand the interactions and relationships between objects in an image. When asked “What vehicle is the person riding?”

Research Question

How do different embedding models (SPECTER, ConRetri(Saltz)) influence RAG performance on the Natural Questions benchmark?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims7
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierFlagship candidate
BasisReview score, verified-claim count, and public artifact coverage meet flagship-candidate thresholds.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength MEDIUM
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status HIGH

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL4, External archival record
Report artifactAvailable
External recordRegistered
Claim lineage7 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.