Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:D0C52F9E

Can retrieval-augmented 3B models achieve comparable robustness to distractor contexts in multi-hop QA tasks a

Submitted: 10 June 2026
Review score: 3.67/10
Verification: L2, Source-grounded claims
Gate status: Unverified
Quality tier: Quarantine candidate
Verified claims: 7

Abstract

Abstract: Accurate and contextually faithful responses are critical when applying large language models (LLMs) to sensitive and domain-specific tasks, such as answering queries related to quranic studies. General-purpose LLMs often struggle with hallucinations, where generated responses deviate from authoritative sources, raising concerns about their reliability in religious contexts. This challenge highlights the need for systems that can integrate domain-specific knowledge while maintaining response accuracy, relevance, and faithfulness. In this study, we investigate 13 open-source LLMs categorized in

Research Question

Can retrieval-augmented 3B models achieve comparable robustness to distractor contexts in multi-hop QA tasks as larger models while maintaining inference efficiency metrics like latency and throughput?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims7
Claim record sourceparsed source sections

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Truth-Engine Gate Verdict

StatusUnverified
GateGate 2 — Verification (formal proof or sandbox reproduction)
ReasonPublished before the Gate 2 verification pipeline was activated (2026-06-10). No formal proof or sandbox reproduction has been attempted for this record.
Evaluated2026-06-10T06:30:49+00:00

This record has not completed Gate 2 of the verification pipeline (a type-checked Lean4 proof for mathematical claims, or a sealed-sandbox reproduction for empirical claims). It is a literature synthesis only. VERIFIED requires an attached reproducible artifact (Lean4 proof source, or repro script and results) before this status can be set; it is not derived from review score or claim count.

Quality Tier

TierQuarantine candidate
BasisReview score is below 5.0; source-level inspection is required before relying on the synthesis.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL3, Claim aggregate record
Report artifactAvailable
External recordNot registered
Claim lineage7 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.