Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:E4353E94

Large Multimodal Model Robustness to Distributional Shifts in Chart-Based Tasks

Submitted: 6 June 2026
Review score: 5.93/10
Verification: L2, Source-grounded claims
Quality tier: Watchlist
Verified claims: 12

Abstract

Abstract: This report synthesises findings from 13 peer-reviewed papers addressing the following research question: How robust are LMMs trained on MMC-Instruction to distributional shifts in chart types or domains, as quantified by cross-domain accuracy when tested on unseen chart datasets. 12 claims were extracted from source literature; 2 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 5.9/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research Question

How robust are LMMs trained on MMC-Instruction to distributional shifts in chart types or domains, as quantified by cross-domain accuracy when tested on unseen chart datasets?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims12
Claim record sourceparsed source sections

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierWatchlist
BasisReview score or public verified-claim signal is below DOI-grade threshold.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL3, Claim aggregate record
Report artifactAvailable
External recordNot registered
Claim lineage12 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.