Cross-benchmark generalization of PRISM framework's robustness to irrelevant context: how do Llama-3, Mistral,

Abstract

Abstract: Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and generation is acquired by training billions of model's parameters on massive amounts of text data, as predicted by scaling laws cite\kaplan2020scaling,hoffmann2022training\. The research area of LLMs, while very recent, is evolving rapidly in many different ways. In this paper, we review some of the most prominent LLMs, including three popular LLM families

Research Question

Cross-benchmark generalization of PRISM framework's robustness to irrelevant context: how do Llama-3, Mistral, and Qwen model backends compare on F1 and precision metrics when evaluated on standardized multi-hop reasoning benchmarks with context windows from 1k to 32k tokens?

Verification Level

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance