Index  |  Benchmarks  |  Mathematics  |  Graph  |  About

Qwen2.5 on MMLU

Evidence cluster: 4 reported scores
Source coverage: 4 distinct sources (moderate)
Source profile: arxiv.org, 2024 to 2025
Reported range: 25.0% to 86.1%
Spread: 61.1 pp (HIGH)

Reported Scores

Model Score Source paper Year
Qwen2.5 86.1% Qwen2.5 Technical Report / arxiv.org 2024
Qwen2.5 74.9% Mobile-MMLU: A Mobile Intelligence Language Understanding Benchmark / arxiv.org 2025
Qwen2.5 70.0% LLaDA-MoE: A Sparse MoE Diffusion Language Model / arxiv.org 2025
Qwen2.5 25.0% Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmark / arxiv.org 2025

Interpretation

This page groups score claims extracted from papers for the same model and benchmark label. A nonzero spread means the public literature reports different values for this cluster.

Differences are not automatically errors. They may come from prompt choices, dataset versions, evaluation protocol, scoring rule, preprocessing, fine-tuning, or reporting convention. Source papers remain authoritative for their own claims. See the quality guide for how to read evidence links, manifests, and automated assessment fields.

Source coverage is a conservative count of distinct public paper URLs or titles in the cluster. It measures coverage breadth, not correctness.

Source profile reports public URL domains and publication years when they are available in extracted records. It is included for auditability only.