Index  |  Benchmarks  |  Mathematics  |  Graph  |  About

Gemini-1.5-Flash on MMLU

Evidence cluster: 2 reported scores
Source coverage: 2 distinct sources (limited)
Source profile: arxiv.org, doi.org, 2024 to 2025
Reported range: 8.2% to 43.6%
Spread: 35.4 pp (HIGH)

Reported Scores

Model Score Source paper Year
Gemini-1.5-Flash 43.6% Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmark / arxiv.org 2025
Gemini-1.5-Flash 8.2% Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context / doi.org 2024

Interpretation

This page groups score claims extracted from papers for the same model and benchmark label. A nonzero spread means the public literature reports different values for this cluster.

Differences are not automatically errors. They may come from prompt choices, dataset versions, evaluation protocol, scoring rule, preprocessing, fine-tuning, or reporting convention. Source papers remain authoritative for their own claims. See the quality guide for how to read evidence links, manifests, and automated assessment fields.

Source coverage is a conservative count of distinct public paper URLs or titles in the cluster. It measures coverage breadth, not correctness.

Source profile reports public URL domains and publication years when they are available in extracted records. It is included for auditability only.