Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:5BCE5DEA

How do Qwen-Audio, Whisper-Large-V3, and OpenPangu-7B-MLA perform in terms of inference latency and accuracy t

Submitted: 10 June 2026
Review score: 6.50/10
Verification: L1, Literature synthesis
Gate status: Unverified
Quality tier: Watchlist

Abstract

Abstract: Large Language Models achieve remarkable performance but incur substantial computational costs unsuitable for resource-constrained deployments. This paper presents the first comprehensive task-specific efficiency analysis comparing 16 language models across five diverse NLP tasks. We introduce the Performance-Efficiency Ratio (PER), a novel metric integrating accuracy, throughput, memory, and latency through geometric mean normalization. Our systematic evaluation reveals that small models (0.5–3B parameters) achieve superior PER scores across all given tasks. These findings establish quantita

Research Question

How do Qwen-Audio, Whisper-Large-V3, and OpenPangu-7B-MLA perform in terms of inference latency and accuracy trade-offs when deployed in resource-constrained edge devices for low-resource language applications?

Verification Level

Paper levelL1, Literature synthesis
Source-grounded claims0
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Truth-Engine Gate Verdict

StatusUnverified
GateGate 2 — Verification (formal proof or sandbox reproduction)
ReasonPublished before the Gate 2 verification pipeline was activated (2026-06-10). No formal proof or sandbox reproduction has been attempted for this record.
Evaluated2026-06-10T06:30:49+00:00

This record has not completed Gate 2 of the verification pipeline (a type-checked Lean4 proof for mathematical claims, or a sealed-sandbox reproduction for empirical claims). It is a literature synthesis only. VERIFIED requires an attached reproducible artifact (Lean4 proof source, or repro script and results) before this status can be set; it is not derived from review score or claim count.

Quality Tier

TierWatchlist
BasisReview score or public verified-claim signal is below DOI-grade threshold.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL2, Public artifact record
Report artifactAvailable
External recordNot registered
Claim lineage0 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.