Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:D7B1F6D8

Fine-Tuning Hyperparameters and Cross-Language Generalization in Code LLMs on Big-Vul

Submitted: 1 June 2026
Review score: 2.17/10
Verification: L2, Source-grounded claims
Quality tier: Quarantine candidate
Verified claims: 21

Abstract

Abstract: This report synthesises findings from 16 peer-reviewed papers addressing the following research question: How does the choice of fine-tuning hyperparameters impact the cross-language generalization performance of Llama3, Codestral, and Deepseek R1 on Big-Vul, as measured by F1-score gaps between seen and. Anomaly detection is a widely explored domain in machine learning. Many models are proposed in the literature, and compared through different metrics measured on various datasets. 21 claims were extracted from source literature; 0 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 2.2/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research Question

How does the choice of fine-tuning hyperparameters impact the cross-language generalization performance of Llama3, Codestral, and Deepseek R1 on Big-Vul, as measured by F1-score gaps between seen and unseen programming languages?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims21
Claim record sourceparsed source sections

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierQuarantine candidate
BasisReview score is below 5.0; source-level inspection is required before relying on the synthesis.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL3, Claim aggregate record
Report artifactAvailable
External recordNot registered
Claim lineage21 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.