Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:340E1585

Semantics-Guided Adversarial Perturbations in Multimodal Code Generation on HumanEval-X

Submitted: 31 May 2026
Review score: 7.73/10
Verification: L2, Source-grounded claims
Quality tier: DOI grade
Verified claims: 11
DOI: 10.5281/zenodo.20471022

Abstract

Abstract: This report synthesises findings from 14 peer-reviewed papers addressing the following research question: How do semantics-guided adversarial perturbations affect the pass@k scores of multimodal code generation models on the HumanEval-X benchmark across diverse programming languages. Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is based on the social value of Generation Z that online and offline selves are not different. With the technological development of deep learning-based high-precision recognition models and. 11 claims were extracted from source literature; 10 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 7.7/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research Question

How do semantics-guided adversarial perturbations affect the pass@k scores of multimodal code generation models on the HumanEval-X benchmark across diverse programming languages?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims11
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierDOI grade
BasisReview score and verified-claim count meet DOI-grade public quality thresholds.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength MEDIUM
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status HIGH

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL4, External archival record
Report artifactAvailable
External recordRegistered
Claim lineage11 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.