Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:BCEC5CEF

What is the impact of fine-tuning on negative interaction trajectories versus positive-only trajectories for L

Submitted: 28 May 2026
Review score: 8.17/10
Verification: L2, Source-grounded claims
Quality tier: DOI grade
Verified claims: 5
DOI: 10.5281/zenodo.20423642

Abstract

Abstract: Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain the

Research Question

What is the impact of fine-tuning on negative interaction trajectories versus positive-only trajectories for LLM agent tool-use accuracy on the WebShop benchmark, measured by success rate and average reward?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims5
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierDOI grade
BasisReview score and verified-claim count meet DOI-grade public quality thresholds.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength MEDIUM
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status HIGH

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL4, External archival record
Report artifactAvailable
External recordRegistered
Claim lineage5 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.