{"schema":"https://assignee.net/schemas/benchmark-evidence-v1","schema_version":"1.0","contract_version":"benchmark-evidence-v1.0","contract_updated":"2026-06-01","schema_documentation":"https://assignee.net/schemas","changelog_url":"https://assignee.net/changelog","publisher":{"name":"Assignee Research","url":"https://assignee.net"},"html_url":"https://assignee.net/benchmarks/evidence?model=Qwen3&bench=SWE-bench","json_url":"https://assignee.net/benchmarks/evidence.json?model=Qwen3&bench=SWE-bench","model":"Qwen3","benchmark":"SWE-bench","source_count":1,"source_coverage":{"record_count":1,"distinct_source_count":1,"coverage_level":"LIMITED","basis":"distinct public paper URLs or titles in this evidence cluster"},"source_profile":{"source_url_count":1,"missing_source_url_count":0,"domains":["doi.org"],"year_min":2025,"year_max":2025,"basis":"public source URLs, source titles, and reported publication years in this evidence cluster"},"reported_range":{"min_score_pct":69.6,"max_score_pct":69.6},"spread_pp":0.0,"severity":"NONE","entries":[{"model":"Qwen3","benchmark":"SWE-bench","score_pct":69.6,"source_title":"Open-Source vs. Commercial Coding Assistants: A 2025 Comparison of DeepSeek R1, Qwen 2.5 and Claude 3.7","source_url":"https://doi.org/10.20944/preprints202508.1904.v1","source_domain":"doi.org","year":2025}],"interpretation":"This record groups score claims extracted from papers for the same model and benchmark label. A nonzero spread means the public literature reports different values for this cluster.","limitations":["Differences are not automatically errors.","Reported values may differ because of prompts, dataset versions, evaluation protocols, scoring rules, preprocessing, fine-tuning, or reporting conventions.","Source papers remain authoritative for their own claims."]}