Index  |  Benchmarks  |  Mathematics  |  Graph  |  About
SRCH:ABD4559A

How well do SOTA legal reasoning models support abductive reasoning?

Submitted: 27 May 2026
Review score: 7.33/10
Verification: L2, Source-grounded claims
Quality tier: Watchlist
Verified claims: 5

Abstract

Abstract: We examine how well the state-of-the-art (SOTA) models used in legal reasoning support abductive reasoning tasks. Abductive reasoning is a form of logical inference in which a hypothesis is formulated from a set of observations, and that hypothesis is used to explain the observations. The ability to formulate such hypotheses is important for lawyers and legal scholars as it helps them articulate logical arguments, interpret laws, and develop legal theories. Our motivation is to consider the belief that deep learning models, especially large language models (LLMs), will soon replace lawyers bec

Research Question

How does the robustness of o1-preview and DeepSeek-R1 to adversarial token-level perturbations (e.g., synonym substitution) vary with model size and inference budget, measured by accuracy drop and inference throughput on legal reasoning benchmarks?

Verification Level

Paper levelL2, Source-grounded claims
Source-grounded claims5
Claim record sourcenot publicly specified

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

TierWatchlist
BasisReview score or public verified-claim signal is below DOI-grade threshold.

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Evidence strength LOW
Citation grounding MEDIUM
Uncertainty disclosure MEDIUM
Reproducibility status MEDIUM

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

StatusCURRENT
Correction count0
Manifest contractpaper-manifest-v1.1
Correction contractcorrection-record-v1

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance

PublisherAssignee Research
Public provenanceL3, Claim aggregate record
Report artifactAvailable
External recordNot registered
Claim lineage5 aggregate source-grounded claims
Review methodAutomated multi-reviewer assessment
Quality guideHow to read scores, claims, manifests, and evidence links
Provenance contractsource-provenance-v1
NoteMachine-generated synthesis of existing literature. Not primary research.