How does the inference efficiency (throughput, latency) of SecLM-fine-tuned Llama3, Codestral, and Deepseek R1

Abstract

Abstract: Large language models (LLMs) such as GPT-4o and Claude Sonnet 4.5 have demonstrated strong capabilities in open-ended reasoning and generative language tasks, leading to their widespread adoption across a broad range of NLP applications. However, for structured text classification problems with fixed label spaces, model selection is often driven by predictive performance alone, overlooking operational constraints encountered in production systems. In this work, we present a systematic comparison of two contrasting paradigms for text classification: zero- and few-shot prompt-based large langu

Research Question

How does the inference efficiency (throughput, latency) of SecLM-fine-tuned Llama3, Codestral, and Deepseek R1 vary across different programming languages (Python, Java, C/C++) when deployed on edge devices with limited compute resources?

Verification Level

Descriptive public verification status only; aggregate claim counts are public, but individual claim records are not exposed here.

Quality Tier

Descriptive public triage only; this tier does not alter current publication or DOI behavior.

Quality Dimensions

Automated triage signals derived from public fields; not human peer review or independent validation.

Correction Record

Public corrections are additive records. Current status does not claim the synthesis is error-free.

Provenance