Papers
Abstract: This report synthesises findings from 11 peer-reviewed papers addressing the following research question: How does the performance of learnable visual token compression techniques compare to heuristic-based methods in cross-domain visual-language benchmarks like VQAv2 and COCO-QA, measured by accuracy. 9 claims were…
Abstract: This report synthesises findings from 11 peer-reviewed papers addressing the following research question: How does the proposed scaling law with learning rate annealing perform on multimodal code generation benchmarks like CoderBench or DeCompEval compared to traditional power-law scaling methods. 0 claims were…
Abstract: This report synthesises findings from 10 peer-reviewed papers addressing the following research question: What is the impact of model size on the scaling law parameters (L0, A, C, \$alpha\$) in the proposed formulation when evaluated on HumanEval and MBPP benchmarks for code generation tasks. 10 claims were extracted…
Abstract: This report synthesises findings from 10 peer-reviewed papers addressing the following research question: How do different learning rate annealing schedules (e.g., linear, cosine, exponential) compare in terms of pass@k scores on LiveCodeBench when applied to code generation models like Code Llama or. 16 claims were…
Abstract: This report synthesises findings from 15 peer-reviewed papers addressing the following research question: How does the scalability of video encoders trained on synthetic vs. real gesture data affect their inference throughput (measured in FPS) and memory footprint when deployed on edge devices for. 10 claims were…
Abstract: This report synthesises findings from 14 peer-reviewed papers addressing the following research question: What is the correlation between dynamic learning rate schedules and the stability of code generation models when evaluated on adversarial examples from LiveCodeBench. 4 claims were extracted from source…
Abstract: This report synthesises findings from 13 peer-reviewed papers addressing the following research question: Do open-source code models trained with cosine annealing exhibit lower accuracy drops on LiveCodeBench adversarial sets compared to those trained with step decay. 0 claims were extracted from source literature; 0…
Abstract: This report synthesises findings from 11 peer-reviewed papers addressing the following research question: What is the impact of scaling the size of pre-trained video encoder models on the robustness of training-free gesture classification using synthetic data repositories. 0 claims were extracted from source…
Abstract: This report synthesises findings from 13 peer-reviewed papers addressing the following research question: Can THaMES-driven alignment fine-tuning improve factual consistency scores on the TruthfulQA benchmark without degrading general language generation perplexity. 10 claims were extracted from source literature; 3…
Abstract: This report synthesises findings from 15 peer-reviewed papers addressing the following research question: How does few-shot prompting performance of masked language models compare to autoregressive models on cross-lingual named entity recognition benchmarks for low-resource languages. 6 claims were extracted from…
Abstract: This report synthesises findings from 12 peer-reviewed papers addressing the following research question: Which frontier language models achieve highest scores on GPQA Diamond Humanity Last Exam and difficult reasoning benchmarks v10. 0 claims were extracted from source literature; 0 were independently verified…
Abstract: This report synthesises findings from 16 peer-reviewed papers addressing the following research question: What is the impact of THaMES evaluation pipelines on the robustness of multimodal models against factually incorrect captions in the ScienceQA dataset. 5 claims were extracted from source literature; 0 were…
Abstract: This report synthesises findings from 5 peer-reviewed papers addressing the following research question: Comprehensive comparison of frontier large language models on mathematical reasoning code generation and scientific knowledge v10. 0 claims were extracted from source literature; 0 were independently verified…
Abstract: This report synthesises findings from 15 peer-reviewed papers addressing the following research question: What are the state-of-the-art large language model results on reasoning benchmarks published recently v10. 0 claims were extracted from source literature; 0 were independently verified against retrieved…
Abstract: This report synthesises findings from 12 peer-reviewed papers addressing the following research question: How do language models compare to human experts on professional knowledge and science benchmarks v10. 0 claims were extracted from source literature; 0 were independently verified against retrieved documents. An…
Abstract: This report synthesises findings from 10 peer-reviewed papers addressing the following research question: What is the effect of model size on language model performance on logical reasoning tasks v10. 14 claims were extracted from source literature; 2 were independently verified against retrieved documents. An…
Abstract: This report synthesises findings from 16 peer-reviewed papers addressing the following research question: What prompting strategies maximize language model accuracy on graduate-level science questions v10. 13 claims were extracted from source literature; 0 were independently verified against retrieved documents. An…
Abstract: This report synthesises findings from 15 peer-reviewed papers addressing the following research question: How does extended thinking time affect language model accuracy on competition-level mathematics v10. 12 claims were extracted from source literature; 2 were independently verified against retrieved documents. An…
Abstract: This report synthesises findings from 14 peer-reviewed papers addressing the following research question: How does synthetic training data improve language model performance on mathematical reasoning benchmarks v10. 0 claims were extracted from source literature; 0 were independently verified against retrieved…
Abstract: This report synthesises findings from 16 peer-reviewed papers addressing the following research question: How does model quantization affect reasoning capability in large language models v10. 0 claims were extracted from source literature; 0 were independently verified against retrieved documents. An automated…
Abstract: This report synthesises findings from 11 peer-reviewed papers addressing the following research question: How do language models handle multi-hop reasoning chains in scientific question answering v10. 11 claims were extracted from source literature; 0 were independently verified against retrieved documents. An…
Abstract: This report synthesises findings from 12 peer-reviewed papers addressing the following research question: What is the effect of instruction fine-tuning on language model mathematical problem-solving accuracy v10. 9 claims were extracted from source literature; 4 were independently verified against retrieved…
Abstract: This report synthesises findings from 15 peer-reviewed papers addressing the following research question: What training strategies improve language model generalization to novel mathematical reasoning problems v10. 5 claims were extracted from source literature; 0 were independently verified against retrieved…
Abstract: This report synthesises findings from 12 peer-reviewed papers addressing the following research question: What is the comparative performance of open-source language models versus proprietary models on coding benchmarks v10. 10 claims were extracted from source literature; 2 were independently verified against…
Abstract: This report synthesises findings from 4 peer-reviewed papers addressing the following research question: What are the failure modes of frontier language models on abstract mathematical reasoning v10. 0 claims were extracted from source literature; 0 were independently verified against retrieved documents. An…