← Search

Antonis Antoniades

4 accepted papers

2025

Generalization v.s. Memorization: Tracing Language Models’ Capabilities Back to Pretraining Data

ICLR 2025poster

The impressive capabilities of large language models (LLMs) have sparked debate over whether these models genuinely generalize to unseen tasks or predominantly rely on memorizing vast amounts of pretraining data. To explore this issue, we introduce an extended concept of memorization, distributional…

Cited by 0SourcePDFScholar
2025

SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement

ICLR 2025poster

Software engineers operating in complex and dynamic environments must continuously adapt to evolving requirements, learn iteratively from experience, and reconsider their approaches based on new insights. However, current large language model (LLM)-based software agents often follow linear, sequenti…

Cited by 14SourcePDFScholar
2024

MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debate

EMNLP 2024finding

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of these models as agents, enabling interactions among multiple mo…

2024

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

ICLR 2024poster

State-of-the-art systems neuroscience experiments yield large-scale multimodal data, and these data sets require new tools for analysis. Inspired by the success of large pretrained models in vision and language domains, we reframe the analysis of large-scale, cellular-resolution neuronal spiking dat…

Cited by 13SourcePDFScholar