← Search

Mikhail Plekhanov

3 accepted papers

2026

Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments

ICLR 2026oral

We introduce **Gaia2**, a benchmark for evaluating large language model agents in realistic, asynchronous environments. Unlike prior static or synchronous evaluations, Gaia2 introduces scenarios where environments evolve independently of agent actions, requiring agents to operate under temporal cons…

Cited by 0SourceScholar
2023

Polar Ducks and Where to Find Them: Enhancing Entity Linking with Duck Typing and Polar Box Embeddings

EMNLP 2023long main

Entity linking methods based on dense retrieval are widely adopted in large-scale applications for their efficiency, but they can fall short of generative models, as they are sensitive to the structure of the embedding space. To address this issue, this paper introduces DUCK, an approach to infusing…

Cited by 0SourceScholar
2022

EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing

EMNLP 2022main

Existing work on Entity Linking mostly assumes that the reference knowledge base is complete, and therefore all mentions can be linked. In practice this is hardly ever the case, as knowledge bases are incomplete and because novel concepts arise constantly. We introduce the temporally segmented Unkno…