← Search

Artyom Sorokin

4 accepted papers

2026

Q-RAG: Long Context Multi‑Step Retrieval via Value‑Based Embedder Training

ICLR 2026oral

Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and inference cost. However, most existing RAG methods focus on single-step retrieval, which is often insufficient for answering complex questions that req…

Cited by 0SourcecodeScholar
2025

AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents

IJCAI 2025

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and updating their knowledge. Current LLM-based agents process past

2024

BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack

NeurIPS 2024spotlight

In recent years, the input context sizes of large language models (LLMs) have increased dramatically. However, existing evaluation methods have not kept pace, failing to comprehensively assess the efficiency of models in handling long contexts. To bridge this gap, we introduce the BABILong benchmark…

2022

Explain My Surprise: Learning Efficient Long-Term Memory by predicting uncertain outcomes

NeurIPS 2022accept

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored for every element of a sequence. This requires to store prohi…