← Search

Jakub Grudzien Kuba

5 accepted papers

2026

Cliqueformer: Model-Based Optimization with Structured Transformers

AAAI 2026technical

Large neural networks excel at prediction tasks, but their application to design problems, such as protein engineering or materials discovery, requires solving offline model-based optimization (MBO) problems. While predictive models may not directly translate to effective design, recent MBO algorith

Cited by 0SourcePDFScholar
2022

Discovered Policy Optimisation

NeurIPS 2022accept

Tremendous progress has been made in reinforcement learning (RL) over the past decade. Most of these advancements came through the continual development of new algorithms, which were designed using a combination of mathematical derivations, intuitions, and experimentation. Such an approach of creati…

Cited by 93SourcePDFScholar
2022

Multi-Agent Reinforcement Learning is a Sequence Modeling Problem

NeurIPS 2022accept

Large sequence models (SM) such as GPT series and BERT have displayed outstanding performance and generalization capabilities in natural language process, vision and recently reinforcement learning. A natural follow-up question is how to abstract multi-agent decision making also as an sequence model…

2022

Trust Region Policy Optimisation in Multi-Agent Reinforcement Learning

ICLR 2022poster

Trust region methods rigorously enabled reinforcement learning (RL) agents to learn monotonically improving policies, leading to superior performance on a variety of tasks. Unfortunately, when it comes to multi-agent reinforcement learning (MARL), the property of monotonic improvement may not simpl…

Cited by 329SourcePDFScholar
2021

Settling the Variance of Multi-Agent Policy Gradients

NeurIPS 2021poster

Policy gradient (PG) methods are popular reinforcement learning (RL) methods where a baseline is often applied to reduce the variance of gradient estimates. In multi-agent RL (MARL), although the PG theorem can be naturally extended, the effectiveness of multi-agent PG (MAPG) methods degrades as th…