← Search

Thomas Carta

5 accepted papers

2025

MAGELLAN: Metacognitive predictions of learning progress guide autotelic LLM agents in large goal spaces

ICML 2025poster

Open-ended learning agents must efficiently prioritize goals in vast possibility spaces, focusing on those that maximize learning progress (LP). When such autotelic exploration is achieved by LLM agents trained with online RL in high-dimensional and evolving goal spaces, a key challenge for LP predi…

2025

Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfitting

NAACL 2025findings

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of fine-tuning them with RL in a specific environment. In this paper,…

Cited by 1SourcePDFScholar
2024

Leveraging Visual Handicaps for Text-Based Reinforcement Learning

ICASSP 2024accepted

We introduce VisualHandicaps, a novel benchmark environment for the systematic analysis of interactive text-based reinforcement learning (TBRL) agents by providing visual handicaps. Unlike previous TBRL environments, which focus on providing additional textual information to measure agent understand…

Cited by 0SourceScholar
2023

Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning

ICML 2023poster

Recent works successfully leveraged Large Language Models' (LLM) abilities to capture abstract knowledge about world's physics to solve decision-making problems. Yet, the alignment between LLMs' knowledge and the environment can be wrong and limit functional competence due to lack of grounding. In t…

Cited by 199SourcePDFScholar
2022

EAGER: Asking and Answering Questions for Automatic Reward Shaping in Language-guided RL

NeurIPS 2022accept

Reinforcement learning (RL) in long horizon and sparse reward tasks is notoriously difficult and requires a lot of training steps. A standard solution to speed up the process is to leverage additional reward signals, shaping it to better guide the learning process. In the context of language-conditi…