← Search

Pedro Zuidberg Dos Martires

17 accepted papers

2026

APC-RL: Exceeding data-driven behavior priors with adaptive policy composition

ICLR 2026poster

Incorporating demonstration data into reinforcement learning (RL) can greatly accelerate learning, but existing approaches often assume demonstrations are optimal and fully aligned with the target task. In practice, demonstrations are frequently sparse, suboptimal, or misaligned, which can degrade p…

Cited by 0SourceScholar
2026

Two Constraint Compilation Methods for Lifted Planning

AAAI 2026technical

We study planning in a fragment of PDDL with qualitative state-trajectory constraints, capturing safety requirements, task ordering conditions, and intermediate sub-goals commonly found in real-world problems. A prominent approach to tackle such problems is to compile their constraints away, leading

Cited by 0SourcePDFScholar
2025

KLay: Accelerating Arithmetic Circuits for Neurosymbolic AI

ICLR 2025poster

A popular approach to neurosymbolic AI involves mapping logic formulas to arithmetic circuits (computation graphs consisting of sums and products) and passing the outputs of a neural network through these circuits. This approach enforces symbolic constraints onto a neural network in a principled and…

Cited by 0SourcePDFScholar
2025

LexiCon: a Benchmark for Planning under Temporal Constraints in Natural Language

NeurIPS 2025poster

Owing to their reasoning capabilities, large language models (LLMs) have been evaluated on planning tasks described in natural language. However, LLMs have largely been tested on planning domains without constraints. In order to deploy them in real-world settings where adherence to constraints, in p…

Cited by 0SourceScholar
2025

REvolve: Reward Evolution with Large Language Models using Human Feedback

ICLR 2025poster

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify explicitly. In recent works, large language models (LLMs) have bee…

Cited by 1SourcePDFScholar
2024

A Fast Convoluted Story: Scaling Probabilistic Inference for Integer Arithmetics

NeurIPS 2024poster

As illustrated by the success of integer linear programming, linear integer arithmetics is a powerful tool for modelling combinatorial problems. Furthermore, the probabilistic extension of linear programming has been used to formulate problems in neurosymbolic AI. However, two key problems persist t…

Cited by 0SourcePDFScholar
2024

Inference and Learning in Dynamic Decision Networks Using Knowledge Compilation

AAAI 2024technical

Decision making under uncertainty in dynamic environments is a fundamental AI problem in which agents need to determine which decisions (or actions) to make at each time step to maximise their expected utility. Dynamic decision networks (DDNs) are an extension of dynamic Bayesian networks with decis…

2024

SayCanPay: Heuristic Planning with Large Language Models Using Learnable Domain Knowledge

AAAI 2024technical

Large Language Models (LLMs) have demonstrated impressive planning abilities due to their vast "world knowledge". Yet, obtaining plans that are both feasible (grounded in affordances) and cost-effective (in plan length), remains a challenge, despite recent progress. This contrasts with heuristic pla…

Cited by 42SourcePDFScholar
2023

Differentiable Sampling of Categorical Distributions Using the CatLog-Derivative Trick

NeurIPS 2023poster

Categorical random variables can faithfully represent the discrete and uncertain aspects of data as part of a discrete latent variable model. Learning in such models necessitates taking gradients with respect to the parameters of the categorical probability distributions, which is often intractable…

Cited by 14SourcePDFScholar
2023

Neural probabilistic logic programming in discrete-continuous domains

UAI 2023poster

Neural-symbolic AI (NeSy) allows neural networks to exploit symbolic background knowledge in the form of logic. It has been shown to aid learning in the limited data regime and to facilitate inference on out-of-distribution data. Probabilistic NeSy focuses on integrating neural networks with both lo…

Cited by 16SourcePDFScholar
2022

Inference and Learning with Model Uncertainty in Probabilistic Logic Programs

AAAI 2022technical

An issue that has so far received only limited attention in probabilistic logic programming (PLP) is the modelling of so-called epistemic uncertainty, the uncertainty about the model itself. Accurately quantifying this model uncertainty is paramount to robust inference, learning and ultimately decis…

2021

Hybrid Probabilistic Inference with Logical and Algebraic Constraints: a Survey

IJCAI 2021poster

Real world decision making problems often involve both discrete and continuous variables and require a combination of probabilistic and deterministic knowledge. Stimulated by recent advances in automated reasoning technology, hybrid (discrete+continuous) probabilistic…

2020

Ordering Variables for Weighted Model Integration

UAI 2020poster

State-of-the-art probabilistic inference algorithms, such as variable elimination and search-based approaches, rely heavily on the order in which variables are marginalized. Finding the optimal ordering is an NP-complete problem. This computational hardness has led to heuristics to find adequate v…

2020

ProbAnch: a Modular Probabilistic Anchoring Framework

IJCAI 2020poster

Modeling object representations derived from perceptual observations, in a way that is also semantically meaningful for humans as well as autonomous agents, is a prerequisite for joint human-agent understanding of the world. A practical approach that aims to model such representations is perceptual…

2019

How to Exploit Structure while Solving Weighted Model Integration Problems

UAI 2019poster

Weighted model counting (WMC) is a state-of-the-art technique for probabilistic inference in discrete domains. WMC has recently been extended towards weighted model integration (WMI) in order to handle discrete and continuous distributions alike. While a number of WMI solvers have been introduced, t…

Cited by 21SourcePDFScholar