← Search

Oliver Schulte

12 accepted papers

2023

Cause-Effect Inference in Location-Scale Noise Models: Maximum Likelihood vs. Independence Testing

NeurIPS 2023poster

A fundamental problem of causal discovery is cause-effect inference, to learn the correct causal direction between two random variables. Significant progress has been made through modelling the effect as a function of its cause and a noise term, which allows us to leverage assumptions about the gene…

2023

Generative Causal Representation Learning for Out-of-Distribution Motion Forecasting

ICML 2023poster

Conventional supervised learning methods typically assume i.i.d samples and are found to be sensitive to out-of-distribution (OOD) data. We propose Generative Causal Representation Learning (GCRL) which leverages causality to facilitate knowledge transfer under distribution shifts. While we evaluate…

Cited by 13SourcePDFScholar
2023

NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledge

AISTATS 2023poster

We describe NTS-NOTEARS, a score-based structure learning method for time-series data to learn dynamic Bayesian networks (DBNs) that captures nonlinear, lagged (inter-slice) and instantaneous (intra-slice) relations among variables. NTS-NOTEARS utilizes 1D convolutional neural networks (CNNs) to mod…

2022

Distributional Reinforcement Learning with Monotonic Splines

ICLR 2022poster

Distributional Reinforcement Learning (RL) differs from traditional RL by estimating the distribution over returns to capture the intrinsic uncertainty of MDPs. One key challenge in distributional RL lies in how to parameterize the quantile function when minimizing the Wasserstein metric of temporal…

Cited by 21SourcePDFScholar
2022

Micro and Macro Level Graph Modeling for Graph Variational Auto-Encoders

NeurIPS 2022accept

Generative models for graph data are an important research topic in machine learning. Graph data comprise two levels that are typically analyzed separately: node-level properties such as the existence of a link between a pair of nodes, and global aggregate graph-level statistics, such as motif count…

2022

Uncertainty-Aware Reinforcement Learning for Risk-Sensitive Player Evaluation in Sports Game

NeurIPS 2022accept

A major task of sports analytics is player evaluation. Previous methods commonly measured the impact of players' actions on desirable outcomes (e.g., goals or winning) without considering the risk induced by stochastic game dynamics. In this paper, we design an uncertainty-aware Reinforcement Learn…

Cited by 14SourcePDFScholar
2021

Learning Tree Interpretation from Object Representation for Deep Reinforcement Learning

NeurIPS 2021poster

Interpreting Deep Reinforcement Learning (DRL) models is important to enhance trust and comply with transparency regulations. Existing methods typically explain a DRL model by visualizing the importance of low-level input features with super-pixels, attentions, or saliency maps. Our approach provide…

Cited by 20SourcePDFScholar
2020

Inverse Reinforcement Learning for Team Sports: Valuing Actions and Players

IJCAI 2020poster

A major task of sports analytics is to rank players based on the impact of their actions. Recent methods have applied reinforcement learning (RL) to assess the value of actions from a learned action value or Q-function. A fundamental challenge for estimating action values is that explicit reward sig…

2020

Learning Agent Representations for Ice Hockey

NeurIPS 2020poster

Team sports is a new application domain for agent modeling with high real-world impact. A fundamental challenge for modeling professional players is their large number (over 1K), which includes many bench players with sparse participation in a game season. The diversity and sparsity of player observ…