Gradient-Based Neural DAG Learning
Sébastien Lachapelle, Philippe Brouillard, Tristan Deleu, Simon Lacoste-Julien
Abstract
We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables using neural networks. This extension allows to model complex interactions while avoiding the combinatorial nature of the problem. In addition to comparing our method to existing continuous optimization methods, we provide missing empirical comparisons to nonlinear greedy search methods. On both synthetic and real-world data sets, this new method outperforms current continuous methods on most tasks while being competitive with existing greedy search methods on important metrics for causal inference.
BibTeX
@inproceedings{
Lachapelle2020Gradient-Based,
title={Gradient-Based Neural DAG Learning},
author={Sébastien Lachapelle and Philippe Brouillard and Tristan Deleu and Simon Lacoste-Julien},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rklbKA4YDS}
}