← Search

Brendan Jou

3 accepted papers

2024

A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation

NeurIPS 2024poster

Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training a separate model for each task which is expensive. Here, we…

2022

DISSECT: Disentangled Simultaneous Explanations via Concept Traversals

ICLR 2022poster

Explaining deep learning model inferences is a promising venue for scientific understanding, improving safety, uncovering hidden biases, evaluating fairness, and beyond, as argued by many scholars. One of the principal benefits of counterfactual explanations is allowing users to explore "what-if" sc…

2018

Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

ICLR 2018poster

Recurrent Neural Networks (RNNs) continue to show outstanding performance in sequence modeling tasks. However, training RNNs on long sequences often face challenges like slow inference, vanishing gradients and difficulty in capturing long term dependencies. In backpropagation through time settings,…