← Search

Dario Pavllo

7 accepted papers

2023

Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers

NeurIPS 2023spotlight

Autoregressive Transformers adopted in Large Language Models (LLMs) are hard to scale to long sequences. Despite several works trying to reduce their computational cost, most of LLMs still adopt attention layers between all pairs of tokens in the sequence, thus incurring a quadratic cost. In this st…

Cited by 62SourcePDFScholar
2023

Shape, Pose, and Appearance From a Single Image via Bootstrapped Radiance Field Inversion

CVPR 2023poster

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has mostly focused on synthetic datasets where exact ground-truth…

2022

Vanishing Curvature in Randomly Initialized Deep ReLU Networks

AISTATS 2022poster

Deep ReLU networks are at the basis of many modern neural architectures. Yet, the loss landscape of such networks and its interaction with state-of-the-art optimizers is not fully understood. One of the most crucial aspects is the landscape at random initialization, which often influences convergenc…

Cited by 11SourcePDFScholar
2021

Learning Generative Models of Textured 3D Meshes From Real-World Images

ICCV 2021poster

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in computer graphics, and improve the ability of generative models to…

Cited by 56PDFcodeScholar
2020

Controlling Style and Semantics in Weakly-Supervised Image Generation

ECCV 2020poster

We propose a weakly-supervised approach for conditional image generation of complex scenes where a user has fine control over objects appearing in the scene. We exploit sparse semantic maps to control object shapes and classes, as well as textual descriptions or attributes to control both local and…

2020

Convolutional Generation of Textured 3D Meshes

NeurIPS 2020oral

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications of such models. In this work, we bridge this gap by leveragi…

2019

3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training

CVPR 2019poster

In this work, we demonstrate that 3D poses in video can be effectively estimated with a fully convolutional model based on dilated temporal convolutions over 2D keypoints. We also introduce back-projection, a simple and effective semi-supervised training method that leverages unlabeled video data. W…

Cited by 1464PDFcodeScholar