← Search

Brendan Duke

4 accepted papers

2023

Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers

CVPR 2023poster

Vision Transformers (ViT) have shown competitive advantages in terms of performance compared to convolutional neural networks (CNNs), though they often come with high computational costs. To this end, previous methods explore different attention patterns by limiting a fixed number of spatially nearb…

Cited by 19SourcePDFScholar
2022

Exploring Gradient-Based Multi-directional Controls in GANs

ECCV 2022poster

"Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its controllable generation an open problem, especially when spuri…

2021

LOHO: Latent Optimization of Hairstyles via Orthogonalization

CVPR 2021poster

Hairstyle transfer is challenging due to hair structure differences in the source and target hair. Therefore, we propose Latent Optimization of Hairstyles via Orthogonalization (LOHO), an optimization-based approach using GAN inversion to infill missing hair structure details in latent space during…

Cited by 60PDFcodeScholar
2021

SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation

CVPR 2021poster

In this paper we introduce a Transformer-based approach to video object segmentation (VOS). To address compounding error and scalability issues of prior work, we propose a scalable, end-to-end method for VOS called Sparse Spatiotemporal Transformers (SST). SST extracts per-pixel representations for…

Cited by 217PDFcodeScholar