← Search

Shir Gur

12 accepted papers

2022

Unsupervised Disentanglement with Tensor Product Representations on the Torus

ICLR 2022poster

The current methods for learning representations with auto-encoders almost exclusively employ vectors as the latent representations. In this work, we propose to employ a tensor product structure for this purpose. This way, the obtained representations are naturally disentangled. In contrast to the…

2021

Cross-Modal Retrieval Augmentation for Multi-Modal Classification

EMNLP 2021finding

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge sources of images and their corresponding captions for improving v…

Cited by 29SourcePDFScholar
2021

Generic Attention-Model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers

ICCV 2021poster

Transformers are increasingly dominating multi-modal reasoning tasks, such as visual question answering, achieving state-of-the-art results thanks to their ability to contextualize information using the self-attention and co-attention mechanisms. These attention modules also play a role in other com…

Cited by 392PDFcodeScholar
2021

Visualization of Supervised and Self-Supervised Neural Networks via Attribution Guided Factorization

AAAI 2021technical

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we show, these methods are limited in their ability to identify t…

2020

Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Sample

NeurIPS 2020poster

We consider the task of generating diverse and novel videos from a single video sample. Recently, new hierarchical patch-GAN based approaches were proposed for generating diverse images, given only a single sample at training time. Moving to videos, these approaches fail to generate diverse samples,…

2019

Unsupervised Microvascular Image Segmentation Using an Active Contours Mimicking Neural Network

ICCV 2019accepted

The task of blood vessel segmentation in microscopy images is crucial for many diagnostic and research applications. However, vessels can look vastly different, depending on the transient imaging conditions, and collecting data for supervised training is laborious. We present a novel deep learning m…