Visalogy: Answering Visual Analogy Questions
Fereshteh Sadeghi, C. Lawrence Zitnick, Ali Farhadi
Abstract
In this paper, we study the problem of answering visual analogy questions. These questions take the form of image A is to image B as image C is to what. Answering these questions entails discovering the mapping from image A to image B and then extending the mapping to image C and searching for the image D such that the relation from A to B holds for C to D. We pose this problem as learning an embedding that encourages pairs of analogous images with similar transformations to be close together using convolutional neural networks with a quadruple Siamese architecture. We introduce a dataset of visual analogy questions in natural images, and show first results of its kind on solving analogy questions on natural images.
BibTeX
@inproceedings{NIPS2015_45f31d16,
author = {Sadeghi, Fereshteh and Zitnick, C. Lawrence and Farhadi, Ali},
booktitle = {Advances in Neural Information Processing Systems},
editor = {C. Cortes and N. Lawrence and D. Lee and M. Sugiyama and R. Garnett},
pages = {},
publisher = {Curran Associates, Inc.},
title = {Visalogy: Answering Visual Analogy Questions},
url = {https://proceedings.neurips.cc/paper_files/paper/2015/file/45f31d16b1058d586fc3be7207b58053-Paper.pdf},
volume = {28},
year = {2015}
}