From Symbols to Signals: Symbolic Variational Autoencoders
Chinmaya Devaraj, Aritra Chowdhury, Arpit Jain, James R. Kubricht, Peter H. Tu, Alberto Santamaría-Pang
Abstract
We introduce Symbolic Variational Autoencoders which generate images from symbols that represent semantic concepts. Unlike generic Variational Autoencoders (VAEs) or Generative Adversarial Networks (GANs), the latent distribution from the Symbolic Variational Autoencoder is discrete. The symbols are learned in a completely unsupervised manner by reconstructing images from symbolic encodings. We demonstrate the efficacy of our symbolic approach on the MNIST and FashionMNIST datasets. Results indicate that symbolic encodings naturally form a grammar, where unique strings of symbols map to different semantic concepts. We further explore how changing these symbols affects the final image that is generated.
BibTeX
@inproceedings{icassp2020_fromsymbolstosig,
title = {From Symbols to Signals: Symbolic Variational Autoencoders},
author = {Chinmaya Devaraj and Aritra Chowdhury and Arpit Jain and James R. Kubricht and Peter H. Tu and Alberto Santamaría-Pang},
booktitle = {ICASSP 2020},
year = {2020}
}