Galen Chuang — accepted AI-conference papers

2018

Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input

David Harwath, Adria Recasens, Didac Suris, Galen Chuang, Antonio Torralba, James Glass

ECCV 2018poster

In this paper, we explore neural network models that learn to associate segments of spoken audio captions with the semantically relevant portions of natural images that they refer to. We demonstrate that these audio-visual associative localizations emerge from network-internal representations learne…

Cited by 254 Source ↗PDF ↗Scholar ↗

2018

Vision as an Interlingua: Learning Multilingual Semantic Embeddings of Untranscribed Speech

David Harwath, Galen Chuang, James R. Glass

ICASSP 2018accepted

In this paper, we explore the learning of neural network embeddings for natural images and speech waveforms describing the content of those images. These embeddings are learned directly from the waveforms without the use of linguistic transcriptions or conventional speech recognition technology. Whi…

Cited by 0 Source ↗Scholar ↗