Kazuhiko Sumi

Attention-Based Multimodal Fusion for Video Description

Current methods for video description are based on encoder-decoder sentence generation using recurrent neural networks (RNNs). Recent work has demonstrated the advantages of integrating temporal attention mechanisms into these models, in which the decoder network predicts each word in the descriptio…